Jul 29 15:46:38.042714 ip-10-0-141-213 systemd[1]: Starting Kubernetes Kubelet... Jul 29 15:46:38.432519 ip-10-0-141-213 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 15:46:38.432519 ip-10-0-141-213 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 29 15:46:38.432519 ip-10-0-141-213 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 15:46:38.432519 ip-10-0-141-213 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 29 15:46:38.432519 ip-10-0-141-213 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 15:46:38.433098 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.432570 2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 29 15:46:38.437367 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437352 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:46:38.437367 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437366 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:46:38.437367 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437370 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:46:38.437473 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437373 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:46:38.437473 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437376 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:46:38.437473 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437379 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:46:38.437473 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437383 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:46:38.437473 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437385 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:46:38.437473 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437388 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:46:38.437473 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437390 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:46:38.437473 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437393 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:46:38.437473 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437395 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:46:38.437473 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437398 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:46:38.437473 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437401 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:46:38.437473 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437404 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:46:38.437473 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437406 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:46:38.437473 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437409 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:46:38.437473 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437413 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:46:38.437473 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437417 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:46:38.437473 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437420 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:46:38.437473 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437423 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:46:38.437473 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437425 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:46:38.437473 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437428 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:46:38.437948 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437431 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:46:38.437948 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437448 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:46:38.437948 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437453 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:46:38.437948 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437457 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:46:38.437948 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437461 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:46:38.437948 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437465 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:46:38.437948 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437469 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:46:38.437948 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437472 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:46:38.437948 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437475 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:46:38.437948 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437478 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:46:38.437948 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437481 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:46:38.437948 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437484 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:46:38.437948 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437486 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:46:38.437948 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437490 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:46:38.437948 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437492 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:46:38.437948 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437495 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:46:38.437948 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437498 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:46:38.437948 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437502 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:46:38.437948 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437505 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:46:38.438410 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437507 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:46:38.438410 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437510 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:46:38.438410 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437513 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:46:38.438410 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437515 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:46:38.438410 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437518 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:46:38.438410 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437522 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:46:38.438410 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437524 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:46:38.438410 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437527 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:46:38.438410 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437530 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:46:38.438410 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437533 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:46:38.438410 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437535 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:46:38.438410 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437538 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:46:38.438410 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437540 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:46:38.438410 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437543 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:46:38.438410 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437546 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:46:38.438410 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437549 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:46:38.438410 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437551 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:46:38.438410 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437554 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:46:38.438410 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437556 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:46:38.438410 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437559 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:46:38.438910 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437562 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:46:38.438910 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437565 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:46:38.438910 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437567 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:46:38.438910 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437570 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:46:38.438910 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437573 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:46:38.438910 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437575 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:46:38.438910 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437578 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:46:38.438910 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437581 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:46:38.438910 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437583 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:46:38.438910 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437586 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:46:38.438910 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437588 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:46:38.438910 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437592 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:46:38.438910 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437594 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:46:38.438910 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437597 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:46:38.438910 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437599 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:46:38.438910 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437602 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:46:38.438910 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437605 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:46:38.438910 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437607 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:46:38.438910 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437611 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:46:38.438910 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437613 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:46:38.439379 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437616 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:46:38.439379 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437618 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:46:38.439379 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437621 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:46:38.439379 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437623 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:46:38.439379 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437626 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:46:38.439379 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437628 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:46:38.439379 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437631 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:46:38.439379 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437634 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:46:38.439379 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437636 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:46:38.439379 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437640 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:46:38.439379 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437643 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:46:38.439379 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437646 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:46:38.439379 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437649 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:46:38.439379 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437652 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:46:38.439379 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437655 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:46:38.439379 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437658 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:46:38.439379 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.437660 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:46:38.439379 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438338 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:46:38.439379 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438345 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:46:38.439849 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438347 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:46:38.439849 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438350 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:46:38.439849 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438353 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:46:38.439849 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438356 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:46:38.439849 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438358 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:46:38.439849 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438361 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:46:38.439849 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438364 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:46:38.439849 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438366 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:46:38.439849 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438369 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:46:38.439849 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438371 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:46:38.439849 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438374 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:46:38.439849 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438377 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:46:38.439849 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438380 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:46:38.439849 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438383 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:46:38.439849 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438386 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:46:38.439849 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438388 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:46:38.439849 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438391 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:46:38.439849 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438394 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:46:38.439849 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438396 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:46:38.439849 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438399 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:46:38.440337 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438402 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:46:38.440337 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438404 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:46:38.440337 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438407 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:46:38.440337 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438409 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:46:38.440337 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438412 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:46:38.440337 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438414 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:46:38.440337 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438417 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:46:38.440337 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438420 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:46:38.440337 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438422 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:46:38.440337 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438425 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:46:38.440337 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438427 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:46:38.440337 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438430 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:46:38.440337 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438432 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:46:38.440337 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438455 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:46:38.440337 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438458 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:46:38.440337 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438461 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:46:38.440337 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438463 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:46:38.440337 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438466 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:46:38.440337 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438469 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:46:38.440337 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438471 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:46:38.440834 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438474 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:46:38.440834 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438476 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:46:38.440834 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438479 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:46:38.440834 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438482 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:46:38.440834 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438484 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:46:38.440834 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438490 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:46:38.440834 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438493 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:46:38.440834 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438496 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:46:38.440834 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438499 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:46:38.440834 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438501 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:46:38.440834 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438504 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:46:38.440834 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438508 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:46:38.440834 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438510 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:46:38.440834 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438513 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:46:38.440834 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438515 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:46:38.440834 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438518 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:46:38.440834 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438521 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:46:38.440834 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438523 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:46:38.440834 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438527 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:46:38.440834 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438529 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:46:38.441313 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438532 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:46:38.441313 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438535 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:46:38.441313 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438537 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:46:38.441313 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438540 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:46:38.441313 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438542 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:46:38.441313 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438545 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:46:38.441313 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438547 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:46:38.441313 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438550 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:46:38.441313 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438552 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:46:38.441313 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438555 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:46:38.441313 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438557 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:46:38.441313 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438561 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:46:38.441313 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438566 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:46:38.441313 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438569 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:46:38.441313 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438573 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:46:38.441313 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438576 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:46:38.441313 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438579 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:46:38.441313 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438589 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:46:38.441313 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438594 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:46:38.441789 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438597 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:46:38.441789 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438599 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:46:38.441789 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438602 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:46:38.441789 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438604 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:46:38.441789 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438607 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:46:38.441789 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438610 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:46:38.441789 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438612 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:46:38.441789 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438615 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:46:38.441789 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438617 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:46:38.441789 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438620 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:46:38.441789 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438622 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:46:38.441789 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438625 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:46:38.441789 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438628 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:46:38.441789 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438632 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:46:38.441789 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438635 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:46:38.441789 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438638 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:46:38.441789 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438641 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:46:38.441789 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438644 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:46:38.441789 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438994 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:46:38.442263 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.438998 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:46:38.442263 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439001 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:46:38.442263 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439004 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:46:38.442263 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439007 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:46:38.442263 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439010 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:46:38.442263 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439013 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:46:38.442263 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439016 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:46:38.442263 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439019 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:46:38.442263 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439022 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:46:38.442263 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439025 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:46:38.442263 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439028 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:46:38.442263 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439031 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:46:38.442263 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439034 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:46:38.442263 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439036 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:46:38.442263 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439039 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:46:38.442263 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439042 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:46:38.442263 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439045 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:46:38.442263 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439047 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:46:38.442263 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439050 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:46:38.442263 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439053 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:46:38.442811 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439056 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:46:38.442811 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439059 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:46:38.442811 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439061 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:46:38.442811 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439064 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:46:38.442811 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439066 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:46:38.442811 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439070 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:46:38.442811 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439072 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:46:38.442811 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439075 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:46:38.442811 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439077 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:46:38.442811 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439080 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:46:38.442811 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439082 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:46:38.442811 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439085 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:46:38.442811 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439088 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:46:38.442811 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439091 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:46:38.442811 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439094 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:46:38.442811 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439096 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:46:38.442811 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439099 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:46:38.442811 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439101 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:46:38.442811 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439104 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:46:38.443265 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439106 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:46:38.443265 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439109 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:46:38.443265 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439111 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:46:38.443265 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439114 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:46:38.443265 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439116 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:46:38.443265 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439119 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:46:38.443265 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439122 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:46:38.443265 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439124 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:46:38.443265 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439127 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:46:38.443265 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439129 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:46:38.443265 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439132 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:46:38.443265 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439135 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:46:38.443265 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439137 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:46:38.443265 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439142 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:46:38.443265 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439145 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:46:38.443265 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439148 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:46:38.443265 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439150 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:46:38.443265 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439153 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:46:38.443265 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439156 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:46:38.443265 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439159 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:46:38.443761 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439161 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:46:38.443761 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439164 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:46:38.443761 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439167 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:46:38.443761 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439169 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:46:38.443761 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439172 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:46:38.443761 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439174 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:46:38.443761 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439177 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:46:38.443761 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439179 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:46:38.443761 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439182 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:46:38.443761 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439184 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:46:38.443761 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439187 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:46:38.443761 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439190 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:46:38.443761 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439193 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:46:38.443761 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439195 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:46:38.443761 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439198 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:46:38.443761 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439200 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:46:38.443761 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439203 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:46:38.443761 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439205 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:46:38.443761 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439208 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:46:38.444239 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439210 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:46:38.444239 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439213 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:46:38.444239 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439217 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:46:38.444239 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439220 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:46:38.444239 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439225 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:46:38.444239 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439228 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:46:38.444239 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439231 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:46:38.444239 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439234 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:46:38.444239 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439237 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:46:38.444239 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439239 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:46:38.444239 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439242 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:46:38.444239 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439246 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:46:38.444239 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439249 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:46:38.444239 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439252 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:46:38.444239 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439254 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:46:38.444239 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439257 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:46:38.444239 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439259 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:46:38.444239 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439262 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:46:38.444239 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439264 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:46:38.444239 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439267 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:46:38.444755 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439331 2584 flags.go:64] FLAG: --address="0.0.0.0" Jul 29 15:46:38.444755 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439338 2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 29 15:46:38.444755 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439391 2584 flags.go:64] FLAG: --anonymous-auth="true" Jul 29 15:46:38.444755 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439396 2584 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 29 15:46:38.444755 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439400 2584 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 29 15:46:38.444755 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439404 2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 29 15:46:38.444755 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439410 2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 29 15:46:38.444755 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439414 2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 29 15:46:38.444755 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439417 2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 29 15:46:38.444755 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439420 2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 29 15:46:38.444755 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439424 2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 29 15:46:38.444755 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439427 2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 29 15:46:38.444755 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439430 2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 29 15:46:38.444755 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439447 2584 flags.go:64] FLAG: --cgroup-root="" Jul 29 15:46:38.444755 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439452 2584 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 29 15:46:38.444755 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439455 2584 flags.go:64] FLAG: --client-ca-file="" Jul 29 15:46:38.444755 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439459 2584 flags.go:64] FLAG: --cloud-provider="external" Jul 29 15:46:38.444755 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439462 2584 flags.go:64] FLAG: --cluster-dns="[]" Jul 29 15:46:38.444755 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439466 2584 flags.go:64] FLAG: --cluster-domain="" Jul 29 15:46:38.444755 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439469 2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 29 15:46:38.444755 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439472 2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 29 15:46:38.444755 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439476 2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 29 15:46:38.444755 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439479 2584 flags.go:64] FLAG: --container-log-max-files="5" Jul 29 15:46:38.444755 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439482 2584 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 29 15:46:38.445357 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439485 2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 29 15:46:38.445357 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439488 2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 29 15:46:38.445357 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439492 2584 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 29 15:46:38.445357 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439495 2584 flags.go:64] FLAG: --contention-profiling="false" Jul 29 15:46:38.445357 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439498 2584 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 29 15:46:38.445357 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439500 2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 29 15:46:38.445357 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439504 2584 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 29 15:46:38.445357 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439506 2584 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 29 15:46:38.445357 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439511 2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 29 15:46:38.445357 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439514 2584 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 29 15:46:38.445357 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439517 2584 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 29 15:46:38.445357 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439519 2584 flags.go:64] FLAG: --enable-load-reader="false" Jul 29 15:46:38.445357 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439522 2584 flags.go:64] FLAG: --enable-server="true" Jul 29 15:46:38.445357 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439525 2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 29 15:46:38.445357 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439529 2584 flags.go:64] FLAG: --event-burst="100" Jul 29 15:46:38.445357 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439532 2584 flags.go:64] FLAG: --event-qps="50" Jul 29 15:46:38.445357 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439535 2584 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 29 15:46:38.445357 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439538 2584 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 29 15:46:38.445357 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439541 2584 flags.go:64] FLAG: --eviction-hard="" Jul 29 15:46:38.445357 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439544 2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 29 15:46:38.445357 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439547 2584 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 29 15:46:38.445357 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439550 2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 29 15:46:38.445357 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439554 2584 flags.go:64] FLAG: --eviction-soft="" Jul 29 15:46:38.445357 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439558 2584 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 29 15:46:38.445357 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439561 2584 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 29 15:46:38.446056 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439563 2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 29 15:46:38.446056 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439566 2584 flags.go:64] FLAG: --experimental-mounter-path="" Jul 29 15:46:38.446056 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439569 2584 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 29 15:46:38.446056 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439572 2584 flags.go:64] FLAG: --fail-swap-on="true" Jul 29 15:46:38.446056 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439575 2584 flags.go:64] FLAG: --feature-gates="" Jul 29 15:46:38.446056 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439578 2584 flags.go:64] FLAG: --file-check-frequency="20s" Jul 29 15:46:38.446056 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439581 2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 29 15:46:38.446056 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439584 2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 29 15:46:38.446056 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439587 2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 29 15:46:38.446056 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439591 2584 flags.go:64] FLAG: --healthz-port="10248" Jul 29 15:46:38.446056 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439594 2584 flags.go:64] FLAG: --help="false" Jul 29 15:46:38.446056 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439596 2584 flags.go:64] FLAG: --hostname-override="ip-10-0-141-213.ec2.internal" Jul 29 15:46:38.446056 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439599 2584 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 29 15:46:38.446056 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439602 2584 flags.go:64] FLAG: --http-check-frequency="20s" Jul 29 15:46:38.446056 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439605 2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 29 15:46:38.446056 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439608 2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 29 15:46:38.446056 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439611 2584 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 29 15:46:38.446056 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439614 2584 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 29 15:46:38.446056 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439617 2584 flags.go:64] FLAG: --image-service-endpoint="" Jul 29 15:46:38.446056 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439620 2584 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 29 15:46:38.446056 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439622 2584 flags.go:64] FLAG: --kube-api-burst="100" Jul 29 15:46:38.446056 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439625 2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 29 15:46:38.446056 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439628 2584 flags.go:64] FLAG: --kube-api-qps="50" Jul 29 15:46:38.446056 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439631 2584 flags.go:64] FLAG: --kube-reserved="" Jul 29 15:46:38.446663 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439634 2584 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 29 15:46:38.446663 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439637 2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 29 15:46:38.446663 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439639 2584 flags.go:64] FLAG: --kubelet-cgroups="" Jul 29 15:46:38.446663 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439642 2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 29 15:46:38.446663 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439645 2584 flags.go:64] FLAG: --lock-file="" Jul 29 15:46:38.446663 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439649 2584 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 29 15:46:38.446663 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439652 2584 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 29 15:46:38.446663 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439656 2584 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 29 15:46:38.446663 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439661 2584 flags.go:64] FLAG: --log-json-split-stream="false" Jul 29 15:46:38.446663 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439663 2584 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 29 15:46:38.446663 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439666 2584 flags.go:64] FLAG: --log-text-split-stream="false" Jul 29 15:46:38.446663 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439669 2584 flags.go:64] FLAG: --logging-format="text" Jul 29 15:46:38.446663 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439672 2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 29 15:46:38.446663 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439675 2584 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 29 15:46:38.446663 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439678 2584 flags.go:64] FLAG: --manifest-url="" Jul 29 15:46:38.446663 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439680 2584 flags.go:64] FLAG: --manifest-url-header="" Jul 29 15:46:38.446663 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439685 2584 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 29 15:46:38.446663 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439688 2584 flags.go:64] FLAG: --max-open-files="1000000" Jul 29 15:46:38.446663 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439691 2584 flags.go:64] FLAG: --max-pods="110" Jul 29 15:46:38.446663 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439694 2584 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 29 15:46:38.446663 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439697 2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 29 15:46:38.446663 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439699 2584 flags.go:64] FLAG: --memory-manager-policy="None" Jul 29 15:46:38.446663 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439702 2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 29 15:46:38.446663 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439705 2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 29 15:46:38.446663 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439708 2584 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 29 15:46:38.447279 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439711 2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 29 15:46:38.447279 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439718 2584 flags.go:64] FLAG: --node-status-max-images="50" Jul 29 15:46:38.447279 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439720 2584 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 29 15:46:38.447279 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439724 2584 flags.go:64] FLAG: --oom-score-adj="-999" Jul 29 15:46:38.447279 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439727 2584 flags.go:64] FLAG: --pod-cidr="" Jul 29 15:46:38.447279 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439729 2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 29 15:46:38.447279 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439735 2584 flags.go:64] FLAG: --pod-manifest-path="" Jul 29 15:46:38.447279 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439738 2584 flags.go:64] FLAG: --pod-max-pids="-1" Jul 29 15:46:38.447279 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439741 2584 flags.go:64] FLAG: --pods-per-core="0" Jul 29 15:46:38.447279 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439744 2584 flags.go:64] FLAG: --port="10250" Jul 29 15:46:38.447279 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439747 2584 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 29 15:46:38.447279 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439750 2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-085f51f5ae98fe670" Jul 29 15:46:38.447279 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439754 2584 flags.go:64] FLAG: --qos-reserved="" Jul 29 15:46:38.447279 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439758 2584 flags.go:64] FLAG: --read-only-port="10255" Jul 29 15:46:38.447279 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439762 2584 flags.go:64] FLAG: --register-node="true" Jul 29 15:46:38.447279 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439764 2584 flags.go:64] FLAG: --register-with-taints="" Jul 29 15:46:38.447279 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439768 2584 flags.go:64] FLAG: --registry-burst="10" Jul 29 15:46:38.447279 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439771 2584 flags.go:64] FLAG: --registry-qps="5" Jul 29 15:46:38.447279 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439773 2584 flags.go:64] FLAG: --reserved-cpus="" Jul 29 15:46:38.447279 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439776 2584 flags.go:64] FLAG: --reserved-memory="" Jul 29 15:46:38.447279 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439780 2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 29 15:46:38.447279 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439782 2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 29 15:46:38.447279 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439786 2584 flags.go:64] FLAG: --rotate-certificates="false" Jul 29 15:46:38.447279 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439788 2584 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 29 15:46:38.447279 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439791 2584 flags.go:64] FLAG: --runonce="false" Jul 29 15:46:38.447899 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439794 2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 29 15:46:38.447899 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439797 2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 29 15:46:38.447899 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439800 2584 flags.go:64] FLAG: --seccomp-default="false" Jul 29 15:46:38.447899 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439803 2584 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 29 15:46:38.447899 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439806 2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 29 15:46:38.447899 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439809 2584 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 29 15:46:38.447899 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439812 2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 29 15:46:38.447899 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439815 2584 flags.go:64] FLAG: --storage-driver-password="root" Jul 29 15:46:38.447899 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439818 2584 flags.go:64] FLAG: --storage-driver-secure="false" Jul 29 15:46:38.447899 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439820 2584 flags.go:64] FLAG: --storage-driver-table="stats" Jul 29 15:46:38.447899 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439823 2584 flags.go:64] FLAG: --storage-driver-user="root" Jul 29 15:46:38.447899 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439825 2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 29 15:46:38.447899 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439829 2584 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 29 15:46:38.447899 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439833 2584 flags.go:64] FLAG: --system-cgroups="" Jul 29 15:46:38.447899 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439836 2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 29 15:46:38.447899 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439841 2584 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 29 15:46:38.447899 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439844 2584 flags.go:64] FLAG: --tls-cert-file="" Jul 29 15:46:38.447899 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439847 2584 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 29 15:46:38.447899 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439851 2584 flags.go:64] FLAG: --tls-min-version="" Jul 29 15:46:38.447899 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439854 2584 flags.go:64] FLAG: --tls-private-key-file="" Jul 29 15:46:38.447899 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439859 2584 flags.go:64] FLAG: --topology-manager-policy="none" Jul 29 15:46:38.447899 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439862 2584 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 29 15:46:38.447899 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439866 2584 flags.go:64] FLAG: --topology-manager-scope="container" Jul 29 15:46:38.447899 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439869 2584 flags.go:64] FLAG: --v="2" Jul 29 15:46:38.447899 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439873 2584 flags.go:64] FLAG: --version="false" Jul 29 15:46:38.448517 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439877 2584 flags.go:64] FLAG: --vmodule="" Jul 29 15:46:38.448517 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439880 2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 29 15:46:38.448517 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.439883 2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 29 15:46:38.448517 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439993 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:46:38.448517 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439996 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:46:38.448517 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.439999 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:46:38.448517 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440002 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:46:38.448517 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440005 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:46:38.448517 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440008 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:46:38.448517 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440011 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:46:38.448517 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440014 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:46:38.448517 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440016 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:46:38.448517 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440019 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:46:38.448517 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440022 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:46:38.448517 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440024 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:46:38.448517 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440027 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:46:38.448517 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440030 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:46:38.448517 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440033 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:46:38.448517 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440035 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:46:38.448517 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440040 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:46:38.449013 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440044 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:46:38.449013 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440048 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:46:38.449013 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440050 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:46:38.449013 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440053 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:46:38.449013 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440056 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:46:38.449013 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440059 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:46:38.449013 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440062 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:46:38.449013 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440065 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:46:38.449013 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440069 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:46:38.449013 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440072 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:46:38.449013 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440075 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:46:38.449013 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440078 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:46:38.449013 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440081 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:46:38.449013 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440083 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:46:38.449013 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440086 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:46:38.449013 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440089 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:46:38.449013 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440092 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:46:38.449013 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440094 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:46:38.449013 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440097 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:46:38.449532 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440099 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:46:38.449532 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440101 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:46:38.449532 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440104 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:46:38.449532 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440106 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:46:38.449532 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440110 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:46:38.449532 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440113 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:46:38.449532 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440116 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:46:38.449532 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440118 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:46:38.449532 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440121 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:46:38.449532 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440124 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:46:38.449532 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440126 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:46:38.449532 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440128 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:46:38.449532 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440131 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:46:38.449532 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440135 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:46:38.449532 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440137 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:46:38.449532 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440140 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:46:38.449532 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440143 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:46:38.449532 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440145 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:46:38.449532 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440148 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:46:38.449993 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440150 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:46:38.449993 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440153 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:46:38.449993 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440156 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:46:38.449993 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440158 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:46:38.449993 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440161 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:46:38.449993 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440164 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:46:38.449993 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440166 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:46:38.449993 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440168 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:46:38.449993 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440171 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:46:38.449993 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440173 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:46:38.449993 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440176 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:46:38.449993 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440178 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:46:38.449993 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440181 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:46:38.449993 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440183 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:46:38.449993 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440186 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:46:38.449993 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440189 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:46:38.449993 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440191 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:46:38.449993 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440194 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:46:38.449993 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440197 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:46:38.450510 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440199 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:46:38.450510 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440202 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:46:38.450510 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440204 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:46:38.450510 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440207 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:46:38.450510 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440210 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:46:38.450510 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440212 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:46:38.450510 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440215 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:46:38.450510 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440219 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:46:38.450510 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440222 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:46:38.450510 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440225 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:46:38.450510 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440227 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:46:38.450510 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440229 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:46:38.450510 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440232 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:46:38.450510 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440234 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:46:38.450510 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440237 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:46:38.450510 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440240 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:46:38.450510 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440242 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:46:38.450510 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440244 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:46:38.450510 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440247 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:46:38.450510 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440250 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:46:38.451008 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440253 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:46:38.451008 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440255 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:46:38.451008 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440258 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:46:38.451008 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440261 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:46:38.451008 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.440263 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:46:38.451008 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.440271 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 15:46:38.451008 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.445968 2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 29 15:46:38.451008 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.445983 2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 29 15:46:38.451008 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.445998 2584 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 29 15:46:38.451008 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.446007 2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 29 15:46:38.451008 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446060 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:46:38.451008 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446065 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:46:38.451008 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446068 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:46:38.451008 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446072 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:46:38.451008 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446075 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:46:38.451380 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446078 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:46:38.451380 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446081 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:46:38.451380 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446084 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:46:38.451380 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446086 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:46:38.451380 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446089 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:46:38.451380 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446091 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:46:38.451380 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446094 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:46:38.451380 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446096 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:46:38.451380 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446099 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:46:38.451380 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446102 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:46:38.451380 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446104 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:46:38.451380 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446107 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:46:38.451380 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446110 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:46:38.451380 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446113 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:46:38.451380 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446115 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:46:38.451380 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446119 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:46:38.451380 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446121 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:46:38.451380 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446124 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:46:38.451380 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446127 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:46:38.451380 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446129 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:46:38.451888 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446132 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:46:38.451888 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446135 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:46:38.451888 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446137 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:46:38.451888 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446140 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:46:38.451888 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446143 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:46:38.451888 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446146 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:46:38.451888 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446148 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:46:38.451888 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446151 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:46:38.451888 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446153 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:46:38.451888 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446156 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:46:38.451888 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446159 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:46:38.451888 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446161 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:46:38.451888 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446164 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:46:38.451888 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446167 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:46:38.451888 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446169 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:46:38.451888 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446172 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:46:38.451888 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446174 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:46:38.451888 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446177 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:46:38.451888 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446179 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:46:38.451888 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446182 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:46:38.452367 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446184 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:46:38.452367 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446187 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:46:38.452367 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446189 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:46:38.452367 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446192 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:46:38.452367 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446195 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:46:38.452367 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446198 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:46:38.452367 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446201 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:46:38.452367 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446204 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:46:38.452367 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446206 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:46:38.452367 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446209 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:46:38.452367 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446211 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:46:38.452367 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446214 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:46:38.452367 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446217 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:46:38.452367 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446220 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:46:38.452367 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446222 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:46:38.452367 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446225 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:46:38.452367 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446229 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:46:38.452367 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446233 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:46:38.452367 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446236 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:46:38.452367 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446239 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:46:38.452900 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446242 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:46:38.452900 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446244 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:46:38.452900 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446247 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:46:38.452900 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446249 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:46:38.452900 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446252 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:46:38.452900 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446254 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:46:38.452900 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446257 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:46:38.452900 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446260 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:46:38.452900 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446262 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:46:38.452900 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446266 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:46:38.452900 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446269 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:46:38.452900 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446272 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:46:38.452900 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446275 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:46:38.452900 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446278 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:46:38.452900 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446281 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:46:38.452900 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446284 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:46:38.452900 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446287 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:46:38.452900 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446289 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:46:38.452900 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446292 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:46:38.453372 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446295 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:46:38.453372 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446297 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:46:38.453372 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446300 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:46:38.453372 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446302 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:46:38.453372 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446305 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:46:38.453372 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446309 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:46:38.453372 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446312 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:46:38.453372 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446315 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:46:38.453372 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446318 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:46:38.453372 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446321 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:46:38.453372 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446324 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:46:38.453372 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446327 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:46:38.453372 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446329 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:46:38.453372 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446332 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:46:38.453372 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446334 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:46:38.453767 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.446339 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 15:46:38.453767 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446472 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:46:38.453767 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446478 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:46:38.453767 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446481 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:46:38.453767 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446484 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:46:38.453767 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446487 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:46:38.453767 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446490 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:46:38.453767 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446493 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:46:38.453767 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446495 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:46:38.453767 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446498 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:46:38.453767 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446500 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:46:38.453767 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446503 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:46:38.453767 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446505 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:46:38.453767 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446508 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:46:38.453767 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446510 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:46:38.454140 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446514 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:46:38.454140 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446518 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:46:38.454140 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446521 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:46:38.454140 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446523 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:46:38.454140 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446526 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:46:38.454140 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446529 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:46:38.454140 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446532 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:46:38.454140 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446535 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:46:38.454140 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446538 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:46:38.454140 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446541 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:46:38.454140 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446543 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:46:38.454140 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446546 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:46:38.454140 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446548 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:46:38.454140 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446552 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:46:38.454140 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446559 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:46:38.454140 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446562 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:46:38.454140 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446565 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:46:38.454140 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446568 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:46:38.454140 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446570 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:46:38.454140 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446573 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:46:38.454645 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446575 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:46:38.454645 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446578 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:46:38.454645 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446581 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:46:38.454645 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446591 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:46:38.454645 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446595 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:46:38.454645 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446598 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:46:38.454645 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446600 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:46:38.454645 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446603 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:46:38.454645 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446606 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:46:38.454645 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446608 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:46:38.454645 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446611 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:46:38.454645 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446613 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:46:38.454645 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446616 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:46:38.454645 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446619 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:46:38.454645 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446621 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:46:38.454645 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446624 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:46:38.454645 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446627 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:46:38.454645 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446629 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:46:38.454645 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446632 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:46:38.454645 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446634 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:46:38.455154 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446637 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:46:38.455154 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446640 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:46:38.455154 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446642 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:46:38.455154 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446645 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:46:38.455154 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446647 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:46:38.455154 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446650 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:46:38.455154 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446653 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:46:38.455154 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446656 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:46:38.455154 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446659 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:46:38.455154 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446661 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:46:38.455154 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446664 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:46:38.455154 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446666 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:46:38.455154 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446669 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:46:38.455154 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446673 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:46:38.455154 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446677 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:46:38.455154 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446679 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:46:38.455154 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446682 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:46:38.455154 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446685 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:46:38.455154 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446687 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:46:38.455881 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446690 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:46:38.455881 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446692 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:46:38.455881 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446695 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:46:38.455881 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446697 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:46:38.455881 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446699 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:46:38.455881 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446702 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:46:38.455881 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446705 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:46:38.455881 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446707 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:46:38.455881 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446710 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:46:38.455881 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446712 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:46:38.455881 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446715 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:46:38.455881 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446717 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:46:38.455881 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446720 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:46:38.455881 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446722 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:46:38.455881 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446725 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:46:38.455881 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446727 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:46:38.455881 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446730 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:46:38.455881 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446733 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:46:38.455881 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446735 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:46:38.455881 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446738 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:46:38.456420 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446741 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:46:38.456420 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446744 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:46:38.456420 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446747 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:46:38.456420 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446749 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:46:38.456420 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446752 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:46:38.456420 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:38.446754 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:46:38.456420 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.446759 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 15:46:38.456420 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.446852 2584 server.go:962] "Client rotation is on, will bootstrap in background" Jul 29 15:46:38.456420 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.448762 2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 29 15:46:38.456420 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.449865 2584 server.go:1019] "Starting client certificate rotation" Jul 29 15:46:38.456420 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.449960 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 15:46:38.456420 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.450027 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 15:46:38.456420 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.452084 2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 15:46:38.456783 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.456073 2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 15:46:38.472298 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.472272 2584 log.go:25] "Validated CRI v1 runtime API" Jul 29 15:46:38.474369 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.474355 2584 log.go:25] "Validated CRI v1 image API" Jul 29 15:46:38.475150 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.475125 2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 29 15:46:38.478007 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.477980 2584 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ccd860cd-5dd7-4bef-8125-169193309ffd:/dev/nvme0n1p4 db849162-6539-4396-8c64-f332707f2188:/dev/nvme0n1p3] Jul 29 15:46:38.478068 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.478006 2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 29 15:46:38.484659 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.484534 2584 manager.go:216] Machine: {Timestamp:2026-07-29 15:46:38.482868537 +0000 UTC m=+0.327166010 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101192 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28b9629b6de0af4aae390d5cf17669 SystemUUID:ec28b962-9b6d-e0af-4aae-390d5cf17669 BootID:26b5ba1f-bf3d-4685-a809-2afdf5cf4665 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ba:c7:b6:1c:47 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ba:c7:b6:1c:47 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:82:45:82:53:78:78 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 29 15:46:38.484659 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.484648 2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 29 15:46:38.484807 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.484716 2584 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 29 15:46:38.485573 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.485554 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 15:46:38.487894 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.487870 2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 29 15:46:38.488024 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.487898 2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-213.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 29 15:46:38.488618 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.488607 2584 topology_manager.go:138] "Creating topology manager with none policy" Jul 29 15:46:38.488660 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.488621 2584 container_manager_linux.go:309] "Creating device plugin manager" Jul 29 15:46:38.488660 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.488628 2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 15:46:38.490064 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.490052 2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 15:46:38.491164 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.491153 2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 29 15:46:38.493201 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.493189 2584 state_mem.go:36] "Initialized new in-memory state store" Jul 29 15:46:38.493315 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.493305 2584 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 29 15:46:38.493359 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.493334 2584 kubelet.go:486] "Attempting to sync node with API server" Jul 29 15:46:38.493359 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.493344 2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 29 15:46:38.493359 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.493353 2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 29 15:46:38.493476 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.493363 2584 kubelet.go:398] "Adding apiserver pod source" Jul 29 15:46:38.493476 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.493374 2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 29 15:46:38.493719 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.493707 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 15:46:38.493768 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.493729 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 15:46:38.496134 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.496096 2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 29 15:46:38.498184 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.498158 2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 29 15:46:38.498257 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.498206 2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 29 15:46:38.500484 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.500471 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 29 15:46:38.500555 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.500488 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 29 15:46:38.500555 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.500494 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 29 15:46:38.500555 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.500500 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 29 15:46:38.500555 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.500524 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 29 15:46:38.500555 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.500530 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 29 15:46:38.500555 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.500539 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 29 15:46:38.500555 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.500544 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 29 15:46:38.500747 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.500560 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 29 15:46:38.500747 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.500566 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 29 15:46:38.500747 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.500579 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 29 15:46:38.500747 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.500584 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 29 15:46:38.500747 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.500608 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 29 15:46:38.500747 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.500614 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 29 15:46:38.504059 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.504044 2584 server.go:1268] "Started kubelet" Jul 29 15:46:38.504200 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.504174 2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 29 15:46:38.504434 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.504293 2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 29 15:46:38.504631 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.504612 2584 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 29 15:46:38.504888 ip-10-0-141-213 systemd[1]: Started Kubernetes Kubelet. Jul 29 15:46:38.511059 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.510292 2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-213.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 29 15:46:38.511059 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.509864 2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 29 15:46:38.511059 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:38.510638 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 29 15:46:38.511059 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:38.510815 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-213.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 29 15:46:38.512981 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:38.512939 2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 29 15:46:38.513500 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.513486 2584 server.go:310] "Adding debug handlers to kubelet server" Jul 29 15:46:38.514646 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:38.513501 2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-213.ec2.internal.18c6cd44fe1ff28c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-213.ec2.internal,UID:ip-10-0-141-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-213.ec2.internal,},FirstTimestamp:2026-07-29 15:46:38.503957132 +0000 UTC m=+0.348254605,LastTimestamp:2026-07-29 15:46:38.503957132 +0000 UTC m=+0.348254605,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-213.ec2.internal,}" Jul 29 15:46:38.517909 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.517882 2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 29 15:46:38.517909 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.517899 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 29 15:46:38.518067 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:38.517987 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-213.ec2.internal\" not found" Jul 29 15:46:38.518526 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.518510 2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 29 15:46:38.518687 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.518544 2584 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 29 15:46:38.518784 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.518775 2584 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 29 15:46:38.518901 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.518778 2584 factory.go:55] Registering systemd factory Jul 29 15:46:38.518980 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.518972 2584 factory.go:223] Registration of the systemd container factory successfully Jul 29 15:46:38.519089 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.519073 2584 reconstruct.go:97] "Volume reconstruction finished" Jul 29 15:46:38.519141 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.519108 2584 reconciler.go:29] "Reconciler: start to sync state" Jul 29 15:46:38.519238 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.519220 2584 factory.go:153] Registering CRI-O factory Jul 29 15:46:38.519286 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.519243 2584 factory.go:223] Registration of the crio container factory successfully Jul 29 15:46:38.519332 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.519293 2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 29 15:46:38.519332 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.519321 2584 factory.go:103] Registering Raw factory Jul 29 15:46:38.519430 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.519338 2584 manager.go:1196] Started watching for new ooms in manager Jul 29 15:46:38.519801 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.519783 2584 manager.go:349] Starting recovery of all containers Jul 29 15:46:38.524530 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:38.524334 2584 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-213.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 29 15:46:38.524658 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:38.524634 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 29 15:46:38.530594 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.530578 2584 manager.go:354] Recovery completed Jul 29 15:46:38.535940 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.535925 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:46:38.538910 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.538892 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-213.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:46:38.538992 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.538924 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-213.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:46:38.538992 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.538938 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-213.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:46:38.539482 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.539468 2584 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 29 15:46:38.539482 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.539481 2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 29 15:46:38.539630 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.539496 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:46:38.539630 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.539499 2584 state_mem.go:36] "Initialized new in-memory state store" Jul 29 15:46:38.540386 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.540368 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-213.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:46:38.540452 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.540401 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-213.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:46:38.540452 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.540413 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-213.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:46:38.541492 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.541476 2584 policy_none.go:49] "None policy: Start" Jul 29 15:46:38.541539 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.541500 2584 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 29 15:46:38.541539 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.541532 2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 29 15:46:38.542854 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.542842 2584 policy_none.go:47] "Start" Jul 29 15:46:38.543538 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:38.543389 2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-213.ec2.internal.18c6cd450035423f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-213.ec2.internal,UID:ip-10-0-141-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-213.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-213.ec2.internal,},FirstTimestamp:2026-07-29 15:46:38.538908223 +0000 UTC m=+0.383205696,LastTimestamp:2026-07-29 15:46:38.538908223 +0000 UTC m=+0.383205696,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-213.ec2.internal,}" Jul 29 15:46:38.546144 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.546126 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h4h6x" Jul 29 15:46:38.554989 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:38.554926 2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-213.ec2.internal.18c6cd4500359af1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-213.ec2.internal,UID:ip-10-0-141-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-213.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-213.ec2.internal,},FirstTimestamp:2026-07-29 15:46:38.538930929 +0000 UTC m=+0.383228405,LastTimestamp:2026-07-29 15:46:38.538930929 +0000 UTC m=+0.383228405,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-213.ec2.internal,}" Jul 29 15:46:38.558933 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.558905 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h4h6x" Jul 29 15:46:38.575752 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.575739 2584 manager.go:337] "Starting Device Plugin manager" Jul 29 15:46:38.575825 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:38.575772 2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 29 15:46:38.575825 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.575783 2584 server.go:87] "Starting device plugin registration server" Jul 29 15:46:38.575984 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.575967 2584 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 29 15:46:38.576088 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.575986 2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 29 15:46:38.576088 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.576065 2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 29 15:46:38.576185 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.576147 2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 29 15:46:38.576185 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.576156 2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 29 15:46:38.576758 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:38.576736 2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 29 15:46:38.576821 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:38.576792 2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-213.ec2.internal\" not found" Jul 29 15:46:38.678873 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.678854 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:46:38.680643 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.680627 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-213.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:46:38.680730 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.680660 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-213.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:46:38.680730 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.680677 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-213.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:46:38.680730 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.680714 2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-213.ec2.internal" Jul 29 15:46:38.692117 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.692068 2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-213.ec2.internal" Jul 29 15:46:38.692117 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:38.692098 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-213.ec2.internal\": node \"ip-10-0-141-213.ec2.internal\" not found" Jul 29 15:46:38.710629 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:38.710611 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-213.ec2.internal\" not found" Jul 29 15:46:38.719730 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.719709 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 29 15:46:38.720919 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.720900 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 29 15:46:38.720990 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.720933 2584 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 29 15:46:38.720990 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.720951 2584 kubelet.go:2448] "Starting kubelet main sync loop" Jul 29 15:46:38.720990 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:38.720979 2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 29 15:46:38.723812 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.723793 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:46:38.814729 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:38.814696 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-213.ec2.internal\" not found" Jul 29 15:46:38.821534 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.821513 2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-213.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-213.ec2.internal"] Jul 29 15:46:38.821596 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.821569 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:46:38.822390 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.822374 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-213.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:46:38.822467 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.822401 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-213.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:46:38.822467 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.822412 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-213.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:46:38.824040 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.824027 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:46:38.824204 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.824188 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-213.ec2.internal" Jul 29 15:46:38.824272 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.824230 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:46:38.824851 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.824834 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-213.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:46:38.824941 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.824865 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-213.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:46:38.824941 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.824877 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-213.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:46:38.824941 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.824838 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-213.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:46:38.825060 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.824948 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-213.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:46:38.825060 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.824968 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-213.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:46:38.826538 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.826508 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-213.ec2.internal" Jul 29 15:46:38.826634 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.826547 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:46:38.827229 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.827214 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-213.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:46:38.827308 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.827254 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-213.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:46:38.827308 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.827267 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-213.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:46:38.854281 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:38.854261 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-213.ec2.internal\" not found" node="ip-10-0-141-213.ec2.internal" Jul 29 15:46:38.858791 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:38.858775 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-213.ec2.internal\" not found" node="ip-10-0-141-213.ec2.internal" Jul 29 15:46:38.915254 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:38.915238 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-213.ec2.internal\" not found" Jul 29 15:46:38.921024 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.921006 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/49c209b3e6e7d8404ad2a977c0bb87c9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-213.ec2.internal\" (UID: \"49c209b3e6e7d8404ad2a977c0bb87c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-213.ec2.internal" Jul 29 15:46:38.921073 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.921031 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49c209b3e6e7d8404ad2a977c0bb87c9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-213.ec2.internal\" (UID: \"49c209b3e6e7d8404ad2a977c0bb87c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-213.ec2.internal" Jul 29 15:46:38.921073 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:38.921056 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a2ba8c9c359a1f1e65affdf9bc68bd46-config\") pod \"kube-apiserver-proxy-ip-10-0-141-213.ec2.internal\" (UID: \"a2ba8c9c359a1f1e65affdf9bc68bd46\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-213.ec2.internal" Jul 29 15:46:39.016123 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:39.016063 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-213.ec2.internal\" not found" Jul 29 15:46:39.021880 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:39.021859 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/49c209b3e6e7d8404ad2a977c0bb87c9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-213.ec2.internal\" (UID: \"49c209b3e6e7d8404ad2a977c0bb87c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-213.ec2.internal" Jul 29 15:46:39.021964 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:39.021890 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49c209b3e6e7d8404ad2a977c0bb87c9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-213.ec2.internal\" (UID: \"49c209b3e6e7d8404ad2a977c0bb87c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-213.ec2.internal" Jul 29 15:46:39.021964 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:39.021918 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a2ba8c9c359a1f1e65affdf9bc68bd46-config\") pod \"kube-apiserver-proxy-ip-10-0-141-213.ec2.internal\" (UID: \"a2ba8c9c359a1f1e65affdf9bc68bd46\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-213.ec2.internal" Jul 29 15:46:39.022063 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:39.021968 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/49c209b3e6e7d8404ad2a977c0bb87c9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-213.ec2.internal\" (UID: \"49c209b3e6e7d8404ad2a977c0bb87c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-213.ec2.internal" Jul 29 15:46:39.022063 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:39.021983 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a2ba8c9c359a1f1e65affdf9bc68bd46-config\") pod \"kube-apiserver-proxy-ip-10-0-141-213.ec2.internal\" (UID: \"a2ba8c9c359a1f1e65affdf9bc68bd46\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-213.ec2.internal" Jul 29 15:46:39.022063 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:39.021987 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49c209b3e6e7d8404ad2a977c0bb87c9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-213.ec2.internal\" (UID: \"49c209b3e6e7d8404ad2a977c0bb87c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-213.ec2.internal" Jul 29 15:46:39.123825 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:39.123795 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-213.ec2.internal\" not found" Jul 29 15:46:39.158604 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:39.158578 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-213.ec2.internal" Jul 29 15:46:39.161685 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:39.161668 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-213.ec2.internal" Jul 29 15:46:39.224183 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:39.224146 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-213.ec2.internal\" not found" Jul 29 15:46:39.324422 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:39.324370 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-213.ec2.internal\" not found" Jul 29 15:46:39.425486 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:39.425465 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-213.ec2.internal\" not found" Jul 29 15:46:39.449676 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:39.449641 2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 29 15:46:39.450190 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:39.449783 2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 15:46:39.493290 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:39.493266 2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:46:39.525996 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:39.525972 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-213.ec2.internal\" not found" Jul 29 15:46:39.566089 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:39.566053 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 15:41:38 +0000 UTC" deadline="2028-01-14 19:15:24.726277608 +0000 UTC" Jul 29 15:46:39.566089 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:39.566082 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12819h28m45.160199867s" Jul 29 15:46:39.627040 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:39.626984 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-213.ec2.internal\" not found" Jul 29 15:46:39.647201 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:39.647181 2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:46:39.675116 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:39.675095 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:46:39.676368 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:39.676342 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-213.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:46:39.676476 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:39.676380 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-213.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:46:39.676476 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:39.676395 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-213.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:46:39.727106 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:39.727080 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-213.ec2.internal\" not found" Jul 29 15:46:39.741851 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:39.741827 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2ba8c9c359a1f1e65affdf9bc68bd46.slice/crio-5935e8a1169346e083679fcd6983804406bb4ac1b27de757adea556b3434f206 WatchSource:0}: Error finding container 5935e8a1169346e083679fcd6983804406bb4ac1b27de757adea556b3434f206: Status 404 returned error can't find the container with id 5935e8a1169346e083679fcd6983804406bb4ac1b27de757adea556b3434f206 Jul 29 15:46:39.747643 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:39.747630 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 15:46:39.815948 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:39.815922 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49c209b3e6e7d8404ad2a977c0bb87c9.slice/crio-0f99b209b37e8ce1c34408f302cbf3e1436b41045e67199693102be46a2ca74b WatchSource:0}: Error finding container 0f99b209b37e8ce1c34408f302cbf3e1436b41045e67199693102be46a2ca74b: Status 404 returned error can't find the container with id 0f99b209b37e8ce1c34408f302cbf3e1436b41045e67199693102be46a2ca74b Jul 29 15:46:39.828288 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:39.828271 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-213.ec2.internal\" not found" Jul 29 15:46:39.899799 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:39.899752 2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:46:39.918622 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:39.918603 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-213.ec2.internal" Jul 29 15:46:39.934121 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:39.934103 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 15:46:39.935257 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:39.935242 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-213.ec2.internal" Jul 29 15:46:39.950077 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:39.950053 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 15:46:40.494870 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.494843 2584 apiserver.go:52] "Watching apiserver" Jul 29 15:46:40.505030 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.505003 2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 29 15:46:40.505776 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.505416 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-qqxjg","openshift-image-registry/node-ca-254br","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-213.ec2.internal","openshift-multus/multus-additional-cni-plugins-6nm7c","kube-system/global-pull-secret-syncer-f5gvg","openshift-dns/node-resolver-7w9zd","openshift-multus/multus-48lc4","openshift-multus/network-metrics-daemon-64nqz","openshift-network-diagnostics/network-check-target-rwvpj","openshift-network-operator/iptables-alerter-wx6jd","openshift-ovn-kubernetes/ovnkube-node-t5rxf","kube-system/konnectivity-agent-wtfzb","kube-system/kube-apiserver-proxy-ip-10-0-141-213.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fsfwz"] Jul 29 15:46:40.507436 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.506951 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.508733 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.508709 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.509995 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.509975 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ds6wl\"" Jul 29 15:46:40.509995 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.509993 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 29 15:46:40.510208 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.510191 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 29 15:46:40.510447 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.510430 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 29 15:46:40.510839 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.510817 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 29 15:46:40.511784 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.511700 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 29 15:46:40.512093 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.512074 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mqfhd\"" Jul 29 15:46:40.512337 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.512322 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 29 15:46:40.512625 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.512607 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fsfwz" Jul 29 15:46:40.513667 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.513647 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 29 15:46:40.513884 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.513862 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 29 15:46:40.514108 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.514090 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6nm7c" Jul 29 15:46:40.514204 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.514188 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 29 15:46:40.514468 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.514107 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 29 15:46:40.515719 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.515694 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 29 15:46:40.516274 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.516113 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 29 15:46:40.516274 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.516215 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7lpwk\"" Jul 29 15:46:40.516691 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.516667 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:46:40.516791 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:40.516742 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5gvg" podUID="77adaab3-405e-43d8-8dec-badf07ce38f2" Jul 29 15:46:40.517288 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.517268 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 29 15:46:40.517526 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.517509 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 29 15:46:40.517739 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.517725 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xdtxz\"" Jul 29 15:46:40.517806 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.517781 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7w9zd" Jul 29 15:46:40.517902 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.517871 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 29 15:46:40.518872 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.518331 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 29 15:46:40.518872 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.518617 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:46:40.518872 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:40.518682 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwvpj" podUID="e7e55e83-cfda-4e11-8182-e93e305e78bb" Jul 29 15:46:40.520363 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.520343 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:46:40.520491 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:40.520405 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64nqz" podUID="7377e78e-3c71-4fcb-918c-eb6c54e2d562" Jul 29 15:46:40.521290 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.521267 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 29 15:46:40.521398 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.521304 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 29 15:46:40.521651 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.521625 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nl6gt\"" Jul 29 15:46:40.522432 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.522413 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-254br" Jul 29 15:46:40.524200 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.524179 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wx6jd" Jul 29 15:46:40.525140 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.525119 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mg8jt\"" Jul 29 15:46:40.525464 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.525446 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 29 15:46:40.525673 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.525652 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 29 15:46:40.525776 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.525694 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 29 15:46:40.526564 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.525932 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.526855 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.526828 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 29 15:46:40.527301 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.527280 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wtfzb" Jul 29 15:46:40.527378 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.527325 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 29 15:46:40.527732 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.527713 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 29 15:46:40.527826 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.527809 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kcgsr\"" Jul 29 15:46:40.530498 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.530471 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2sq9h\"" Jul 29 15:46:40.530792 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.530773 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 29 15:46:40.531074 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.531053 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xv76j\"" Jul 29 15:46:40.531183 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.531161 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 29 15:46:40.531314 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.531294 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 29 15:46:40.531992 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.531960 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.532121 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.532001 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8lhd\" (UniqueName: \"kubernetes.io/projected/619ab912-9655-4f72-a490-3ff971625501-kube-api-access-g8lhd\") pod \"aws-ebs-csi-driver-node-fsfwz\" (UID: \"619ab912-9655-4f72-a490-3ff971625501\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fsfwz" Jul 29 15:46:40.532121 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.532029 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvgsv\" (UniqueName: \"kubernetes.io/projected/7e8b3213-5f73-40dc-8357-d1ae21efd3d9-kube-api-access-vvgsv\") pod \"multus-additional-cni-plugins-6nm7c\" (UID: \"7e8b3213-5f73-40dc-8357-d1ae21efd3d9\") " pod="openshift-multus/multus-additional-cni-plugins-6nm7c" Jul 29 15:46:40.532121 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.532055 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf8ks\" (UniqueName: \"kubernetes.io/projected/7192759b-4ce8-4271-a907-7d4c227599b1-kube-api-access-bf8ks\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.532121 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.532086 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-run-openvswitch\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.532121 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.532109 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7377e78e-3c71-4fcb-918c-eb6c54e2d562-metrics-certs\") pod \"network-metrics-daemon-64nqz\" (UID: \"7377e78e-3c71-4fcb-918c-eb6c54e2d562\") " pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:46:40.532390 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.532142 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-host-cni-netd\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.532390 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.532164 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e8b3213-5f73-40dc-8357-d1ae21efd3d9-cnibin\") pod \"multus-additional-cni-plugins-6nm7c\" (UID: \"7e8b3213-5f73-40dc-8357-d1ae21efd3d9\") " pod="openshift-multus/multus-additional-cni-plugins-6nm7c" Jul 29 15:46:40.532390 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.532188 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6skr\" (UniqueName: \"kubernetes.io/projected/e7e55e83-cfda-4e11-8182-e93e305e78bb-kube-api-access-t6skr\") pod \"network-check-target-rwvpj\" (UID: \"e7e55e83-cfda-4e11-8182-e93e305e78bb\") " pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:46:40.532970 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.532943 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-host-kubelet\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.533062 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.533001 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-host-run-netns\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.533062 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.533041 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/619ab912-9655-4f72-a490-3ff971625501-sys-fs\") pod \"aws-ebs-csi-driver-node-fsfwz\" (UID: \"619ab912-9655-4f72-a490-3ff971625501\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fsfwz" Jul 29 15:46:40.533179 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.533077 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77adaab3-405e-43d8-8dec-badf07ce38f2-original-pull-secret\") pod \"global-pull-secret-syncer-f5gvg\" (UID: \"77adaab3-405e-43d8-8dec-badf07ce38f2\") " pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:46:40.533646 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.533621 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 29 15:46:40.534848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.533620 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-hostroot\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.534848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.533944 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-etc-openvswitch\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.534848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.534033 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e8b3213-5f73-40dc-8357-d1ae21efd3d9-system-cni-dir\") pod \"multus-additional-cni-plugins-6nm7c\" (UID: \"7e8b3213-5f73-40dc-8357-d1ae21efd3d9\") " pod="openshift-multus/multus-additional-cni-plugins-6nm7c" Jul 29 15:46:40.534848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.534103 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e8b3213-5f73-40dc-8357-d1ae21efd3d9-os-release\") pod \"multus-additional-cni-plugins-6nm7c\" (UID: \"7e8b3213-5f73-40dc-8357-d1ae21efd3d9\") " pod="openshift-multus/multus-additional-cni-plugins-6nm7c" Jul 29 15:46:40.534848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.534130 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlt2w\" (UniqueName: \"kubernetes.io/projected/4f782ba3-b2ac-46c7-ad06-db9aa6721614-kube-api-access-hlt2w\") pod \"node-resolver-7w9zd\" (UID: \"4f782ba3-b2ac-46c7-ad06-db9aa6721614\") " pod="openshift-dns/node-resolver-7w9zd" Jul 29 15:46:40.534848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.534230 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-systemd-units\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.534848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.534282 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-var-lib-openvswitch\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.534848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.534393 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/619ab912-9655-4f72-a490-3ff971625501-registration-dir\") pod \"aws-ebs-csi-driver-node-fsfwz\" (UID: \"619ab912-9655-4f72-a490-3ff971625501\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fsfwz" Jul 29 15:46:40.534848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.534433 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e8b3213-5f73-40dc-8357-d1ae21efd3d9-cni-binary-copy\") pod \"multus-additional-cni-plugins-6nm7c\" (UID: \"7e8b3213-5f73-40dc-8357-d1ae21efd3d9\") " pod="openshift-multus/multus-additional-cni-plugins-6nm7c" Jul 29 15:46:40.534848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.534467 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/77adaab3-405e-43d8-8dec-badf07ce38f2-kubelet-config\") pod \"global-pull-secret-syncer-f5gvg\" (UID: \"77adaab3-405e-43d8-8dec-badf07ce38f2\") " pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:46:40.534848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.534497 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-multus-conf-dir\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.534848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.534546 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-host-cni-bin\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.534848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.534586 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/619ab912-9655-4f72-a490-3ff971625501-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fsfwz\" (UID: \"619ab912-9655-4f72-a490-3ff971625501\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fsfwz" Jul 29 15:46:40.534848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.534668 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f782ba3-b2ac-46c7-ad06-db9aa6721614-tmp-dir\") pod \"node-resolver-7w9zd\" (UID: \"4f782ba3-b2ac-46c7-ad06-db9aa6721614\") " pod="openshift-dns/node-resolver-7w9zd" Jul 29 15:46:40.534848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.534729 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd61573c-d06b-46e4-afea-887f283a1e1a-ovn-node-metrics-cert\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.534848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.534760 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm8v8\" (UniqueName: \"kubernetes.io/projected/dd61573c-d06b-46e4-afea-887f283a1e1a-kube-api-access-bm8v8\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.535707 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.534784 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-run-ovn\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.535707 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.534973 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e8b3213-5f73-40dc-8357-d1ae21efd3d9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6nm7c\" (UID: \"7e8b3213-5f73-40dc-8357-d1ae21efd3d9\") " pod="openshift-multus/multus-additional-cni-plugins-6nm7c" Jul 29 15:46:40.535707 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.535000 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-cnibin\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.535707 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.535028 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-node-log\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.535707 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.535101 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd61573c-d06b-46e4-afea-887f283a1e1a-ovnkube-config\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.535707 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.535151 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/619ab912-9655-4f72-a490-3ff971625501-device-dir\") pod \"aws-ebs-csi-driver-node-fsfwz\" (UID: \"619ab912-9655-4f72-a490-3ff971625501\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fsfwz" Jul 29 15:46:40.535707 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.535180 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-system-cni-dir\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.535707 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.535214 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-multus-cni-dir\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.535707 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.535251 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-multus-socket-dir-parent\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.535707 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.535284 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-host-run-multus-certs\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.535707 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.535327 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-host-run-ovn-kubernetes\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.535707 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.535360 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7e8b3213-5f73-40dc-8357-d1ae21efd3d9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6nm7c\" (UID: \"7e8b3213-5f73-40dc-8357-d1ae21efd3d9\") " pod="openshift-multus/multus-additional-cni-plugins-6nm7c" Jul 29 15:46:40.535707 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.535396 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4f782ba3-b2ac-46c7-ad06-db9aa6721614-hosts-file\") pod \"node-resolver-7w9zd\" (UID: \"4f782ba3-b2ac-46c7-ad06-db9aa6721614\") " pod="openshift-dns/node-resolver-7w9zd" Jul 29 15:46:40.535707 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.535431 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd61573c-d06b-46e4-afea-887f283a1e1a-env-overrides\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.535707 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.535483 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd61573c-d06b-46e4-afea-887f283a1e1a-ovnkube-script-lib\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.535707 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.535529 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/77adaab3-405e-43d8-8dec-badf07ce38f2-dbus\") pod \"global-pull-secret-syncer-f5gvg\" (UID: \"77adaab3-405e-43d8-8dec-badf07ce38f2\") " pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:46:40.536475 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.535561 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7192759b-4ce8-4271-a907-7d4c227599b1-multus-daemon-config\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.536475 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.535590 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-host-slash\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.536475 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.535620 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-log-socket\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.536475 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.535643 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/619ab912-9655-4f72-a490-3ff971625501-etc-selinux\") pod \"aws-ebs-csi-driver-node-fsfwz\" (UID: \"619ab912-9655-4f72-a490-3ff971625501\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fsfwz" Jul 29 15:46:40.536475 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.535672 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-host-var-lib-cni-bin\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.536475 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.535702 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-host-var-lib-cni-multus\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.536475 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.535729 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-etc-kubernetes\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.536475 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.535753 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-run-systemd\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.536475 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.535785 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7e8b3213-5f73-40dc-8357-d1ae21efd3d9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6nm7c\" (UID: \"7e8b3213-5f73-40dc-8357-d1ae21efd3d9\") " pod="openshift-multus/multus-additional-cni-plugins-6nm7c" Jul 29 15:46:40.536475 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.535816 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qs49\" (UniqueName: \"kubernetes.io/projected/7377e78e-3c71-4fcb-918c-eb6c54e2d562-kube-api-access-4qs49\") pod \"network-metrics-daemon-64nqz\" (UID: \"7377e78e-3c71-4fcb-918c-eb6c54e2d562\") " pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:46:40.536475 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.535844 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-os-release\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.536475 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.535875 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7192759b-4ce8-4271-a907-7d4c227599b1-cni-binary-copy\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.536475 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.535898 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-host-run-netns\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.536475 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.535928 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-host-var-lib-kubelet\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.536475 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.535958 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/619ab912-9655-4f72-a490-3ff971625501-socket-dir\") pod \"aws-ebs-csi-driver-node-fsfwz\" (UID: \"619ab912-9655-4f72-a490-3ff971625501\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fsfwz" Jul 29 15:46:40.536475 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.535990 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-host-run-k8s-cni-cncf-io\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.540803 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.540545 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 15:46:40.561532 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.561503 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nks9v" Jul 29 15:46:40.573187 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.573166 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nks9v" Jul 29 15:46:40.581123 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.581106 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:46:40.620731 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.620708 2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 29 15:46:40.637194 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.637171 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9640ca5-c93f-49dc-9216-d3ea149abb4f-host\") pod \"node-ca-254br\" (UID: \"f9640ca5-c93f-49dc-9216-d3ea149abb4f\") " pod="openshift-image-registry/node-ca-254br" Jul 29 15:46:40.637309 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.637208 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd61573c-d06b-46e4-afea-887f283a1e1a-env-overrides\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.637309 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.637272 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd61573c-d06b-46e4-afea-887f283a1e1a-ovnkube-script-lib\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.637309 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.637300 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/77adaab3-405e-43d8-8dec-badf07ce38f2-dbus\") pod \"global-pull-secret-syncer-f5gvg\" (UID: \"77adaab3-405e-43d8-8dec-badf07ce38f2\") " pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:46:40.637556 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.637324 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-run\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.637556 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.637350 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7192759b-4ce8-4271-a907-7d4c227599b1-multus-daemon-config\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.637556 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.637376 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-host-slash\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.637556 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.637402 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkb6j\" (UniqueName: \"kubernetes.io/projected/ea5db5cf-d8ce-4fac-b6e7-13e03e05f535-kube-api-access-wkb6j\") pod \"iptables-alerter-wx6jd\" (UID: \"ea5db5cf-d8ce-4fac-b6e7-13e03e05f535\") " pod="openshift-network-operator/iptables-alerter-wx6jd" Jul 29 15:46:40.637556 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.637438 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-etc-sysctl-d\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.637556 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.637480 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-host\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.637848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.637549 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0008c431-6fb6-4973-a20c-c3f28caa264c-etc-tuned\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.637848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.637585 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4c187f2d-0062-43b4-a61d-b92a4a85793c-konnectivity-ca\") pod \"konnectivity-agent-wtfzb\" (UID: \"4c187f2d-0062-43b4-a61d-b92a4a85793c\") " pod="kube-system/konnectivity-agent-wtfzb" Jul 29 15:46:40.637848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.637607 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-log-socket\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.637848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.637629 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/619ab912-9655-4f72-a490-3ff971625501-etc-selinux\") pod \"aws-ebs-csi-driver-node-fsfwz\" (UID: \"619ab912-9655-4f72-a490-3ff971625501\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fsfwz" Jul 29 15:46:40.637848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.637663 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea5db5cf-d8ce-4fac-b6e7-13e03e05f535-host-slash\") pod \"iptables-alerter-wx6jd\" (UID: \"ea5db5cf-d8ce-4fac-b6e7-13e03e05f535\") " pod="openshift-network-operator/iptables-alerter-wx6jd" Jul 29 15:46:40.637848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.637710 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-host-var-lib-cni-bin\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.637848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.637753 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-host-var-lib-cni-multus\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.637848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.637788 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-etc-kubernetes\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.637848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.637805 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-run-systemd\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.637848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.637824 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7e8b3213-5f73-40dc-8357-d1ae21efd3d9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6nm7c\" (UID: \"7e8b3213-5f73-40dc-8357-d1ae21efd3d9\") " pod="openshift-multus/multus-additional-cni-plugins-6nm7c" Jul 29 15:46:40.637848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.637851 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-sys\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.638401 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.637880 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qs49\" (UniqueName: \"kubernetes.io/projected/7377e78e-3c71-4fcb-918c-eb6c54e2d562-kube-api-access-4qs49\") pod \"network-metrics-daemon-64nqz\" (UID: \"7377e78e-3c71-4fcb-918c-eb6c54e2d562\") " pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:46:40.638401 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.637907 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-os-release\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.638401 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.637934 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7192759b-4ce8-4271-a907-7d4c227599b1-cni-binary-copy\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.638401 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.637959 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-host-run-netns\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.638401 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638001 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-host-var-lib-kubelet\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.638401 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638017 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/619ab912-9655-4f72-a490-3ff971625501-socket-dir\") pod \"aws-ebs-csi-driver-node-fsfwz\" (UID: \"619ab912-9655-4f72-a490-3ff971625501\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fsfwz" Jul 29 15:46:40.638401 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638047 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea5db5cf-d8ce-4fac-b6e7-13e03e05f535-iptables-alerter-script\") pod \"iptables-alerter-wx6jd\" (UID: \"ea5db5cf-d8ce-4fac-b6e7-13e03e05f535\") " pod="openshift-network-operator/iptables-alerter-wx6jd" Jul 29 15:46:40.638401 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638065 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-host-run-k8s-cni-cncf-io\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.638401 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638094 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.638401 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638111 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8lhd\" (UniqueName: \"kubernetes.io/projected/619ab912-9655-4f72-a490-3ff971625501-kube-api-access-g8lhd\") pod \"aws-ebs-csi-driver-node-fsfwz\" (UID: \"619ab912-9655-4f72-a490-3ff971625501\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fsfwz" Jul 29 15:46:40.638401 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638129 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd61573c-d06b-46e4-afea-887f283a1e1a-env-overrides\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.638401 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638152 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7192759b-4ce8-4271-a907-7d4c227599b1-multus-daemon-config\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.638401 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638137 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvgsv\" (UniqueName: \"kubernetes.io/projected/7e8b3213-5f73-40dc-8357-d1ae21efd3d9-kube-api-access-vvgsv\") pod \"multus-additional-cni-plugins-6nm7c\" (UID: \"7e8b3213-5f73-40dc-8357-d1ae21efd3d9\") " pod="openshift-multus/multus-additional-cni-plugins-6nm7c" Jul 29 15:46:40.638401 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638234 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf8ks\" (UniqueName: \"kubernetes.io/projected/7192759b-4ce8-4271-a907-7d4c227599b1-kube-api-access-bf8ks\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.638401 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638265 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd61573c-d06b-46e4-afea-887f283a1e1a-ovnkube-script-lib\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.638401 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638267 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-run-openvswitch\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.638401 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638309 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/77adaab3-405e-43d8-8dec-badf07ce38f2-dbus\") pod \"global-pull-secret-syncer-f5gvg\" (UID: \"77adaab3-405e-43d8-8dec-badf07ce38f2\") " pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:46:40.639306 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638311 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-run-openvswitch\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.639306 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638325 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7377e78e-3c71-4fcb-918c-eb6c54e2d562-metrics-certs\") pod \"network-metrics-daemon-64nqz\" (UID: \"7377e78e-3c71-4fcb-918c-eb6c54e2d562\") " pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:46:40.639306 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638367 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-host-cni-netd\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.639306 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638392 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e8b3213-5f73-40dc-8357-d1ae21efd3d9-cnibin\") pod \"multus-additional-cni-plugins-6nm7c\" (UID: \"7e8b3213-5f73-40dc-8357-d1ae21efd3d9\") " pod="openshift-multus/multus-additional-cni-plugins-6nm7c" Jul 29 15:46:40.639306 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638419 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-log-socket\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.639306 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:40.638500 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:40.639306 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638579 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-host-cni-netd\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.639306 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638686 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/619ab912-9655-4f72-a490-3ff971625501-etc-selinux\") pod \"aws-ebs-csi-driver-node-fsfwz\" (UID: \"619ab912-9655-4f72-a490-3ff971625501\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fsfwz" Jul 29 15:46:40.639306 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.637628 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-host-slash\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.639306 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:40.638705 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7377e78e-3c71-4fcb-918c-eb6c54e2d562-metrics-certs podName:7377e78e-3c71-4fcb-918c-eb6c54e2d562 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:41.13867234 +0000 UTC m=+2.982969799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7377e78e-3c71-4fcb-918c-eb6c54e2d562-metrics-certs") pod "network-metrics-daemon-64nqz" (UID: "7377e78e-3c71-4fcb-918c-eb6c54e2d562") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:40.639306 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638732 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-os-release\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.639306 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638771 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-host-var-lib-cni-multus\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.639306 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638798 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-etc-kubernetes\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.639306 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638796 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-run-systemd\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.639306 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638420 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6skr\" (UniqueName: \"kubernetes.io/projected/e7e55e83-cfda-4e11-8182-e93e305e78bb-kube-api-access-t6skr\") pod \"network-check-target-rwvpj\" (UID: \"e7e55e83-cfda-4e11-8182-e93e305e78bb\") " pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:46:40.639306 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638833 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-lib-modules\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.639306 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638852 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-host-kubelet\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.640213 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638887 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e8b3213-5f73-40dc-8357-d1ae21efd3d9-cnibin\") pod \"multus-additional-cni-plugins-6nm7c\" (UID: \"7e8b3213-5f73-40dc-8357-d1ae21efd3d9\") " pod="openshift-multus/multus-additional-cni-plugins-6nm7c" Jul 29 15:46:40.640213 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638893 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-host-run-netns\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.640213 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638928 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/619ab912-9655-4f72-a490-3ff971625501-sys-fs\") pod \"aws-ebs-csi-driver-node-fsfwz\" (UID: \"619ab912-9655-4f72-a490-3ff971625501\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fsfwz" Jul 29 15:46:40.640213 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638931 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-host-run-netns\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.640213 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638961 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77adaab3-405e-43d8-8dec-badf07ce38f2-original-pull-secret\") pod \"global-pull-secret-syncer-f5gvg\" (UID: \"77adaab3-405e-43d8-8dec-badf07ce38f2\") " pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:46:40.640213 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638991 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-host-run-k8s-cni-cncf-io\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.640213 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.638991 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-etc-sysctl-conf\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.640213 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639023 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.640213 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639036 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-var-lib-kubelet\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.640213 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639061 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-hostroot\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.640213 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639085 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-etc-openvswitch\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.640213 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639111 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e8b3213-5f73-40dc-8357-d1ae21efd3d9-system-cni-dir\") pod \"multus-additional-cni-plugins-6nm7c\" (UID: \"7e8b3213-5f73-40dc-8357-d1ae21efd3d9\") " pod="openshift-multus/multus-additional-cni-plugins-6nm7c" Jul 29 15:46:40.640213 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639136 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e8b3213-5f73-40dc-8357-d1ae21efd3d9-os-release\") pod \"multus-additional-cni-plugins-6nm7c\" (UID: \"7e8b3213-5f73-40dc-8357-d1ae21efd3d9\") " pod="openshift-multus/multus-additional-cni-plugins-6nm7c" Jul 29 15:46:40.640213 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639163 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlt2w\" (UniqueName: \"kubernetes.io/projected/4f782ba3-b2ac-46c7-ad06-db9aa6721614-kube-api-access-hlt2w\") pod \"node-resolver-7w9zd\" (UID: \"4f782ba3-b2ac-46c7-ad06-db9aa6721614\") " pod="openshift-dns/node-resolver-7w9zd" Jul 29 15:46:40.640213 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639162 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7e8b3213-5f73-40dc-8357-d1ae21efd3d9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6nm7c\" (UID: \"7e8b3213-5f73-40dc-8357-d1ae21efd3d9\") " pod="openshift-multus/multus-additional-cni-plugins-6nm7c" Jul 29 15:46:40.640213 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639178 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-host-var-lib-cni-bin\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.640213 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639205 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-etc-modprobe-d\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.641082 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639222 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-host-kubelet\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.641082 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639244 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-host-var-lib-kubelet\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.641082 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639279 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7192759b-4ce8-4271-a907-7d4c227599b1-cni-binary-copy\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.641082 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639278 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-etc-sysconfig\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.641082 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639301 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-host-run-netns\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.641082 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639316 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-etc-kubernetes\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.641082 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639323 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/619ab912-9655-4f72-a490-3ff971625501-socket-dir\") pod \"aws-ebs-csi-driver-node-fsfwz\" (UID: \"619ab912-9655-4f72-a490-3ff971625501\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fsfwz" Jul 29 15:46:40.641082 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639334 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-hostroot\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.641082 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639355 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-systemd-units\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.641082 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639381 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-var-lib-openvswitch\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.641082 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639406 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e8b3213-5f73-40dc-8357-d1ae21efd3d9-system-cni-dir\") pod \"multus-additional-cni-plugins-6nm7c\" (UID: \"7e8b3213-5f73-40dc-8357-d1ae21efd3d9\") " pod="openshift-multus/multus-additional-cni-plugins-6nm7c" Jul 29 15:46:40.641082 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639405 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-etc-openvswitch\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.641082 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:40.639443 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:40.641082 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639443 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/619ab912-9655-4f72-a490-3ff971625501-registration-dir\") pod \"aws-ebs-csi-driver-node-fsfwz\" (UID: \"619ab912-9655-4f72-a490-3ff971625501\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fsfwz" Jul 29 15:46:40.641082 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639471 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/619ab912-9655-4f72-a490-3ff971625501-sys-fs\") pod \"aws-ebs-csi-driver-node-fsfwz\" (UID: \"619ab912-9655-4f72-a490-3ff971625501\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fsfwz" Jul 29 15:46:40.641082 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639484 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/619ab912-9655-4f72-a490-3ff971625501-registration-dir\") pod \"aws-ebs-csi-driver-node-fsfwz\" (UID: \"619ab912-9655-4f72-a490-3ff971625501\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fsfwz" Jul 29 15:46:40.641082 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639560 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-systemd-units\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.641777 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:40.639571 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77adaab3-405e-43d8-8dec-badf07ce38f2-original-pull-secret podName:77adaab3-405e-43d8-8dec-badf07ce38f2 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:41.139552821 +0000 UTC m=+2.983850294 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/77adaab3-405e-43d8-8dec-badf07ce38f2-original-pull-secret") pod "global-pull-secret-syncer-f5gvg" (UID: "77adaab3-405e-43d8-8dec-badf07ce38f2") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:40.641777 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639586 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e8b3213-5f73-40dc-8357-d1ae21efd3d9-os-release\") pod \"multus-additional-cni-plugins-6nm7c\" (UID: \"7e8b3213-5f73-40dc-8357-d1ae21efd3d9\") " pod="openshift-multus/multus-additional-cni-plugins-6nm7c" Jul 29 15:46:40.641777 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639605 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-var-lib-openvswitch\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.641777 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639608 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e8b3213-5f73-40dc-8357-d1ae21efd3d9-cni-binary-copy\") pod \"multus-additional-cni-plugins-6nm7c\" (UID: \"7e8b3213-5f73-40dc-8357-d1ae21efd3d9\") " pod="openshift-multus/multus-additional-cni-plugins-6nm7c" Jul 29 15:46:40.641777 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639642 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/77adaab3-405e-43d8-8dec-badf07ce38f2-kubelet-config\") pod \"global-pull-secret-syncer-f5gvg\" (UID: \"77adaab3-405e-43d8-8dec-badf07ce38f2\") " pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:46:40.641777 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639667 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-multus-conf-dir\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.641777 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639693 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-host-cni-bin\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.641777 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639726 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/619ab912-9655-4f72-a490-3ff971625501-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fsfwz\" (UID: \"619ab912-9655-4f72-a490-3ff971625501\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fsfwz" Jul 29 15:46:40.641777 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639727 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-host-cni-bin\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.641777 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639770 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f782ba3-b2ac-46c7-ad06-db9aa6721614-tmp-dir\") pod \"node-resolver-7w9zd\" (UID: \"4f782ba3-b2ac-46c7-ad06-db9aa6721614\") " pod="openshift-dns/node-resolver-7w9zd" Jul 29 15:46:40.641777 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639801 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f9640ca5-c93f-49dc-9216-d3ea149abb4f-serviceca\") pod \"node-ca-254br\" (UID: \"f9640ca5-c93f-49dc-9216-d3ea149abb4f\") " pod="openshift-image-registry/node-ca-254br" Jul 29 15:46:40.641777 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639810 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/619ab912-9655-4f72-a490-3ff971625501-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fsfwz\" (UID: \"619ab912-9655-4f72-a490-3ff971625501\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fsfwz" Jul 29 15:46:40.641777 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639843 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0008c431-6fb6-4973-a20c-c3f28caa264c-tmp\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.641777 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639850 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-multus-conf-dir\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.641777 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639874 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd61573c-d06b-46e4-afea-887f283a1e1a-ovn-node-metrics-cert\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.641777 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639893 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/77adaab3-405e-43d8-8dec-badf07ce38f2-kubelet-config\") pod \"global-pull-secret-syncer-f5gvg\" (UID: \"77adaab3-405e-43d8-8dec-badf07ce38f2\") " pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:46:40.642264 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639932 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm8v8\" (UniqueName: \"kubernetes.io/projected/dd61573c-d06b-46e4-afea-887f283a1e1a-kube-api-access-bm8v8\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.642264 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639964 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-etc-systemd\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.642264 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.639991 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-run-ovn\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.642264 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.640029 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e8b3213-5f73-40dc-8357-d1ae21efd3d9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6nm7c\" (UID: \"7e8b3213-5f73-40dc-8357-d1ae21efd3d9\") " pod="openshift-multus/multus-additional-cni-plugins-6nm7c" Jul 29 15:46:40.642264 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.640052 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp2lk\" (UniqueName: \"kubernetes.io/projected/0008c431-6fb6-4973-a20c-c3f28caa264c-kube-api-access-dp2lk\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.642264 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.640068 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4c187f2d-0062-43b4-a61d-b92a4a85793c-agent-certs\") pod \"konnectivity-agent-wtfzb\" (UID: \"4c187f2d-0062-43b4-a61d-b92a4a85793c\") " pod="kube-system/konnectivity-agent-wtfzb" Jul 29 15:46:40.642264 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.640074 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e8b3213-5f73-40dc-8357-d1ae21efd3d9-cni-binary-copy\") pod \"multus-additional-cni-plugins-6nm7c\" (UID: \"7e8b3213-5f73-40dc-8357-d1ae21efd3d9\") " pod="openshift-multus/multus-additional-cni-plugins-6nm7c" Jul 29 15:46:40.642264 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.640092 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-cnibin\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.642264 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.640162 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-run-ovn\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.642264 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.640239 2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 29 15:46:40.642264 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.640359 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f782ba3-b2ac-46c7-ad06-db9aa6721614-tmp-dir\") pod \"node-resolver-7w9zd\" (UID: \"4f782ba3-b2ac-46c7-ad06-db9aa6721614\") " pod="openshift-dns/node-resolver-7w9zd" Jul 29 15:46:40.642264 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.640403 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-node-log\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.642264 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.640430 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd61573c-d06b-46e4-afea-887f283a1e1a-ovnkube-config\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.642264 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.640456 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/619ab912-9655-4f72-a490-3ff971625501-device-dir\") pod \"aws-ebs-csi-driver-node-fsfwz\" (UID: \"619ab912-9655-4f72-a490-3ff971625501\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fsfwz" Jul 29 15:46:40.642264 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.640460 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e8b3213-5f73-40dc-8357-d1ae21efd3d9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6nm7c\" (UID: \"7e8b3213-5f73-40dc-8357-d1ae21efd3d9\") " pod="openshift-multus/multus-additional-cni-plugins-6nm7c" Jul 29 15:46:40.642264 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.640481 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-cnibin\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.642264 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.640483 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqsgl\" (UniqueName: \"kubernetes.io/projected/f9640ca5-c93f-49dc-9216-d3ea149abb4f-kube-api-access-vqsgl\") pod \"node-ca-254br\" (UID: \"f9640ca5-c93f-49dc-9216-d3ea149abb4f\") " pod="openshift-image-registry/node-ca-254br" Jul 29 15:46:40.642264 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.640553 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-system-cni-dir\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.642848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.640572 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/619ab912-9655-4f72-a490-3ff971625501-device-dir\") pod \"aws-ebs-csi-driver-node-fsfwz\" (UID: \"619ab912-9655-4f72-a490-3ff971625501\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fsfwz" Jul 29 15:46:40.642848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.640580 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-multus-cni-dir\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.642848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.640608 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-multus-socket-dir-parent\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.642848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.640634 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-host-run-multus-certs\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.642848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.640661 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-host-run-ovn-kubernetes\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.642848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.640703 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7e8b3213-5f73-40dc-8357-d1ae21efd3d9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6nm7c\" (UID: \"7e8b3213-5f73-40dc-8357-d1ae21efd3d9\") " pod="openshift-multus/multus-additional-cni-plugins-6nm7c" Jul 29 15:46:40.642848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.640730 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4f782ba3-b2ac-46c7-ad06-db9aa6721614-hosts-file\") pod \"node-resolver-7w9zd\" (UID: \"4f782ba3-b2ac-46c7-ad06-db9aa6721614\") " pod="openshift-dns/node-resolver-7w9zd" Jul 29 15:46:40.642848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.640866 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-multus-socket-dir-parent\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.642848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.640879 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4f782ba3-b2ac-46c7-ad06-db9aa6721614-hosts-file\") pod \"node-resolver-7w9zd\" (UID: \"4f782ba3-b2ac-46c7-ad06-db9aa6721614\") " pod="openshift-dns/node-resolver-7w9zd" Jul 29 15:46:40.642848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.640879 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-node-log\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.642848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.640938 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-system-cni-dir\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.642848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.640967 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd61573c-d06b-46e4-afea-887f283a1e1a-ovnkube-config\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.642848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.641031 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-multus-cni-dir\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.642848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.641028 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7192759b-4ce8-4271-a907-7d4c227599b1-host-run-multus-certs\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.642848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.641065 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd61573c-d06b-46e4-afea-887f283a1e1a-host-run-ovn-kubernetes\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.642848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.641350 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7e8b3213-5f73-40dc-8357-d1ae21efd3d9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6nm7c\" (UID: \"7e8b3213-5f73-40dc-8357-d1ae21efd3d9\") " pod="openshift-multus/multus-additional-cni-plugins-6nm7c" Jul 29 15:46:40.644252 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.644175 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd61573c-d06b-46e4-afea-887f283a1e1a-ovn-node-metrics-cert\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.651128 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:40.650908 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:46:40.651128 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:40.650943 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:46:40.651128 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:40.650956 2584 projected.go:196] Error preparing data for projected volume kube-api-access-t6skr for pod openshift-network-diagnostics/network-check-target-rwvpj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:40.651128 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:40.651006 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7e55e83-cfda-4e11-8182-e93e305e78bb-kube-api-access-t6skr podName:e7e55e83-cfda-4e11-8182-e93e305e78bb nodeName:}" failed. No retries permitted until 2026-07-29 15:46:41.150991162 +0000 UTC m=+2.995288631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-t6skr" (UniqueName: "kubernetes.io/projected/e7e55e83-cfda-4e11-8182-e93e305e78bb-kube-api-access-t6skr") pod "network-check-target-rwvpj" (UID: "e7e55e83-cfda-4e11-8182-e93e305e78bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:40.654093 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.654066 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm8v8\" (UniqueName: \"kubernetes.io/projected/dd61573c-d06b-46e4-afea-887f283a1e1a-kube-api-access-bm8v8\") pod \"ovnkube-node-t5rxf\" (UID: \"dd61573c-d06b-46e4-afea-887f283a1e1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.654333 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.654305 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf8ks\" (UniqueName: \"kubernetes.io/projected/7192759b-4ce8-4271-a907-7d4c227599b1-kube-api-access-bf8ks\") pod \"multus-48lc4\" (UID: \"7192759b-4ce8-4271-a907-7d4c227599b1\") " pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.655038 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.655016 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvgsv\" (UniqueName: \"kubernetes.io/projected/7e8b3213-5f73-40dc-8357-d1ae21efd3d9-kube-api-access-vvgsv\") pod \"multus-additional-cni-plugins-6nm7c\" (UID: \"7e8b3213-5f73-40dc-8357-d1ae21efd3d9\") " pod="openshift-multus/multus-additional-cni-plugins-6nm7c" Jul 29 15:46:40.655649 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.655627 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8lhd\" (UniqueName: \"kubernetes.io/projected/619ab912-9655-4f72-a490-3ff971625501-kube-api-access-g8lhd\") pod \"aws-ebs-csi-driver-node-fsfwz\" (UID: \"619ab912-9655-4f72-a490-3ff971625501\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fsfwz" Jul 29 15:46:40.655740 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.655681 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qs49\" (UniqueName: \"kubernetes.io/projected/7377e78e-3c71-4fcb-918c-eb6c54e2d562-kube-api-access-4qs49\") pod \"network-metrics-daemon-64nqz\" (UID: \"7377e78e-3c71-4fcb-918c-eb6c54e2d562\") " pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:46:40.657153 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.657130 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlt2w\" (UniqueName: \"kubernetes.io/projected/4f782ba3-b2ac-46c7-ad06-db9aa6721614-kube-api-access-hlt2w\") pod \"node-resolver-7w9zd\" (UID: \"4f782ba3-b2ac-46c7-ad06-db9aa6721614\") " pod="openshift-dns/node-resolver-7w9zd" Jul 29 15:46:40.726269 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.726212 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-213.ec2.internal" event={"ID":"49c209b3e6e7d8404ad2a977c0bb87c9","Type":"ContainerStarted","Data":"0f99b209b37e8ce1c34408f302cbf3e1436b41045e67199693102be46a2ca74b"} Jul 29 15:46:40.727526 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.727494 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-213.ec2.internal" event={"ID":"a2ba8c9c359a1f1e65affdf9bc68bd46","Type":"ContainerStarted","Data":"5935e8a1169346e083679fcd6983804406bb4ac1b27de757adea556b3434f206"} Jul 29 15:46:40.740997 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.740968 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f9640ca5-c93f-49dc-9216-d3ea149abb4f-serviceca\") pod \"node-ca-254br\" (UID: \"f9640ca5-c93f-49dc-9216-d3ea149abb4f\") " pod="openshift-image-registry/node-ca-254br" Jul 29 15:46:40.741101 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.741006 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0008c431-6fb6-4973-a20c-c3f28caa264c-tmp\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.741101 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.741035 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-etc-systemd\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.741101 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.741069 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp2lk\" (UniqueName: \"kubernetes.io/projected/0008c431-6fb6-4973-a20c-c3f28caa264c-kube-api-access-dp2lk\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.741101 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.741094 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4c187f2d-0062-43b4-a61d-b92a4a85793c-agent-certs\") pod \"konnectivity-agent-wtfzb\" (UID: \"4c187f2d-0062-43b4-a61d-b92a4a85793c\") " pod="kube-system/konnectivity-agent-wtfzb" Jul 29 15:46:40.741299 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.741124 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqsgl\" (UniqueName: \"kubernetes.io/projected/f9640ca5-c93f-49dc-9216-d3ea149abb4f-kube-api-access-vqsgl\") pod \"node-ca-254br\" (UID: \"f9640ca5-c93f-49dc-9216-d3ea149abb4f\") " pod="openshift-image-registry/node-ca-254br" Jul 29 15:46:40.741299 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.741157 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9640ca5-c93f-49dc-9216-d3ea149abb4f-host\") pod \"node-ca-254br\" (UID: \"f9640ca5-c93f-49dc-9216-d3ea149abb4f\") " pod="openshift-image-registry/node-ca-254br" Jul 29 15:46:40.741299 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.741182 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-run\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.741299 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.741210 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkb6j\" (UniqueName: \"kubernetes.io/projected/ea5db5cf-d8ce-4fac-b6e7-13e03e05f535-kube-api-access-wkb6j\") pod \"iptables-alerter-wx6jd\" (UID: \"ea5db5cf-d8ce-4fac-b6e7-13e03e05f535\") " pod="openshift-network-operator/iptables-alerter-wx6jd" Jul 29 15:46:40.741299 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.741235 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-etc-sysctl-d\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.741299 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.741260 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-host\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.741299 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.741290 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0008c431-6fb6-4973-a20c-c3f28caa264c-etc-tuned\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.741621 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.741318 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4c187f2d-0062-43b4-a61d-b92a4a85793c-konnectivity-ca\") pod \"konnectivity-agent-wtfzb\" (UID: \"4c187f2d-0062-43b4-a61d-b92a4a85793c\") " pod="kube-system/konnectivity-agent-wtfzb" Jul 29 15:46:40.741621 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.741348 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea5db5cf-d8ce-4fac-b6e7-13e03e05f535-host-slash\") pod \"iptables-alerter-wx6jd\" (UID: \"ea5db5cf-d8ce-4fac-b6e7-13e03e05f535\") " pod="openshift-network-operator/iptables-alerter-wx6jd" Jul 29 15:46:40.741621 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.741376 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-sys\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.741621 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.741370 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9640ca5-c93f-49dc-9216-d3ea149abb4f-host\") pod \"node-ca-254br\" (UID: \"f9640ca5-c93f-49dc-9216-d3ea149abb4f\") " pod="openshift-image-registry/node-ca-254br" Jul 29 15:46:40.741621 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.741406 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea5db5cf-d8ce-4fac-b6e7-13e03e05f535-iptables-alerter-script\") pod \"iptables-alerter-wx6jd\" (UID: \"ea5db5cf-d8ce-4fac-b6e7-13e03e05f535\") " pod="openshift-network-operator/iptables-alerter-wx6jd" Jul 29 15:46:40.741621 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.741462 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-lib-modules\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.741621 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.741519 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-etc-sysctl-conf\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.741621 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.741542 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-var-lib-kubelet\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.741621 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.741573 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-etc-modprobe-d\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.741621 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.741598 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-etc-sysconfig\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.741621 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.741622 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-etc-kubernetes\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.742143 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.741715 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-etc-kubernetes\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.742143 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.741836 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-lib-modules\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.742143 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.741870 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-etc-systemd\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.742143 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.741880 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-var-lib-kubelet\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.742143 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.741915 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-etc-modprobe-d\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.742143 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.741964 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-etc-sysconfig\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.742143 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.742006 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-etc-sysctl-conf\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.742143 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.742032 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-etc-sysctl-d\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.742143 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.742091 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-run\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.742616 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.742146 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea5db5cf-d8ce-4fac-b6e7-13e03e05f535-host-slash\") pod \"iptables-alerter-wx6jd\" (UID: \"ea5db5cf-d8ce-4fac-b6e7-13e03e05f535\") " pod="openshift-network-operator/iptables-alerter-wx6jd" Jul 29 15:46:40.742616 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.742164 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-sys\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.742616 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.742175 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea5db5cf-d8ce-4fac-b6e7-13e03e05f535-iptables-alerter-script\") pod \"iptables-alerter-wx6jd\" (UID: \"ea5db5cf-d8ce-4fac-b6e7-13e03e05f535\") " pod="openshift-network-operator/iptables-alerter-wx6jd" Jul 29 15:46:40.742616 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.742226 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0008c431-6fb6-4973-a20c-c3f28caa264c-host\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.742616 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.742286 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f9640ca5-c93f-49dc-9216-d3ea149abb4f-serviceca\") pod \"node-ca-254br\" (UID: \"f9640ca5-c93f-49dc-9216-d3ea149abb4f\") " pod="openshift-image-registry/node-ca-254br" Jul 29 15:46:40.742882 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.742766 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4c187f2d-0062-43b4-a61d-b92a4a85793c-konnectivity-ca\") pod \"konnectivity-agent-wtfzb\" (UID: \"4c187f2d-0062-43b4-a61d-b92a4a85793c\") " pod="kube-system/konnectivity-agent-wtfzb" Jul 29 15:46:40.745330 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.745257 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4c187f2d-0062-43b4-a61d-b92a4a85793c-agent-certs\") pod \"konnectivity-agent-wtfzb\" (UID: \"4c187f2d-0062-43b4-a61d-b92a4a85793c\") " pod="kube-system/konnectivity-agent-wtfzb" Jul 29 15:46:40.745431 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.745323 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0008c431-6fb6-4973-a20c-c3f28caa264c-tmp\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.745431 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.745399 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0008c431-6fb6-4973-a20c-c3f28caa264c-etc-tuned\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.754426 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.753283 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqsgl\" (UniqueName: \"kubernetes.io/projected/f9640ca5-c93f-49dc-9216-d3ea149abb4f-kube-api-access-vqsgl\") pod \"node-ca-254br\" (UID: \"f9640ca5-c93f-49dc-9216-d3ea149abb4f\") " pod="openshift-image-registry/node-ca-254br" Jul 29 15:46:40.754426 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.753747 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp2lk\" (UniqueName: \"kubernetes.io/projected/0008c431-6fb6-4973-a20c-c3f28caa264c-kube-api-access-dp2lk\") pod \"tuned-qqxjg\" (UID: \"0008c431-6fb6-4973-a20c-c3f28caa264c\") " pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.755211 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.755152 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkb6j\" (UniqueName: \"kubernetes.io/projected/ea5db5cf-d8ce-4fac-b6e7-13e03e05f535-kube-api-access-wkb6j\") pod \"iptables-alerter-wx6jd\" (UID: \"ea5db5cf-d8ce-4fac-b6e7-13e03e05f535\") " pod="openshift-network-operator/iptables-alerter-wx6jd" Jul 29 15:46:40.825309 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.825274 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-48lc4" Jul 29 15:46:40.834239 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.834218 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:46:40.845132 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.845103 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fsfwz" Jul 29 15:46:40.853895 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.853874 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6nm7c" Jul 29 15:46:40.861591 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.861570 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7w9zd" Jul 29 15:46:40.867356 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.867336 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-254br" Jul 29 15:46:40.876217 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.876196 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wx6jd" Jul 29 15:46:40.884109 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.884090 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" Jul 29 15:46:40.890908 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:40.890888 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wtfzb" Jul 29 15:46:41.144538 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:41.144426 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7377e78e-3c71-4fcb-918c-eb6c54e2d562-metrics-certs\") pod \"network-metrics-daemon-64nqz\" (UID: \"7377e78e-3c71-4fcb-918c-eb6c54e2d562\") " pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:46:41.144699 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:41.144573 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77adaab3-405e-43d8-8dec-badf07ce38f2-original-pull-secret\") pod \"global-pull-secret-syncer-f5gvg\" (UID: \"77adaab3-405e-43d8-8dec-badf07ce38f2\") " pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:46:41.144699 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:41.144590 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:41.144817 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:41.144645 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:41.144817 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:41.144740 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7377e78e-3c71-4fcb-918c-eb6c54e2d562-metrics-certs podName:7377e78e-3c71-4fcb-918c-eb6c54e2d562 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:42.144706822 +0000 UTC m=+3.989004289 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7377e78e-3c71-4fcb-918c-eb6c54e2d562-metrics-certs") pod "network-metrics-daemon-64nqz" (UID: "7377e78e-3c71-4fcb-918c-eb6c54e2d562") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:41.144817 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:41.144780 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77adaab3-405e-43d8-8dec-badf07ce38f2-original-pull-secret podName:77adaab3-405e-43d8-8dec-badf07ce38f2 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:42.144761309 +0000 UTC m=+3.989058783 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/77adaab3-405e-43d8-8dec-badf07ce38f2-original-pull-secret") pod "global-pull-secret-syncer-f5gvg" (UID: "77adaab3-405e-43d8-8dec-badf07ce38f2") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:41.245195 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:41.245161 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6skr\" (UniqueName: \"kubernetes.io/projected/e7e55e83-cfda-4e11-8182-e93e305e78bb-kube-api-access-t6skr\") pod \"network-check-target-rwvpj\" (UID: \"e7e55e83-cfda-4e11-8182-e93e305e78bb\") " pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:46:41.245367 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:41.245321 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:46:41.245367 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:41.245337 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:46:41.245367 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:41.245347 2584 projected.go:196] Error preparing data for projected volume kube-api-access-t6skr for pod openshift-network-diagnostics/network-check-target-rwvpj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:41.245551 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:41.245425 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7e55e83-cfda-4e11-8182-e93e305e78bb-kube-api-access-t6skr podName:e7e55e83-cfda-4e11-8182-e93e305e78bb nodeName:}" failed. No retries permitted until 2026-07-29 15:46:42.245403351 +0000 UTC m=+4.089700811 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-t6skr" (UniqueName: "kubernetes.io/projected/e7e55e83-cfda-4e11-8182-e93e305e78bb-kube-api-access-t6skr") pod "network-check-target-rwvpj" (UID: "e7e55e83-cfda-4e11-8182-e93e305e78bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:41.575718 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:41.575614 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 15:41:40 +0000 UTC" deadline="2028-03-04 16:46:18.456062931 +0000 UTC" Jul 29 15:46:41.575718 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:41.575659 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14016h59m36.880409254s" Jul 29 15:46:41.673027 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:41.672988 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c187f2d_0062_43b4_a61d_b92a4a85793c.slice/crio-64cdc3d15ba1a1faa9577c7aa03086e0d4c6845608a49eb2839ab775e9ed30f2 WatchSource:0}: Error finding container 64cdc3d15ba1a1faa9577c7aa03086e0d4c6845608a49eb2839ab775e9ed30f2: Status 404 returned error can't find the container with id 64cdc3d15ba1a1faa9577c7aa03086e0d4c6845608a49eb2839ab775e9ed30f2 Jul 29 15:46:41.674795 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:41.674763 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7192759b_4ce8_4271_a907_7d4c227599b1.slice/crio-b9d74555e3275cba7d3fa9326b24008d49177713a9b48ea0e23c38f25186ff24 WatchSource:0}: Error finding container b9d74555e3275cba7d3fa9326b24008d49177713a9b48ea0e23c38f25186ff24: Status 404 returned error can't find the container with id b9d74555e3275cba7d3fa9326b24008d49177713a9b48ea0e23c38f25186ff24 Jul 29 15:46:41.678615 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:41.678578 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9640ca5_c93f_49dc_9216_d3ea149abb4f.slice/crio-3458bc36ad1adac097b38ae19359d74c41b2e2149ff581f8359532ca88b4be4f WatchSource:0}: Error finding container 3458bc36ad1adac097b38ae19359d74c41b2e2149ff581f8359532ca88b4be4f: Status 404 returned error can't find the container with id 3458bc36ad1adac097b38ae19359d74c41b2e2149ff581f8359532ca88b4be4f Jul 29 15:46:41.680362 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:41.680339 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod619ab912_9655_4f72_a490_3ff971625501.slice/crio-c2a979931ea563fe9d04479bdf81ba897fc65c2ee8052235127175e6142212e6 WatchSource:0}: Error finding container c2a979931ea563fe9d04479bdf81ba897fc65c2ee8052235127175e6142212e6: Status 404 returned error can't find the container with id c2a979931ea563fe9d04479bdf81ba897fc65c2ee8052235127175e6142212e6 Jul 29 15:46:41.681155 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:41.681008 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea5db5cf_d8ce_4fac_b6e7_13e03e05f535.slice/crio-3d93ebf64fcbdab8d5ee92a961d1f3435482c4aef71118fc8bec2c95b9599339 WatchSource:0}: Error finding container 3d93ebf64fcbdab8d5ee92a961d1f3435482c4aef71118fc8bec2c95b9599339: Status 404 returned error can't find the container with id 3d93ebf64fcbdab8d5ee92a961d1f3435482c4aef71118fc8bec2c95b9599339 Jul 29 15:46:41.682814 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:41.682785 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f782ba3_b2ac_46c7_ad06_db9aa6721614.slice/crio-01c207ae500444b018ee11964ac9bf7f89584e8c0f392453b0d1060d7f62bf17 WatchSource:0}: Error finding container 01c207ae500444b018ee11964ac9bf7f89584e8c0f392453b0d1060d7f62bf17: Status 404 returned error can't find the container with id 01c207ae500444b018ee11964ac9bf7f89584e8c0f392453b0d1060d7f62bf17 Jul 29 15:46:41.683196 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:41.683172 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd61573c_d06b_46e4_afea_887f283a1e1a.slice/crio-5df8ade360cc82fc702ea775750518285b1bc8529673b8d0048f05a158132d7a WatchSource:0}: Error finding container 5df8ade360cc82fc702ea775750518285b1bc8529673b8d0048f05a158132d7a: Status 404 returned error can't find the container with id 5df8ade360cc82fc702ea775750518285b1bc8529673b8d0048f05a158132d7a Jul 29 15:46:41.686000 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:46:41.685604 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e8b3213_5f73_40dc_8357_d1ae21efd3d9.slice/crio-e60463c984e883ce2678ad3f453853f8b82ee4961b114592fa506c4a4ce316e4 WatchSource:0}: Error finding container e60463c984e883ce2678ad3f453853f8b82ee4961b114592fa506c4a4ce316e4: Status 404 returned error can't find the container with id e60463c984e883ce2678ad3f453853f8b82ee4961b114592fa506c4a4ce316e4 Jul 29 15:46:41.732160 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:41.732007 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" event={"ID":"0008c431-6fb6-4973-a20c-c3f28caa264c","Type":"ContainerStarted","Data":"32b9b96d47d3591242fd57adcd106cac229ade7de0862a46b22360f238cf2dff"} Jul 29 15:46:41.733219 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:41.733196 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6nm7c" event={"ID":"7e8b3213-5f73-40dc-8357-d1ae21efd3d9","Type":"ContainerStarted","Data":"e60463c984e883ce2678ad3f453853f8b82ee4961b114592fa506c4a4ce316e4"} Jul 29 15:46:41.734536 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:41.734512 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" event={"ID":"dd61573c-d06b-46e4-afea-887f283a1e1a","Type":"ContainerStarted","Data":"5df8ade360cc82fc702ea775750518285b1bc8529673b8d0048f05a158132d7a"} Jul 29 15:46:41.735976 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:41.735945 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wx6jd" event={"ID":"ea5db5cf-d8ce-4fac-b6e7-13e03e05f535","Type":"ContainerStarted","Data":"3d93ebf64fcbdab8d5ee92a961d1f3435482c4aef71118fc8bec2c95b9599339"} Jul 29 15:46:41.737809 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:41.737783 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fsfwz" event={"ID":"619ab912-9655-4f72-a490-3ff971625501","Type":"ContainerStarted","Data":"c2a979931ea563fe9d04479bdf81ba897fc65c2ee8052235127175e6142212e6"} Jul 29 15:46:41.739135 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:41.739111 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-254br" event={"ID":"f9640ca5-c93f-49dc-9216-d3ea149abb4f","Type":"ContainerStarted","Data":"3458bc36ad1adac097b38ae19359d74c41b2e2149ff581f8359532ca88b4be4f"} Jul 29 15:46:41.740300 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:41.740276 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-48lc4" event={"ID":"7192759b-4ce8-4271-a907-7d4c227599b1","Type":"ContainerStarted","Data":"b9d74555e3275cba7d3fa9326b24008d49177713a9b48ea0e23c38f25186ff24"} Jul 29 15:46:41.741429 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:41.741401 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7w9zd" event={"ID":"4f782ba3-b2ac-46c7-ad06-db9aa6721614","Type":"ContainerStarted","Data":"01c207ae500444b018ee11964ac9bf7f89584e8c0f392453b0d1060d7f62bf17"} Jul 29 15:46:41.742404 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:41.742380 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wtfzb" event={"ID":"4c187f2d-0062-43b4-a61d-b92a4a85793c","Type":"ContainerStarted","Data":"64cdc3d15ba1a1faa9577c7aa03086e0d4c6845608a49eb2839ab775e9ed30f2"} Jul 29 15:46:42.153893 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:42.153226 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7377e78e-3c71-4fcb-918c-eb6c54e2d562-metrics-certs\") pod \"network-metrics-daemon-64nqz\" (UID: \"7377e78e-3c71-4fcb-918c-eb6c54e2d562\") " pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:46:42.153893 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:42.153284 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77adaab3-405e-43d8-8dec-badf07ce38f2-original-pull-secret\") pod \"global-pull-secret-syncer-f5gvg\" (UID: \"77adaab3-405e-43d8-8dec-badf07ce38f2\") " pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:46:42.153893 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:42.153416 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:42.153893 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:42.153496 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77adaab3-405e-43d8-8dec-badf07ce38f2-original-pull-secret podName:77adaab3-405e-43d8-8dec-badf07ce38f2 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:44.153457209 +0000 UTC m=+5.997754671 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/77adaab3-405e-43d8-8dec-badf07ce38f2-original-pull-secret") pod "global-pull-secret-syncer-f5gvg" (UID: "77adaab3-405e-43d8-8dec-badf07ce38f2") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:42.153893 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:42.153613 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:42.153893 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:42.153663 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7377e78e-3c71-4fcb-918c-eb6c54e2d562-metrics-certs podName:7377e78e-3c71-4fcb-918c-eb6c54e2d562 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:44.153650429 +0000 UTC m=+5.997947888 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7377e78e-3c71-4fcb-918c-eb6c54e2d562-metrics-certs") pod "network-metrics-daemon-64nqz" (UID: "7377e78e-3c71-4fcb-918c-eb6c54e2d562") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:42.257013 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:42.256977 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6skr\" (UniqueName: \"kubernetes.io/projected/e7e55e83-cfda-4e11-8182-e93e305e78bb-kube-api-access-t6skr\") pod \"network-check-target-rwvpj\" (UID: \"e7e55e83-cfda-4e11-8182-e93e305e78bb\") " pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:46:42.257218 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:42.257199 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:46:42.257292 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:42.257225 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:46:42.257292 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:42.257250 2584 projected.go:196] Error preparing data for projected volume kube-api-access-t6skr for pod openshift-network-diagnostics/network-check-target-rwvpj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:42.257401 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:42.257325 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7e55e83-cfda-4e11-8182-e93e305e78bb-kube-api-access-t6skr podName:e7e55e83-cfda-4e11-8182-e93e305e78bb nodeName:}" failed. No retries permitted until 2026-07-29 15:46:44.257297029 +0000 UTC m=+6.101594489 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-t6skr" (UniqueName: "kubernetes.io/projected/e7e55e83-cfda-4e11-8182-e93e305e78bb-kube-api-access-t6skr") pod "network-check-target-rwvpj" (UID: "e7e55e83-cfda-4e11-8182-e93e305e78bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:42.576917 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:42.576762 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 15:41:40 +0000 UTC" deadline="2028-01-13 15:13:45.53839618 +0000 UTC" Jul 29 15:46:42.576917 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:42.576830 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12791h27m2.961571157s" Jul 29 15:46:42.724233 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:42.724204 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:46:42.724360 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:42.724337 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5gvg" podUID="77adaab3-405e-43d8-8dec-badf07ce38f2" Jul 29 15:46:42.724804 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:42.724782 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:46:42.724924 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:42.724904 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64nqz" podUID="7377e78e-3c71-4fcb-918c-eb6c54e2d562" Jul 29 15:46:42.724990 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:42.724971 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:46:42.725055 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:42.725038 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwvpj" podUID="e7e55e83-cfda-4e11-8182-e93e305e78bb" Jul 29 15:46:42.749310 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:42.749266 2584 generic.go:356] "Generic (PLEG): container finished" podID="49c209b3e6e7d8404ad2a977c0bb87c9" containerID="bc8b4bd444fdef939bb24ffe8ae9f7615a42e849d9a361f7dc19070e9e5c2ff3" exitCode=0 Jul 29 15:46:42.749451 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:42.749364 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-213.ec2.internal" event={"ID":"49c209b3e6e7d8404ad2a977c0bb87c9","Type":"ContainerDied","Data":"bc8b4bd444fdef939bb24ffe8ae9f7615a42e849d9a361f7dc19070e9e5c2ff3"} Jul 29 15:46:42.758960 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:42.758903 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-213.ec2.internal" event={"ID":"a2ba8c9c359a1f1e65affdf9bc68bd46","Type":"ContainerStarted","Data":"0a37795d4fb5ebe2fabe5553999a2c69bb6b60d1c1662f9e73bbca9e09bc62f2"} Jul 29 15:46:42.785810 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:42.784756 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-213.ec2.internal" podStartSLOduration=2.784737312 podStartE2EDuration="2.784737312s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:46:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:46:42.784408489 +0000 UTC m=+4.628705969" watchObservedRunningTime="2026-07-29 15:46:42.784737312 +0000 UTC m=+4.629034796" Jul 29 15:46:43.779453 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:43.779404 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-213.ec2.internal" event={"ID":"49c209b3e6e7d8404ad2a977c0bb87c9","Type":"ContainerStarted","Data":"7a5c2a25a6d30c53c0e6fbfc56750e6ce514329c92faeb379e5e5c3797d3a778"} Jul 29 15:46:44.174246 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:44.174162 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7377e78e-3c71-4fcb-918c-eb6c54e2d562-metrics-certs\") pod \"network-metrics-daemon-64nqz\" (UID: \"7377e78e-3c71-4fcb-918c-eb6c54e2d562\") " pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:46:44.174246 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:44.174225 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77adaab3-405e-43d8-8dec-badf07ce38f2-original-pull-secret\") pod \"global-pull-secret-syncer-f5gvg\" (UID: \"77adaab3-405e-43d8-8dec-badf07ce38f2\") " pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:46:44.174489 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:44.174405 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:44.174489 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:44.174483 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77adaab3-405e-43d8-8dec-badf07ce38f2-original-pull-secret podName:77adaab3-405e-43d8-8dec-badf07ce38f2 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:48.174462396 +0000 UTC m=+10.018759854 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/77adaab3-405e-43d8-8dec-badf07ce38f2-original-pull-secret") pod "global-pull-secret-syncer-f5gvg" (UID: "77adaab3-405e-43d8-8dec-badf07ce38f2") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:44.174920 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:44.174899 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:44.175004 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:44.174954 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7377e78e-3c71-4fcb-918c-eb6c54e2d562-metrics-certs podName:7377e78e-3c71-4fcb-918c-eb6c54e2d562 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:48.174938774 +0000 UTC m=+10.019236238 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7377e78e-3c71-4fcb-918c-eb6c54e2d562-metrics-certs") pod "network-metrics-daemon-64nqz" (UID: "7377e78e-3c71-4fcb-918c-eb6c54e2d562") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:44.274781 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:44.274742 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6skr\" (UniqueName: \"kubernetes.io/projected/e7e55e83-cfda-4e11-8182-e93e305e78bb-kube-api-access-t6skr\") pod \"network-check-target-rwvpj\" (UID: \"e7e55e83-cfda-4e11-8182-e93e305e78bb\") " pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:46:44.274942 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:44.274927 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:46:44.275007 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:44.274946 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:46:44.275007 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:44.274958 2584 projected.go:196] Error preparing data for projected volume kube-api-access-t6skr for pod openshift-network-diagnostics/network-check-target-rwvpj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:44.275110 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:44.275011 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7e55e83-cfda-4e11-8182-e93e305e78bb-kube-api-access-t6skr podName:e7e55e83-cfda-4e11-8182-e93e305e78bb nodeName:}" failed. No retries permitted until 2026-07-29 15:46:48.274994441 +0000 UTC m=+10.119291903 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-t6skr" (UniqueName: "kubernetes.io/projected/e7e55e83-cfda-4e11-8182-e93e305e78bb-kube-api-access-t6skr") pod "network-check-target-rwvpj" (UID: "e7e55e83-cfda-4e11-8182-e93e305e78bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:44.723780 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:44.723750 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:46:44.723960 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:44.723878 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5gvg" podUID="77adaab3-405e-43d8-8dec-badf07ce38f2" Jul 29 15:46:44.724261 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:44.724236 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:46:44.724370 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:44.724349 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64nqz" podUID="7377e78e-3c71-4fcb-918c-eb6c54e2d562" Jul 29 15:46:44.724458 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:44.724404 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:46:44.724518 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:44.724487 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwvpj" podUID="e7e55e83-cfda-4e11-8182-e93e305e78bb" Jul 29 15:46:46.722468 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:46.721829 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:46:46.722468 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:46.721952 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwvpj" podUID="e7e55e83-cfda-4e11-8182-e93e305e78bb" Jul 29 15:46:46.722468 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:46.722358 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:46:46.722468 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:46.722467 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5gvg" podUID="77adaab3-405e-43d8-8dec-badf07ce38f2" Jul 29 15:46:46.723374 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:46.722578 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:46:46.723374 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:46.722737 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64nqz" podUID="7377e78e-3c71-4fcb-918c-eb6c54e2d562" Jul 29 15:46:48.209291 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:48.209256 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7377e78e-3c71-4fcb-918c-eb6c54e2d562-metrics-certs\") pod \"network-metrics-daemon-64nqz\" (UID: \"7377e78e-3c71-4fcb-918c-eb6c54e2d562\") " pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:46:48.209729 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:48.209303 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77adaab3-405e-43d8-8dec-badf07ce38f2-original-pull-secret\") pod \"global-pull-secret-syncer-f5gvg\" (UID: \"77adaab3-405e-43d8-8dec-badf07ce38f2\") " pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:46:48.209729 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:48.209413 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:48.209729 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:48.209427 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:48.209729 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:48.209483 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77adaab3-405e-43d8-8dec-badf07ce38f2-original-pull-secret podName:77adaab3-405e-43d8-8dec-badf07ce38f2 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:56.209464588 +0000 UTC m=+18.053762048 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/77adaab3-405e-43d8-8dec-badf07ce38f2-original-pull-secret") pod "global-pull-secret-syncer-f5gvg" (UID: "77adaab3-405e-43d8-8dec-badf07ce38f2") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:48.209729 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:48.209504 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7377e78e-3c71-4fcb-918c-eb6c54e2d562-metrics-certs podName:7377e78e-3c71-4fcb-918c-eb6c54e2d562 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:56.209493233 +0000 UTC m=+18.053790697 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7377e78e-3c71-4fcb-918c-eb6c54e2d562-metrics-certs") pod "network-metrics-daemon-64nqz" (UID: "7377e78e-3c71-4fcb-918c-eb6c54e2d562") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:48.310470 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:48.310424 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6skr\" (UniqueName: \"kubernetes.io/projected/e7e55e83-cfda-4e11-8182-e93e305e78bb-kube-api-access-t6skr\") pod \"network-check-target-rwvpj\" (UID: \"e7e55e83-cfda-4e11-8182-e93e305e78bb\") " pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:46:48.310642 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:48.310591 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:46:48.310642 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:48.310609 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:46:48.310642 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:48.310622 2584 projected.go:196] Error preparing data for projected volume kube-api-access-t6skr for pod openshift-network-diagnostics/network-check-target-rwvpj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:48.310758 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:48.310677 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7e55e83-cfda-4e11-8182-e93e305e78bb-kube-api-access-t6skr podName:e7e55e83-cfda-4e11-8182-e93e305e78bb nodeName:}" failed. No retries permitted until 2026-07-29 15:46:56.31065885 +0000 UTC m=+18.154956313 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-t6skr" (UniqueName: "kubernetes.io/projected/e7e55e83-cfda-4e11-8182-e93e305e78bb-kube-api-access-t6skr") pod "network-check-target-rwvpj" (UID: "e7e55e83-cfda-4e11-8182-e93e305e78bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:48.722265 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:48.722233 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:46:48.722427 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:48.722360 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64nqz" podUID="7377e78e-3c71-4fcb-918c-eb6c54e2d562" Jul 29 15:46:48.722728 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:48.722696 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:46:48.722868 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:48.722777 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwvpj" podUID="e7e55e83-cfda-4e11-8182-e93e305e78bb" Jul 29 15:46:48.722868 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:48.722839 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:46:48.723000 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:48.722910 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5gvg" podUID="77adaab3-405e-43d8-8dec-badf07ce38f2" Jul 29 15:46:50.721491 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:50.721428 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:46:50.721944 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:50.721587 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64nqz" podUID="7377e78e-3c71-4fcb-918c-eb6c54e2d562" Jul 29 15:46:50.722023 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:50.721949 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:46:50.722075 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:50.722036 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwvpj" podUID="e7e55e83-cfda-4e11-8182-e93e305e78bb" Jul 29 15:46:50.722121 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:50.722097 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:46:50.722293 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:50.722221 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5gvg" podUID="77adaab3-405e-43d8-8dec-badf07ce38f2" Jul 29 15:46:52.721352 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:52.721320 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:46:52.721752 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:52.721321 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:46:52.721752 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:52.721465 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:46:52.721752 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:52.721459 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5gvg" podUID="77adaab3-405e-43d8-8dec-badf07ce38f2" Jul 29 15:46:52.721752 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:52.721572 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwvpj" podUID="e7e55e83-cfda-4e11-8182-e93e305e78bb" Jul 29 15:46:52.721752 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:52.721653 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64nqz" podUID="7377e78e-3c71-4fcb-918c-eb6c54e2d562" Jul 29 15:46:54.722171 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:54.722134 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:46:54.722619 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:54.722134 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:46:54.722619 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:54.722281 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:46:54.722619 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:54.722277 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64nqz" podUID="7377e78e-3c71-4fcb-918c-eb6c54e2d562" Jul 29 15:46:54.722619 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:54.722389 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5gvg" podUID="77adaab3-405e-43d8-8dec-badf07ce38f2" Jul 29 15:46:54.722619 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:54.722500 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwvpj" podUID="e7e55e83-cfda-4e11-8182-e93e305e78bb" Jul 29 15:46:56.268929 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:56.268856 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7377e78e-3c71-4fcb-918c-eb6c54e2d562-metrics-certs\") pod \"network-metrics-daemon-64nqz\" (UID: \"7377e78e-3c71-4fcb-918c-eb6c54e2d562\") " pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:46:56.268929 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:56.268909 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77adaab3-405e-43d8-8dec-badf07ce38f2-original-pull-secret\") pod \"global-pull-secret-syncer-f5gvg\" (UID: \"77adaab3-405e-43d8-8dec-badf07ce38f2\") " pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:46:56.269433 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:56.269001 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:56.269433 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:56.269052 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77adaab3-405e-43d8-8dec-badf07ce38f2-original-pull-secret podName:77adaab3-405e-43d8-8dec-badf07ce38f2 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:12.269032487 +0000 UTC m=+34.113329944 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/77adaab3-405e-43d8-8dec-badf07ce38f2-original-pull-secret") pod "global-pull-secret-syncer-f5gvg" (UID: "77adaab3-405e-43d8-8dec-badf07ce38f2") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:56.269433 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:56.269001 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:56.269433 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:56.269157 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7377e78e-3c71-4fcb-918c-eb6c54e2d562-metrics-certs podName:7377e78e-3c71-4fcb-918c-eb6c54e2d562 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:12.269135442 +0000 UTC m=+34.113432904 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7377e78e-3c71-4fcb-918c-eb6c54e2d562-metrics-certs") pod "network-metrics-daemon-64nqz" (UID: "7377e78e-3c71-4fcb-918c-eb6c54e2d562") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:56.370096 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:56.370066 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6skr\" (UniqueName: \"kubernetes.io/projected/e7e55e83-cfda-4e11-8182-e93e305e78bb-kube-api-access-t6skr\") pod \"network-check-target-rwvpj\" (UID: \"e7e55e83-cfda-4e11-8182-e93e305e78bb\") " pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:46:56.370276 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:56.370247 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:46:56.370276 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:56.370268 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:46:56.370392 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:56.370281 2584 projected.go:196] Error preparing data for projected volume kube-api-access-t6skr for pod openshift-network-diagnostics/network-check-target-rwvpj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:56.370392 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:56.370335 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7e55e83-cfda-4e11-8182-e93e305e78bb-kube-api-access-t6skr podName:e7e55e83-cfda-4e11-8182-e93e305e78bb nodeName:}" failed. No retries permitted until 2026-07-29 15:47:12.370318924 +0000 UTC m=+34.214616384 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-t6skr" (UniqueName: "kubernetes.io/projected/e7e55e83-cfda-4e11-8182-e93e305e78bb-kube-api-access-t6skr") pod "network-check-target-rwvpj" (UID: "e7e55e83-cfda-4e11-8182-e93e305e78bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:56.722126 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:56.722030 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:46:56.722126 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:56.722063 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:46:56.722126 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:56.722030 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:46:56.722389 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:56.722171 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwvpj" podUID="e7e55e83-cfda-4e11-8182-e93e305e78bb" Jul 29 15:46:56.722389 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:56.722252 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64nqz" podUID="7377e78e-3c71-4fcb-918c-eb6c54e2d562" Jul 29 15:46:56.722641 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:56.722614 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5gvg" podUID="77adaab3-405e-43d8-8dec-badf07ce38f2" Jul 29 15:46:58.722154 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:58.722087 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:46:58.722568 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:58.722219 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5gvg" podUID="77adaab3-405e-43d8-8dec-badf07ce38f2" Jul 29 15:46:58.722568 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:58.722233 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:46:58.722568 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:46:58.722307 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:46:58.722568 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:58.722407 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwvpj" podUID="e7e55e83-cfda-4e11-8182-e93e305e78bb" Jul 29 15:46:58.722568 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:46:58.722541 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64nqz" podUID="7377e78e-3c71-4fcb-918c-eb6c54e2d562" Jul 29 15:47:00.722108 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:00.721833 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:47:00.722652 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:00.721833 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:47:00.722652 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:00.721905 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:47:00.722652 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:00.722283 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5gvg" podUID="77adaab3-405e-43d8-8dec-badf07ce38f2" Jul 29 15:47:00.722652 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:00.722179 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwvpj" podUID="e7e55e83-cfda-4e11-8182-e93e305e78bb" Jul 29 15:47:00.722652 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:00.722315 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64nqz" podUID="7377e78e-3c71-4fcb-918c-eb6c54e2d562" Jul 29 15:47:00.810993 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:00.810965 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fsfwz" event={"ID":"619ab912-9655-4f72-a490-3ff971625501","Type":"ContainerStarted","Data":"cd0a9fa99bfa60eff6cc06af6db0795a4eb5af9f53bb64d10126db1f5a264cb8"} Jul 29 15:47:00.812422 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:00.812394 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-254br" event={"ID":"f9640ca5-c93f-49dc-9216-d3ea149abb4f","Type":"ContainerStarted","Data":"1c272735a04caf327d1a8c5af32ae1c05f5f0ac5625a71e2bba547470371b7bb"} Jul 29 15:47:00.813773 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:00.813753 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-48lc4" event={"ID":"7192759b-4ce8-4271-a907-7d4c227599b1","Type":"ContainerStarted","Data":"de63d11a836cadcb0914f62636e24e70b43da253d7da59d7eeeba41bfa9dd0fc"} Jul 29 15:47:00.815111 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:00.815085 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7w9zd" event={"ID":"4f782ba3-b2ac-46c7-ad06-db9aa6721614","Type":"ContainerStarted","Data":"3ba8de9838e0e27d1a9d3894caf65bc4a58cfc76787d71c411cb153f9c1ebab8"} Jul 29 15:47:00.816471 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:00.816427 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wtfzb" event={"ID":"4c187f2d-0062-43b4-a61d-b92a4a85793c","Type":"ContainerStarted","Data":"3e6cc0e4042c9af422da84803c3cc6afad4ee37c262f917e14e1af7f46d37d3c"} Jul 29 15:47:00.817687 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:00.817668 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" event={"ID":"0008c431-6fb6-4973-a20c-c3f28caa264c","Type":"ContainerStarted","Data":"762e30b2c8daa5c8646fe86199b13334c70b01d1716a341f7a3f0093a952eb2a"} Jul 29 15:47:00.819099 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:00.819077 2584 generic.go:356] "Generic (PLEG): container finished" podID="7e8b3213-5f73-40dc-8357-d1ae21efd3d9" containerID="b6edd76a35b6d902ae15d2d45071bd99bfa97090f60101a20c7225b460bfc05f" exitCode=0 Jul 29 15:47:00.819209 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:00.819165 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6nm7c" event={"ID":"7e8b3213-5f73-40dc-8357-d1ae21efd3d9","Type":"ContainerDied","Data":"b6edd76a35b6d902ae15d2d45071bd99bfa97090f60101a20c7225b460bfc05f"} Jul 29 15:47:00.822144 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:00.822125 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" event={"ID":"dd61573c-d06b-46e4-afea-887f283a1e1a","Type":"ContainerStarted","Data":"3c83f5e79913e1b84ac040af7768c388ef234fbc101f093d1719ce965073342e"} Jul 29 15:47:00.822248 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:00.822203 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" event={"ID":"dd61573c-d06b-46e4-afea-887f283a1e1a","Type":"ContainerStarted","Data":"71be5fb2122909b7be970d2728ff0f52435a121dd23a230d9fd406ebef2d01b8"} Jul 29 15:47:00.822248 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:00.822234 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" event={"ID":"dd61573c-d06b-46e4-afea-887f283a1e1a","Type":"ContainerStarted","Data":"26140ace11c3d14333bf43319d32c4f5738555c6ebab1cf6edbb36508996851e"} Jul 29 15:47:00.822407 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:00.822262 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" event={"ID":"dd61573c-d06b-46e4-afea-887f283a1e1a","Type":"ContainerStarted","Data":"444ad4d35c05b25e76f0e8b55255518864e5797409b10374094f2365ea6f0536"} Jul 29 15:47:00.822407 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:00.822291 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" event={"ID":"dd61573c-d06b-46e4-afea-887f283a1e1a","Type":"ContainerStarted","Data":"fb6ae69f64e68e5e6b88fca1411fd14369d4afb7aa6b8e940d80b0cffa2eb53a"} Jul 29 15:47:00.822407 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:00.822316 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" event={"ID":"dd61573c-d06b-46e4-afea-887f283a1e1a","Type":"ContainerStarted","Data":"43409443fa14f3f46133d0393c1e9f620d0b2d9125f18f1c9b8ca1ae99b2a70b"} Jul 29 15:47:00.828293 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:00.828258 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-254br" podStartSLOduration=3.421537542 podStartE2EDuration="21.828230621s" totalImagesPullingTime="18.406693079s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:46:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:00.828026646 +0000 UTC m=+22.672324115" watchObservedRunningTime="2026-07-29 15:47:00.828230621 +0000 UTC m=+22.672528081" Jul 29 15:47:00.828398 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:00.828379 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-213.ec2.internal" podStartSLOduration=20.828372897 podStartE2EDuration="20.828372897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:46:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:46:43.794209277 +0000 UTC m=+5.638506757" watchObservedRunningTime="2026-07-29 15:47:00.828372897 +0000 UTC m=+22.672670375" Jul 29 15:47:00.843366 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:00.843300 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7w9zd" podStartSLOduration=3.443605276 podStartE2EDuration="21.843287594s" totalImagesPullingTime="18.399682318s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:46:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:00.843206734 +0000 UTC m=+22.687504214" watchObservedRunningTime="2026-07-29 15:47:00.843287594 +0000 UTC m=+22.687585073" Jul 29 15:47:00.860678 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:00.860642 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qqxjg" podStartSLOduration=3.459349456 podStartE2EDuration="21.860629741s" totalImagesPullingTime="18.401280285s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:46:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:00.860282389 +0000 UTC m=+22.704579869" watchObservedRunningTime="2026-07-29 15:47:00.860629741 +0000 UTC m=+22.704927220" Jul 29 15:47:00.896633 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:00.896603 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wtfzb" podStartSLOduration=7.627956244 podStartE2EDuration="21.896592373s" totalImagesPullingTime="14.268636129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:46:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:00.89642666 +0000 UTC m=+22.740724140" watchObservedRunningTime="2026-07-29 15:47:00.896592373 +0000 UTC m=+22.740889877" Jul 29 15:47:00.915168 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:00.915133 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-48lc4" podStartSLOduration=3.449350873 podStartE2EDuration="21.915123265s" totalImagesPullingTime="18.465772392s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:46:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:00.91507868 +0000 UTC m=+22.759376158" watchObservedRunningTime="2026-07-29 15:47:00.915123265 +0000 UTC m=+22.759420767" Jul 29 15:47:01.804046 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:01.804019 2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 29 15:47:01.826175 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:01.826140 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wx6jd" event={"ID":"ea5db5cf-d8ce-4fac-b6e7-13e03e05f535","Type":"ContainerStarted","Data":"f12c8da6a820be65fa6dae64b1be13a4c316e94e2f97e55258493ace3af06c04"} Jul 29 15:47:01.828498 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:01.828464 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fsfwz" event={"ID":"619ab912-9655-4f72-a490-3ff971625501","Type":"ContainerStarted","Data":"43b5275bbdb879cd553b8efe97e25c7facc5387692a234a80d3db07db6b51008"} Jul 29 15:47:02.591503 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:02.591359 2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T15:47:01.804042809Z","UUID":"6811140d-b30e-443c-b87b-284f44f7ec79","Handler":null,"Name":"","Endpoint":""} Jul 29 15:47:02.592874 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:02.592855 2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 29 15:47:02.593006 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:02.592895 2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 29 15:47:02.722127 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:02.722093 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:47:02.722289 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:02.722223 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwvpj" podUID="e7e55e83-cfda-4e11-8182-e93e305e78bb" Jul 29 15:47:02.722289 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:02.722241 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:47:02.722289 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:02.722266 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:47:02.722394 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:02.722348 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5gvg" podUID="77adaab3-405e-43d8-8dec-badf07ce38f2" Jul 29 15:47:02.722487 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:02.722460 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64nqz" podUID="7377e78e-3c71-4fcb-918c-eb6c54e2d562" Jul 29 15:47:03.050553 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:03.050525 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wtfzb" Jul 29 15:47:03.051363 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:03.051340 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wtfzb" Jul 29 15:47:03.068056 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:03.068009 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wx6jd" podStartSLOduration=5.661250883 podStartE2EDuration="24.067988843s" totalImagesPullingTime="18.40673796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:46:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:01.841810815 +0000 UTC m=+23.686108296" watchObservedRunningTime="2026-07-29 15:47:03.067988843 +0000 UTC m=+24.912286323" Jul 29 15:47:03.837177 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:03.836968 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" event={"ID":"dd61573c-d06b-46e4-afea-887f283a1e1a","Type":"ContainerStarted","Data":"4a84923e2f1920d63aa582e0fbdf86f650fc5ad17bcac38bdbbcf7094af29ee2"} Jul 29 15:47:03.839454 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:03.839411 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fsfwz" event={"ID":"619ab912-9655-4f72-a490-3ff971625501","Type":"ContainerStarted","Data":"4a6fe4bdbee6d88190bf5cfb2cf81917e5d5b82f606b8923b2909675cf1e82b1"} Jul 29 15:47:03.839743 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:03.839726 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wtfzb" Jul 29 15:47:03.840239 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:03.840218 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wtfzb" Jul 29 15:47:03.876802 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:03.876761 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fsfwz" podStartSLOduration=3.701775871 podStartE2EDuration="24.876747624s" totalImagesPullingTime="21.174971753s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:46:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:03.861288904 +0000 UTC m=+25.705586384" watchObservedRunningTime="2026-07-29 15:47:03.876747624 +0000 UTC m=+25.721045103" Jul 29 15:47:04.722065 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:04.722026 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:47:04.722659 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:04.722024 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:47:04.722659 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:04.722182 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:47:04.722659 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:04.722183 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64nqz" podUID="7377e78e-3c71-4fcb-918c-eb6c54e2d562" Jul 29 15:47:04.722659 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:04.722308 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5gvg" podUID="77adaab3-405e-43d8-8dec-badf07ce38f2" Jul 29 15:47:04.722659 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:04.722372 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwvpj" podUID="e7e55e83-cfda-4e11-8182-e93e305e78bb" Jul 29 15:47:05.844942 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:05.844756 2584 generic.go:356] "Generic (PLEG): container finished" podID="7e8b3213-5f73-40dc-8357-d1ae21efd3d9" containerID="7fd7cbc1aa841420ae1bb29de2832edd7f26b37b54eab918ebb50bcfd8764e69" exitCode=0 Jul 29 15:47:05.845688 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:05.844846 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6nm7c" event={"ID":"7e8b3213-5f73-40dc-8357-d1ae21efd3d9","Type":"ContainerDied","Data":"7fd7cbc1aa841420ae1bb29de2832edd7f26b37b54eab918ebb50bcfd8764e69"} Jul 29 15:47:05.848699 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:05.848675 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" event={"ID":"dd61573c-d06b-46e4-afea-887f283a1e1a","Type":"ContainerStarted","Data":"dfde5c458e7580c756e72549e47cddac60e2d6073a5567f5deae701e07cdd602"} Jul 29 15:47:05.900920 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:05.900873 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" podStartSLOduration=8.418706905 podStartE2EDuration="26.900860313s" totalImagesPullingTime="18.482153408s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:46:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:05.899045839 +0000 UTC m=+27.743343318" watchObservedRunningTime="2026-07-29 15:47:05.900860313 +0000 UTC m=+27.745157792" Jul 29 15:47:06.721770 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:06.721697 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:47:06.722015 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:06.721697 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:47:06.722015 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:06.721805 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5gvg" podUID="77adaab3-405e-43d8-8dec-badf07ce38f2" Jul 29 15:47:06.722015 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:06.721814 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:47:06.722015 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:06.721908 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwvpj" podUID="e7e55e83-cfda-4e11-8182-e93e305e78bb" Jul 29 15:47:06.722015 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:06.721980 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64nqz" podUID="7377e78e-3c71-4fcb-918c-eb6c54e2d562" Jul 29 15:47:06.851456 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:06.851407 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:47:06.851889 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:06.851503 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:47:06.851889 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:06.851545 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:47:06.866188 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:06.866166 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:47:06.866307 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:06.866267 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:47:07.317730 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:07.317658 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f5gvg"] Jul 29 15:47:07.317864 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:07.317783 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:47:07.317927 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:07.317905 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5gvg" podUID="77adaab3-405e-43d8-8dec-badf07ce38f2" Jul 29 15:47:07.321003 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:07.320978 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rwvpj"] Jul 29 15:47:07.321156 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:07.321052 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:47:07.321156 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:07.321123 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwvpj" podUID="e7e55e83-cfda-4e11-8182-e93e305e78bb" Jul 29 15:47:07.321751 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:07.321728 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-64nqz"] Jul 29 15:47:07.321835 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:07.321822 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:47:07.321952 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:07.321931 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64nqz" podUID="7377e78e-3c71-4fcb-918c-eb6c54e2d562" Jul 29 15:47:07.854897 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:07.854869 2584 generic.go:356] "Generic (PLEG): container finished" podID="7e8b3213-5f73-40dc-8357-d1ae21efd3d9" containerID="6a1ca1c03536a73c25b4fc17f7df53efab64ad76812b498bdad7f1bddff42e0c" exitCode=0 Jul 29 15:47:07.855343 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:07.854957 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6nm7c" event={"ID":"7e8b3213-5f73-40dc-8357-d1ae21efd3d9","Type":"ContainerDied","Data":"6a1ca1c03536a73c25b4fc17f7df53efab64ad76812b498bdad7f1bddff42e0c"} Jul 29 15:47:08.724150 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:08.724119 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:47:08.724306 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:08.724221 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwvpj" podUID="e7e55e83-cfda-4e11-8182-e93e305e78bb" Jul 29 15:47:08.724306 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:08.724272 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:47:08.724388 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:08.724367 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64nqz" podUID="7377e78e-3c71-4fcb-918c-eb6c54e2d562" Jul 29 15:47:09.722309 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:09.722106 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:47:09.722683 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:09.722336 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5gvg" podUID="77adaab3-405e-43d8-8dec-badf07ce38f2" Jul 29 15:47:09.862473 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:09.862431 2584 generic.go:356] "Generic (PLEG): container finished" podID="7e8b3213-5f73-40dc-8357-d1ae21efd3d9" containerID="eb1b40bceb0579d29f4507c328b2b1b16211d0842e93bed1f33c6e83cf02486a" exitCode=0 Jul 29 15:47:09.862473 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:09.862468 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6nm7c" event={"ID":"7e8b3213-5f73-40dc-8357-d1ae21efd3d9","Type":"ContainerDied","Data":"eb1b40bceb0579d29f4507c328b2b1b16211d0842e93bed1f33c6e83cf02486a"} Jul 29 15:47:10.725294 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:10.725265 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:47:10.725710 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:10.725385 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64nqz" podUID="7377e78e-3c71-4fcb-918c-eb6c54e2d562" Jul 29 15:47:10.725710 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:10.725456 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:47:10.725710 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:10.725564 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwvpj" podUID="e7e55e83-cfda-4e11-8182-e93e305e78bb" Jul 29 15:47:11.721806 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:11.721726 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:47:11.721945 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:11.721841 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5gvg" podUID="77adaab3-405e-43d8-8dec-badf07ce38f2" Jul 29 15:47:12.294836 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:12.294798 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7377e78e-3c71-4fcb-918c-eb6c54e2d562-metrics-certs\") pod \"network-metrics-daemon-64nqz\" (UID: \"7377e78e-3c71-4fcb-918c-eb6c54e2d562\") " pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:47:12.295345 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:12.294845 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77adaab3-405e-43d8-8dec-badf07ce38f2-original-pull-secret\") pod \"global-pull-secret-syncer-f5gvg\" (UID: \"77adaab3-405e-43d8-8dec-badf07ce38f2\") " pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:47:12.295345 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:12.294951 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:47:12.295345 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:12.295024 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7377e78e-3c71-4fcb-918c-eb6c54e2d562-metrics-certs podName:7377e78e-3c71-4fcb-918c-eb6c54e2d562 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:44.295004137 +0000 UTC m=+66.139301599 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7377e78e-3c71-4fcb-918c-eb6c54e2d562-metrics-certs") pod "network-metrics-daemon-64nqz" (UID: "7377e78e-3c71-4fcb-918c-eb6c54e2d562") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:47:12.295345 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:12.294957 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:47:12.295345 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:12.295089 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77adaab3-405e-43d8-8dec-badf07ce38f2-original-pull-secret podName:77adaab3-405e-43d8-8dec-badf07ce38f2 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:44.295075357 +0000 UTC m=+66.139372814 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/77adaab3-405e-43d8-8dec-badf07ce38f2-original-pull-secret") pod "global-pull-secret-syncer-f5gvg" (UID: "77adaab3-405e-43d8-8dec-badf07ce38f2") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:47:12.395173 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:12.395133 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6skr\" (UniqueName: \"kubernetes.io/projected/e7e55e83-cfda-4e11-8182-e93e305e78bb-kube-api-access-t6skr\") pod \"network-check-target-rwvpj\" (UID: \"e7e55e83-cfda-4e11-8182-e93e305e78bb\") " pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:47:12.395346 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:12.395301 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:47:12.395346 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:12.395320 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:47:12.395346 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:12.395333 2584 projected.go:196] Error preparing data for projected volume kube-api-access-t6skr for pod openshift-network-diagnostics/network-check-target-rwvpj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:47:12.395515 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:12.395388 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7e55e83-cfda-4e11-8182-e93e305e78bb-kube-api-access-t6skr podName:e7e55e83-cfda-4e11-8182-e93e305e78bb nodeName:}" failed. No retries permitted until 2026-07-29 15:47:44.395372631 +0000 UTC m=+66.239670103 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-t6skr" (UniqueName: "kubernetes.io/projected/e7e55e83-cfda-4e11-8182-e93e305e78bb-kube-api-access-t6skr") pod "network-check-target-rwvpj" (UID: "e7e55e83-cfda-4e11-8182-e93e305e78bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:47:12.725745 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:12.725715 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:47:12.725745 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:12.725738 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:47:12.725961 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:12.725841 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwvpj" podUID="e7e55e83-cfda-4e11-8182-e93e305e78bb" Jul 29 15:47:12.726010 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:12.725970 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64nqz" podUID="7377e78e-3c71-4fcb-918c-eb6c54e2d562" Jul 29 15:47:12.944365 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:12.944286 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-213.ec2.internal" event="NodeReady" Jul 29 15:47:12.944542 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:12.944452 2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 29 15:47:12.983520 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:12.983494 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76667dd646-gw5z4"] Jul 29 15:47:12.986548 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:12.986517 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:12.991131 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:12.991105 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 29 15:47:12.991241 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:12.991134 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 29 15:47:12.991550 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:12.991530 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 29 15:47:12.991550 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:12.991546 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-p9xsx\"" Jul 29 15:47:12.997077 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:12.997057 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 29 15:47:13.003286 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.003256 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6b4dc"] Jul 29 15:47:13.005121 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.005105 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76667dd646-gw5z4"] Jul 29 15:47:13.005202 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.005133 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r22bj"] Jul 29 15:47:13.005301 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.005232 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6b4dc" Jul 29 15:47:13.006905 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.006868 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r22bj" Jul 29 15:47:13.008398 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.008378 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l689t\"" Jul 29 15:47:13.008518 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.008381 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 29 15:47:13.008671 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.008656 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 29 15:47:13.009376 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.009356 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 29 15:47:13.009833 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.009815 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-796d6\"" Jul 29 15:47:13.010091 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.010075 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 29 15:47:13.010158 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.010099 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 29 15:47:13.018883 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.018854 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6b4dc"] Jul 29 15:47:13.032414 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.032392 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r22bj"] Jul 29 15:47:13.100142 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.100106 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/66ca9e27-70cd-4be5-ab36-0ea5a7027c56-cert\") pod \"ingress-canary-r22bj\" (UID: \"66ca9e27-70cd-4be5-ab36-0ea5a7027c56\") " pod="openshift-ingress-canary/ingress-canary-r22bj" Jul 29 15:47:13.100317 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.100153 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/24d9aedf-e77f-4e07-9495-cea45eb83a5c-installation-pull-secrets\") pod \"image-registry-76667dd646-gw5z4\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:13.100317 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.100225 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d-config-volume\") pod \"dns-default-6b4dc\" (UID: \"bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d\") " pod="openshift-dns/dns-default-6b4dc" Jul 29 15:47:13.100317 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.100278 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f5t8\" (UniqueName: \"kubernetes.io/projected/66ca9e27-70cd-4be5-ab36-0ea5a7027c56-kube-api-access-7f5t8\") pod \"ingress-canary-r22bj\" (UID: \"66ca9e27-70cd-4be5-ab36-0ea5a7027c56\") " pod="openshift-ingress-canary/ingress-canary-r22bj" Jul 29 15:47:13.100523 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.100315 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/24d9aedf-e77f-4e07-9495-cea45eb83a5c-image-registry-private-configuration\") pod \"image-registry-76667dd646-gw5z4\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:13.100523 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.100341 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/24d9aedf-e77f-4e07-9495-cea45eb83a5c-ca-trust-extracted\") pod \"image-registry-76667dd646-gw5z4\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:13.100523 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.100367 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/24d9aedf-e77f-4e07-9495-cea45eb83a5c-registry-certificates\") pod \"image-registry-76667dd646-gw5z4\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:13.100523 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.100391 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-bound-sa-token\") pod \"image-registry-76667dd646-gw5z4\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:13.100523 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.100486 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d-metrics-tls\") pod \"dns-default-6b4dc\" (UID: \"bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d\") " pod="openshift-dns/dns-default-6b4dc" Jul 29 15:47:13.100743 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.100535 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-registry-tls\") pod \"image-registry-76667dd646-gw5z4\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:13.100743 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.100569 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24d9aedf-e77f-4e07-9495-cea45eb83a5c-trusted-ca\") pod \"image-registry-76667dd646-gw5z4\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:13.100743 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.100584 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mstww\" (UniqueName: \"kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-kube-api-access-mstww\") pod \"image-registry-76667dd646-gw5z4\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:13.100743 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.100602 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d-tmp-dir\") pod \"dns-default-6b4dc\" (UID: \"bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d\") " pod="openshift-dns/dns-default-6b4dc" Jul 29 15:47:13.100743 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.100657 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msgwx\" (UniqueName: \"kubernetes.io/projected/bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d-kube-api-access-msgwx\") pod \"dns-default-6b4dc\" (UID: \"bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d\") " pod="openshift-dns/dns-default-6b4dc" Jul 29 15:47:13.201998 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.201911 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/24d9aedf-e77f-4e07-9495-cea45eb83a5c-image-registry-private-configuration\") pod \"image-registry-76667dd646-gw5z4\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:13.201998 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.201952 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/24d9aedf-e77f-4e07-9495-cea45eb83a5c-ca-trust-extracted\") pod \"image-registry-76667dd646-gw5z4\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:13.201998 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.201977 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/24d9aedf-e77f-4e07-9495-cea45eb83a5c-registry-certificates\") pod \"image-registry-76667dd646-gw5z4\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:13.202253 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.202004 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-bound-sa-token\") pod \"image-registry-76667dd646-gw5z4\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:13.202253 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.202055 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d-metrics-tls\") pod \"dns-default-6b4dc\" (UID: \"bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d\") " pod="openshift-dns/dns-default-6b4dc" Jul 29 15:47:13.202253 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.202096 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-registry-tls\") pod \"image-registry-76667dd646-gw5z4\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:13.202253 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.202131 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24d9aedf-e77f-4e07-9495-cea45eb83a5c-trusted-ca\") pod \"image-registry-76667dd646-gw5z4\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:13.202253 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.202153 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mstww\" (UniqueName: \"kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-kube-api-access-mstww\") pod \"image-registry-76667dd646-gw5z4\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:13.202253 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.202172 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d-tmp-dir\") pod \"dns-default-6b4dc\" (UID: \"bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d\") " pod="openshift-dns/dns-default-6b4dc" Jul 29 15:47:13.202253 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.202204 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msgwx\" (UniqueName: \"kubernetes.io/projected/bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d-kube-api-access-msgwx\") pod \"dns-default-6b4dc\" (UID: \"bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d\") " pod="openshift-dns/dns-default-6b4dc" Jul 29 15:47:13.202253 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.202230 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/66ca9e27-70cd-4be5-ab36-0ea5a7027c56-cert\") pod \"ingress-canary-r22bj\" (UID: \"66ca9e27-70cd-4be5-ab36-0ea5a7027c56\") " pod="openshift-ingress-canary/ingress-canary-r22bj" Jul 29 15:47:13.202253 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:13.202231 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:47:13.202664 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.202267 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/24d9aedf-e77f-4e07-9495-cea45eb83a5c-installation-pull-secrets\") pod \"image-registry-76667dd646-gw5z4\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:13.202664 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.202291 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d-config-volume\") pod \"dns-default-6b4dc\" (UID: \"bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d\") " pod="openshift-dns/dns-default-6b4dc" Jul 29 15:47:13.202664 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:13.202319 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d-metrics-tls podName:bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d nodeName:}" failed. No retries permitted until 2026-07-29 15:47:13.702295732 +0000 UTC m=+35.546593194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d-metrics-tls") pod "dns-default-6b4dc" (UID: "bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d") : secret "dns-default-metrics-tls" not found Jul 29 15:47:13.202664 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.202375 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f5t8\" (UniqueName: \"kubernetes.io/projected/66ca9e27-70cd-4be5-ab36-0ea5a7027c56-kube-api-access-7f5t8\") pod \"ingress-canary-r22bj\" (UID: \"66ca9e27-70cd-4be5-ab36-0ea5a7027c56\") " pod="openshift-ingress-canary/ingress-canary-r22bj" Jul 29 15:47:13.202664 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.202409 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/24d9aedf-e77f-4e07-9495-cea45eb83a5c-ca-trust-extracted\") pod \"image-registry-76667dd646-gw5z4\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:13.202929 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.202673 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/24d9aedf-e77f-4e07-9495-cea45eb83a5c-registry-certificates\") pod \"image-registry-76667dd646-gw5z4\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:13.202929 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.202770 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d-tmp-dir\") pod \"dns-default-6b4dc\" (UID: \"bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d\") " pod="openshift-dns/dns-default-6b4dc" Jul 29 15:47:13.202929 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.202851 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d-config-volume\") pod \"dns-default-6b4dc\" (UID: \"bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d\") " pod="openshift-dns/dns-default-6b4dc" Jul 29 15:47:13.202929 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:13.202865 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 15:47:13.202929 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:13.202880 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76667dd646-gw5z4: secret "image-registry-tls" not found Jul 29 15:47:13.203147 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:13.202948 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-registry-tls podName:24d9aedf-e77f-4e07-9495-cea45eb83a5c nodeName:}" failed. No retries permitted until 2026-07-29 15:47:13.702930702 +0000 UTC m=+35.547228184 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-registry-tls") pod "image-registry-76667dd646-gw5z4" (UID: "24d9aedf-e77f-4e07-9495-cea45eb83a5c") : secret "image-registry-tls" not found Jul 29 15:47:13.203668 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.203616 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24d9aedf-e77f-4e07-9495-cea45eb83a5c-trusted-ca\") pod \"image-registry-76667dd646-gw5z4\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:13.206904 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.206878 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/24d9aedf-e77f-4e07-9495-cea45eb83a5c-image-registry-private-configuration\") pod \"image-registry-76667dd646-gw5z4\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:13.207008 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.206880 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/24d9aedf-e77f-4e07-9495-cea45eb83a5c-installation-pull-secrets\") pod \"image-registry-76667dd646-gw5z4\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:13.207008 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.206940 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/66ca9e27-70cd-4be5-ab36-0ea5a7027c56-cert\") pod \"ingress-canary-r22bj\" (UID: \"66ca9e27-70cd-4be5-ab36-0ea5a7027c56\") " pod="openshift-ingress-canary/ingress-canary-r22bj" Jul 29 15:47:13.211914 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.211890 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msgwx\" (UniqueName: \"kubernetes.io/projected/bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d-kube-api-access-msgwx\") pod \"dns-default-6b4dc\" (UID: \"bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d\") " pod="openshift-dns/dns-default-6b4dc" Jul 29 15:47:13.212541 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.212522 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f5t8\" (UniqueName: \"kubernetes.io/projected/66ca9e27-70cd-4be5-ab36-0ea5a7027c56-kube-api-access-7f5t8\") pod \"ingress-canary-r22bj\" (UID: \"66ca9e27-70cd-4be5-ab36-0ea5a7027c56\") " pod="openshift-ingress-canary/ingress-canary-r22bj" Jul 29 15:47:13.212649 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.212572 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mstww\" (UniqueName: \"kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-kube-api-access-mstww\") pod \"image-registry-76667dd646-gw5z4\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:13.212739 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.212623 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-bound-sa-token\") pod \"image-registry-76667dd646-gw5z4\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:13.324973 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.324934 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r22bj" Jul 29 15:47:13.706019 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.705988 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d-metrics-tls\") pod \"dns-default-6b4dc\" (UID: \"bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d\") " pod="openshift-dns/dns-default-6b4dc" Jul 29 15:47:13.706177 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.706040 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-registry-tls\") pod \"image-registry-76667dd646-gw5z4\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:13.706177 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:13.706138 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:47:13.706256 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:13.706185 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 15:47:13.706256 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:13.706198 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76667dd646-gw5z4: secret "image-registry-tls" not found Jul 29 15:47:13.706256 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:13.706204 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d-metrics-tls podName:bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d nodeName:}" failed. No retries permitted until 2026-07-29 15:47:14.706185508 +0000 UTC m=+36.550482984 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d-metrics-tls") pod "dns-default-6b4dc" (UID: "bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d") : secret "dns-default-metrics-tls" not found Jul 29 15:47:13.706256 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:13.706248 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-registry-tls podName:24d9aedf-e77f-4e07-9495-cea45eb83a5c nodeName:}" failed. No retries permitted until 2026-07-29 15:47:14.70623164 +0000 UTC m=+36.550529104 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-registry-tls") pod "image-registry-76667dd646-gw5z4" (UID: "24d9aedf-e77f-4e07-9495-cea45eb83a5c") : secret "image-registry-tls" not found Jul 29 15:47:13.721325 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.721303 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:47:13.724516 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.724495 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 15:47:13.909843 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:13.909679 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r22bj"] Jul 29 15:47:13.913015 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:47:13.912992 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66ca9e27_70cd_4be5_ab36_0ea5a7027c56.slice/crio-3afcbdc317a0f7bf410b000224ad262e965054e4d0d5deb2ccaed10c11a160c8 WatchSource:0}: Error finding container 3afcbdc317a0f7bf410b000224ad262e965054e4d0d5deb2ccaed10c11a160c8: Status 404 returned error can't find the container with id 3afcbdc317a0f7bf410b000224ad262e965054e4d0d5deb2ccaed10c11a160c8 Jul 29 15:47:14.711938 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:14.711913 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d-metrics-tls\") pod \"dns-default-6b4dc\" (UID: \"bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d\") " pod="openshift-dns/dns-default-6b4dc" Jul 29 15:47:14.712509 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:14.711953 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-registry-tls\") pod \"image-registry-76667dd646-gw5z4\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:14.712509 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:14.712093 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:47:14.712509 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:14.712129 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 15:47:14.712509 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:14.712146 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76667dd646-gw5z4: secret "image-registry-tls" not found Jul 29 15:47:14.712509 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:14.712172 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d-metrics-tls podName:bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d nodeName:}" failed. No retries permitted until 2026-07-29 15:47:16.712149682 +0000 UTC m=+38.556447141 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d-metrics-tls") pod "dns-default-6b4dc" (UID: "bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d") : secret "dns-default-metrics-tls" not found Jul 29 15:47:14.712509 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:14.712192 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-registry-tls podName:24d9aedf-e77f-4e07-9495-cea45eb83a5c nodeName:}" failed. No retries permitted until 2026-07-29 15:47:16.712182938 +0000 UTC m=+38.556480394 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-registry-tls") pod "image-registry-76667dd646-gw5z4" (UID: "24d9aedf-e77f-4e07-9495-cea45eb83a5c") : secret "image-registry-tls" not found Jul 29 15:47:14.725714 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:14.725695 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:47:14.725905 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:14.725887 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:47:14.730147 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:14.730130 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 15:47:14.731385 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:14.731366 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mdhwr\"" Jul 29 15:47:14.731517 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:14.731366 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 15:47:14.731702 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:14.731666 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 15:47:14.734379 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:14.734356 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9brzs\"" Jul 29 15:47:14.875615 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:14.875580 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r22bj" event={"ID":"66ca9e27-70cd-4be5-ab36-0ea5a7027c56","Type":"ContainerStarted","Data":"3afcbdc317a0f7bf410b000224ad262e965054e4d0d5deb2ccaed10c11a160c8"} Jul 29 15:47:14.878557 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:14.878530 2584 generic.go:356] "Generic (PLEG): container finished" podID="7e8b3213-5f73-40dc-8357-d1ae21efd3d9" containerID="db7a6abc5420e30f57fb89696f118a05fb7a41eebe79dc9f972248c31d3df71b" exitCode=0 Jul 29 15:47:14.878673 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:14.878579 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6nm7c" event={"ID":"7e8b3213-5f73-40dc-8357-d1ae21efd3d9","Type":"ContainerDied","Data":"db7a6abc5420e30f57fb89696f118a05fb7a41eebe79dc9f972248c31d3df71b"} Jul 29 15:47:15.884768 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:15.884735 2584 generic.go:356] "Generic (PLEG): container finished" podID="7e8b3213-5f73-40dc-8357-d1ae21efd3d9" containerID="299c98acd230808bf56cc5ba51ff669f7526f6ec9053cd71d142c0d447863c16" exitCode=0 Jul 29 15:47:15.885163 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:15.884811 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6nm7c" event={"ID":"7e8b3213-5f73-40dc-8357-d1ae21efd3d9","Type":"ContainerDied","Data":"299c98acd230808bf56cc5ba51ff669f7526f6ec9053cd71d142c0d447863c16"} Jul 29 15:47:16.118054 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:16.117982 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6tnpm"] Jul 29 15:47:16.124981 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:16.124959 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6tnpm" Jul 29 15:47:16.128817 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:16.128794 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 29 15:47:16.129715 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:16.129688 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 29 15:47:16.129820 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:16.129688 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d2ddt\"" Jul 29 15:47:16.129820 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:16.129695 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 29 15:47:16.130683 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:16.130660 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 29 15:47:16.135059 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:16.135003 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6tnpm"] Jul 29 15:47:16.224616 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:16.224588 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-data-volume\") pod \"insights-runtime-extractor-6tnpm\" (UID: \"47b0d5da-0f97-4139-a01a-cd41ed81f6f0\") " pod="openshift-insights/insights-runtime-extractor-6tnpm" Jul 29 15:47:16.224788 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:16.224620 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-crio-socket\") pod \"insights-runtime-extractor-6tnpm\" (UID: \"47b0d5da-0f97-4139-a01a-cd41ed81f6f0\") " pod="openshift-insights/insights-runtime-extractor-6tnpm" Jul 29 15:47:16.224788 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:16.224642 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbvlx\" (UniqueName: \"kubernetes.io/projected/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-kube-api-access-cbvlx\") pod \"insights-runtime-extractor-6tnpm\" (UID: \"47b0d5da-0f97-4139-a01a-cd41ed81f6f0\") " pod="openshift-insights/insights-runtime-extractor-6tnpm" Jul 29 15:47:16.224788 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:16.224676 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6tnpm\" (UID: \"47b0d5da-0f97-4139-a01a-cd41ed81f6f0\") " pod="openshift-insights/insights-runtime-extractor-6tnpm" Jul 29 15:47:16.224788 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:16.224759 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6tnpm\" (UID: \"47b0d5da-0f97-4139-a01a-cd41ed81f6f0\") " pod="openshift-insights/insights-runtime-extractor-6tnpm" Jul 29 15:47:16.326054 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:16.326028 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-data-volume\") pod \"insights-runtime-extractor-6tnpm\" (UID: \"47b0d5da-0f97-4139-a01a-cd41ed81f6f0\") " pod="openshift-insights/insights-runtime-extractor-6tnpm" Jul 29 15:47:16.326176 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:16.326061 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-crio-socket\") pod \"insights-runtime-extractor-6tnpm\" (UID: \"47b0d5da-0f97-4139-a01a-cd41ed81f6f0\") " pod="openshift-insights/insights-runtime-extractor-6tnpm" Jul 29 15:47:16.326176 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:16.326083 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbvlx\" (UniqueName: \"kubernetes.io/projected/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-kube-api-access-cbvlx\") pod \"insights-runtime-extractor-6tnpm\" (UID: \"47b0d5da-0f97-4139-a01a-cd41ed81f6f0\") " pod="openshift-insights/insights-runtime-extractor-6tnpm" Jul 29 15:47:16.326176 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:16.326137 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6tnpm\" (UID: \"47b0d5da-0f97-4139-a01a-cd41ed81f6f0\") " pod="openshift-insights/insights-runtime-extractor-6tnpm" Jul 29 15:47:16.326176 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:16.326168 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6tnpm\" (UID: \"47b0d5da-0f97-4139-a01a-cd41ed81f6f0\") " pod="openshift-insights/insights-runtime-extractor-6tnpm" Jul 29 15:47:16.326370 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:16.326256 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-crio-socket\") pod \"insights-runtime-extractor-6tnpm\" (UID: \"47b0d5da-0f97-4139-a01a-cd41ed81f6f0\") " pod="openshift-insights/insights-runtime-extractor-6tnpm" Jul 29 15:47:16.326370 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:16.326277 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:47:16.326370 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:16.326323 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:47:16.326370 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:16.326332 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-insights-runtime-extractor-tls podName:47b0d5da-0f97-4139-a01a-cd41ed81f6f0 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:16.826312341 +0000 UTC m=+38.670609818 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6tnpm" (UID: "47b0d5da-0f97-4139-a01a-cd41ed81f6f0") : secret "insights-runtime-extractor-tls" not found Jul 29 15:47:16.326370 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:16.326359 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-data-volume\") pod \"insights-runtime-extractor-6tnpm\" (UID: \"47b0d5da-0f97-4139-a01a-cd41ed81f6f0\") " pod="openshift-insights/insights-runtime-extractor-6tnpm" Jul 29 15:47:16.326639 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:16.326377 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-kube-rbac-proxy-cm podName:47b0d5da-0f97-4139-a01a-cd41ed81f6f0 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:16.826359778 +0000 UTC m=+38.670657242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6tnpm" (UID: "47b0d5da-0f97-4139-a01a-cd41ed81f6f0") : configmap "kube-rbac-proxy" not found Jul 29 15:47:16.338104 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:16.338084 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbvlx\" (UniqueName: \"kubernetes.io/projected/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-kube-api-access-cbvlx\") pod \"insights-runtime-extractor-6tnpm\" (UID: \"47b0d5da-0f97-4139-a01a-cd41ed81f6f0\") " pod="openshift-insights/insights-runtime-extractor-6tnpm" Jul 29 15:47:16.729159 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:16.729023 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d-metrics-tls\") pod \"dns-default-6b4dc\" (UID: \"bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d\") " pod="openshift-dns/dns-default-6b4dc" Jul 29 15:47:16.729274 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:16.729176 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-registry-tls\") pod \"image-registry-76667dd646-gw5z4\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:16.729274 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:16.729202 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:47:16.729274 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:16.729270 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d-metrics-tls podName:bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d nodeName:}" failed. No retries permitted until 2026-07-29 15:47:20.729250278 +0000 UTC m=+42.573547749 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d-metrics-tls") pod "dns-default-6b4dc" (UID: "bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d") : secret "dns-default-metrics-tls" not found Jul 29 15:47:16.729378 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:16.729275 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 15:47:16.729378 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:16.729286 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76667dd646-gw5z4: secret "image-registry-tls" not found Jul 29 15:47:16.729378 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:16.729323 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-registry-tls podName:24d9aedf-e77f-4e07-9495-cea45eb83a5c nodeName:}" failed. No retries permitted until 2026-07-29 15:47:20.729308454 +0000 UTC m=+42.573605911 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-registry-tls") pod "image-registry-76667dd646-gw5z4" (UID: "24d9aedf-e77f-4e07-9495-cea45eb83a5c") : secret "image-registry-tls" not found Jul 29 15:47:16.829911 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:16.829882 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6tnpm\" (UID: \"47b0d5da-0f97-4139-a01a-cd41ed81f6f0\") " pod="openshift-insights/insights-runtime-extractor-6tnpm" Jul 29 15:47:16.829911 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:16.829922 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6tnpm\" (UID: \"47b0d5da-0f97-4139-a01a-cd41ed81f6f0\") " pod="openshift-insights/insights-runtime-extractor-6tnpm" Jul 29 15:47:16.830094 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:16.830008 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:47:16.830094 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:16.830082 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-kube-rbac-proxy-cm podName:47b0d5da-0f97-4139-a01a-cd41ed81f6f0 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:17.83006033 +0000 UTC m=+39.674357807 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6tnpm" (UID: "47b0d5da-0f97-4139-a01a-cd41ed81f6f0") : configmap "kube-rbac-proxy" not found Jul 29 15:47:16.830162 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:16.830110 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:47:16.830194 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:16.830168 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-insights-runtime-extractor-tls podName:47b0d5da-0f97-4139-a01a-cd41ed81f6f0 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:17.83015406 +0000 UTC m=+39.674451517 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6tnpm" (UID: "47b0d5da-0f97-4139-a01a-cd41ed81f6f0") : secret "insights-runtime-extractor-tls" not found Jul 29 15:47:16.888911 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:16.888837 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r22bj" event={"ID":"66ca9e27-70cd-4be5-ab36-0ea5a7027c56","Type":"ContainerStarted","Data":"3d57bf43643c6376b9c84738a02753aabee3b14285385ab4cebdf606eb7e7628"} Jul 29 15:47:16.892099 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:16.892074 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6nm7c" event={"ID":"7e8b3213-5f73-40dc-8357-d1ae21efd3d9","Type":"ContainerStarted","Data":"4cee57ae9a822019c374145dd9f5e5568eb6e02700343e0ef2926379e1e0b924"} Jul 29 15:47:16.905008 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:16.904971 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r22bj" podStartSLOduration=2.236565403 podStartE2EDuration="4.904957842s" totalImagesPullingTime="2.668392439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:47:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:16.904407819 +0000 UTC m=+38.748705299" watchObservedRunningTime="2026-07-29 15:47:16.904957842 +0000 UTC m=+38.749255321" Jul 29 15:47:16.935517 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:16.935477 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6nm7c" podStartSLOduration=8.629236091 podStartE2EDuration="37.935465106s" totalImagesPullingTime="29.306229015s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:46:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:16.935372868 +0000 UTC m=+38.779670347" watchObservedRunningTime="2026-07-29 15:47:16.935465106 +0000 UTC m=+38.779762585" Jul 29 15:47:17.113213 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:17.113185 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-7htgr"] Jul 29 15:47:17.135081 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:17.135054 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-7htgr"] Jul 29 15:47:17.135193 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:17.135152 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7htgr" Jul 29 15:47:17.137963 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:17.137944 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-8bvfh\"" Jul 29 15:47:17.138270 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:17.138254 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 29 15:47:17.138666 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:17.138651 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 29 15:47:17.233325 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:17.233303 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p26qm\" (UniqueName: \"kubernetes.io/projected/3b1b8735-5160-40d9-8939-722146220f9f-kube-api-access-p26qm\") pod \"migrator-6865c9967-7htgr\" (UID: \"3b1b8735-5160-40d9-8939-722146220f9f\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7htgr" Jul 29 15:47:17.333743 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:17.333713 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p26qm\" (UniqueName: \"kubernetes.io/projected/3b1b8735-5160-40d9-8939-722146220f9f-kube-api-access-p26qm\") pod \"migrator-6865c9967-7htgr\" (UID: \"3b1b8735-5160-40d9-8939-722146220f9f\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7htgr" Jul 29 15:47:17.346536 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:17.346504 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p26qm\" (UniqueName: \"kubernetes.io/projected/3b1b8735-5160-40d9-8939-722146220f9f-kube-api-access-p26qm\") pod \"migrator-6865c9967-7htgr\" (UID: \"3b1b8735-5160-40d9-8939-722146220f9f\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7htgr" Jul 29 15:47:17.443911 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:17.443850 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7htgr" Jul 29 15:47:17.499396 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:17.499373 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7w9zd_4f782ba3-b2ac-46c7-ad06-db9aa6721614/dns-node-resolver/0.log" Jul 29 15:47:17.607118 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:17.607090 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-7htgr"] Jul 29 15:47:17.609937 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:47:17.609908 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b1b8735_5160_40d9_8939_722146220f9f.slice/crio-230d6bbd2378a17b06633028145a3d31cd7371f4fbdf47530cfc23e0f2ac05ef WatchSource:0}: Error finding container 230d6bbd2378a17b06633028145a3d31cd7371f4fbdf47530cfc23e0f2ac05ef: Status 404 returned error can't find the container with id 230d6bbd2378a17b06633028145a3d31cd7371f4fbdf47530cfc23e0f2ac05ef Jul 29 15:47:17.837989 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:17.837916 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6tnpm\" (UID: \"47b0d5da-0f97-4139-a01a-cd41ed81f6f0\") " pod="openshift-insights/insights-runtime-extractor-6tnpm" Jul 29 15:47:17.837989 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:17.837954 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6tnpm\" (UID: \"47b0d5da-0f97-4139-a01a-cd41ed81f6f0\") " pod="openshift-insights/insights-runtime-extractor-6tnpm" Jul 29 15:47:17.838155 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:17.838028 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:47:17.838155 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:17.838044 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:47:17.838155 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:17.838082 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-kube-rbac-proxy-cm podName:47b0d5da-0f97-4139-a01a-cd41ed81f6f0 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:19.838067576 +0000 UTC m=+41.682365033 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6tnpm" (UID: "47b0d5da-0f97-4139-a01a-cd41ed81f6f0") : configmap "kube-rbac-proxy" not found Jul 29 15:47:17.838302 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:17.838163 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-insights-runtime-extractor-tls podName:47b0d5da-0f97-4139-a01a-cd41ed81f6f0 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:19.838136192 +0000 UTC m=+41.682433664 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6tnpm" (UID: "47b0d5da-0f97-4139-a01a-cd41ed81f6f0") : secret "insights-runtime-extractor-tls" not found Jul 29 15:47:17.895773 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:17.895745 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7htgr" event={"ID":"3b1b8735-5160-40d9-8939-722146220f9f","Type":"ContainerStarted","Data":"230d6bbd2378a17b06633028145a3d31cd7371f4fbdf47530cfc23e0f2ac05ef"} Jul 29 15:47:18.521163 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:18.521134 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-254br_f9640ca5-c93f-49dc-9216-d3ea149abb4f/node-ca/0.log" Jul 29 15:47:19.499392 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:19.499331 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r22bj_66ca9e27-70cd-4be5-ab36-0ea5a7027c56/serve-healthcheck-canary/0.log" Jul 29 15:47:19.853168 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:19.853106 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6tnpm\" (UID: \"47b0d5da-0f97-4139-a01a-cd41ed81f6f0\") " pod="openshift-insights/insights-runtime-extractor-6tnpm" Jul 29 15:47:19.853168 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:19.853143 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6tnpm\" (UID: \"47b0d5da-0f97-4139-a01a-cd41ed81f6f0\") " pod="openshift-insights/insights-runtime-extractor-6tnpm" Jul 29 15:47:19.853341 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:19.853233 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:47:19.853341 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:19.853297 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-kube-rbac-proxy-cm podName:47b0d5da-0f97-4139-a01a-cd41ed81f6f0 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:23.853280286 +0000 UTC m=+45.697577757 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6tnpm" (UID: "47b0d5da-0f97-4139-a01a-cd41ed81f6f0") : configmap "kube-rbac-proxy" not found Jul 29 15:47:19.853341 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:19.853303 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:47:19.853341 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:19.853341 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-insights-runtime-extractor-tls podName:47b0d5da-0f97-4139-a01a-cd41ed81f6f0 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:23.853328607 +0000 UTC m=+45.697626063 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6tnpm" (UID: "47b0d5da-0f97-4139-a01a-cd41ed81f6f0") : secret "insights-runtime-extractor-tls" not found Jul 29 15:47:19.902356 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:19.902325 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7htgr" event={"ID":"3b1b8735-5160-40d9-8939-722146220f9f","Type":"ContainerStarted","Data":"e0e2f5d966f656eb5e6a6f264b008a56035f44df87dfcdbc36eaf5262809bff0"} Jul 29 15:47:19.902491 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:19.902378 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7htgr" event={"ID":"3b1b8735-5160-40d9-8939-722146220f9f","Type":"ContainerStarted","Data":"69b4fa03018ad2ef43fd960d15fc77265303fcae57a08ac3354f32f98dfde517"} Jul 29 15:47:19.928606 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:19.928567 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7htgr" podStartSLOduration=1.406604755 podStartE2EDuration="2.928553131s" totalImagesPullingTime="1.521948376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:47:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:19.926854794 +0000 UTC m=+41.771152273" watchObservedRunningTime="2026-07-29 15:47:19.928553131 +0000 UTC m=+41.772850610" Jul 29 15:47:20.760589 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:20.760560 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d-metrics-tls\") pod \"dns-default-6b4dc\" (UID: \"bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d\") " pod="openshift-dns/dns-default-6b4dc" Jul 29 15:47:20.761020 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:20.760596 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-registry-tls\") pod \"image-registry-76667dd646-gw5z4\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:20.761020 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:20.760717 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 15:47:20.761020 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:20.760717 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:47:20.761020 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:20.760801 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d-metrics-tls podName:bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d nodeName:}" failed. No retries permitted until 2026-07-29 15:47:28.76078021 +0000 UTC m=+50.605077669 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d-metrics-tls") pod "dns-default-6b4dc" (UID: "bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d") : secret "dns-default-metrics-tls" not found Jul 29 15:47:20.761020 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:20.760728 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76667dd646-gw5z4: secret "image-registry-tls" not found Jul 29 15:47:20.761020 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:20.760854 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-registry-tls podName:24d9aedf-e77f-4e07-9495-cea45eb83a5c nodeName:}" failed. No retries permitted until 2026-07-29 15:47:28.760842899 +0000 UTC m=+50.605140355 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-registry-tls") pod "image-registry-76667dd646-gw5z4" (UID: "24d9aedf-e77f-4e07-9495-cea45eb83a5c") : secret "image-registry-tls" not found Jul 29 15:47:23.882928 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:23.882893 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6tnpm\" (UID: \"47b0d5da-0f97-4139-a01a-cd41ed81f6f0\") " pod="openshift-insights/insights-runtime-extractor-6tnpm" Jul 29 15:47:23.882928 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:23.882931 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6tnpm\" (UID: \"47b0d5da-0f97-4139-a01a-cd41ed81f6f0\") " pod="openshift-insights/insights-runtime-extractor-6tnpm" Jul 29 15:47:23.883568 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:23.883037 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:47:23.883568 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:23.883130 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-kube-rbac-proxy-cm podName:47b0d5da-0f97-4139-a01a-cd41ed81f6f0 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:31.883108674 +0000 UTC m=+53.727406137 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6tnpm" (UID: "47b0d5da-0f97-4139-a01a-cd41ed81f6f0") : configmap "kube-rbac-proxy" not found Jul 29 15:47:23.883568 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:23.883167 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:47:23.883568 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:23.883226 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-insights-runtime-extractor-tls podName:47b0d5da-0f97-4139-a01a-cd41ed81f6f0 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:31.883213317 +0000 UTC m=+53.727510774 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6tnpm" (UID: "47b0d5da-0f97-4139-a01a-cd41ed81f6f0") : secret "insights-runtime-extractor-tls" not found Jul 29 15:47:28.823132 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:28.823103 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d-metrics-tls\") pod \"dns-default-6b4dc\" (UID: \"bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d\") " pod="openshift-dns/dns-default-6b4dc" Jul 29 15:47:28.823599 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:28.823146 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-registry-tls\") pod \"image-registry-76667dd646-gw5z4\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:28.825371 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:28.825346 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d-metrics-tls\") pod \"dns-default-6b4dc\" (UID: \"bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d\") " pod="openshift-dns/dns-default-6b4dc" Jul 29 15:47:28.825508 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:28.825475 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-registry-tls\") pod \"image-registry-76667dd646-gw5z4\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:28.898066 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:28.898047 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:28.919291 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:28.919267 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6b4dc" Jul 29 15:47:29.042209 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:29.042106 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76667dd646-gw5z4"] Jul 29 15:47:29.044674 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:47:29.044642 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24d9aedf_e77f_4e07_9495_cea45eb83a5c.slice/crio-10360dc148a125b074b9ddfd0cb398c683026b3ac44b9bbee206573dc607ef6c WatchSource:0}: Error finding container 10360dc148a125b074b9ddfd0cb398c683026b3ac44b9bbee206573dc607ef6c: Status 404 returned error can't find the container with id 10360dc148a125b074b9ddfd0cb398c683026b3ac44b9bbee206573dc607ef6c Jul 29 15:47:29.068379 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:29.068348 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6b4dc"] Jul 29 15:47:29.071028 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:47:29.071007 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb99fa2c_e1b5_41ab_8e74_1dd4ed8a4b6d.slice/crio-c902c3814e202acb297a9eb3d46bfd366999339a26f940a0eaf343f8f0b02703 WatchSource:0}: Error finding container c902c3814e202acb297a9eb3d46bfd366999339a26f940a0eaf343f8f0b02703: Status 404 returned error can't find the container with id c902c3814e202acb297a9eb3d46bfd366999339a26f940a0eaf343f8f0b02703 Jul 29 15:47:29.927985 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:29.927950 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6b4dc" event={"ID":"bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d","Type":"ContainerStarted","Data":"c902c3814e202acb297a9eb3d46bfd366999339a26f940a0eaf343f8f0b02703"} Jul 29 15:47:29.929584 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:29.929558 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76667dd646-gw5z4" event={"ID":"24d9aedf-e77f-4e07-9495-cea45eb83a5c","Type":"ContainerStarted","Data":"b8021a5b51b2080fcd2c08870f66f2d880eee5597298d9c77c5307262ceb1b0f"} Jul 29 15:47:29.929703 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:29.929603 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76667dd646-gw5z4" event={"ID":"24d9aedf-e77f-4e07-9495-cea45eb83a5c","Type":"ContainerStarted","Data":"10360dc148a125b074b9ddfd0cb398c683026b3ac44b9bbee206573dc607ef6c"} Jul 29 15:47:29.929767 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:29.929705 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:47:29.952924 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:29.952873 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-76667dd646-gw5z4" podStartSLOduration=20.952857957 podStartE2EDuration="20.952857957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:47:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:29.951177931 +0000 UTC m=+51.795475409" watchObservedRunningTime="2026-07-29 15:47:29.952857957 +0000 UTC m=+51.797155436" Jul 29 15:47:31.938296 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:31.938260 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6b4dc" event={"ID":"bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d","Type":"ContainerStarted","Data":"45a6c1e50722f624e79f657255e2b4a7b1cbd05c5540c9a522ddb48bf2884947"} Jul 29 15:47:31.938743 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:31.938354 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6b4dc" event={"ID":"bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d","Type":"ContainerStarted","Data":"06133f2d71feebef0d125db7c4ca60e3448d6f30e961928ce065b4a58a817f99"} Jul 29 15:47:31.938743 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:31.938404 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6b4dc" Jul 29 15:47:31.948880 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:31.948862 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6tnpm\" (UID: \"47b0d5da-0f97-4139-a01a-cd41ed81f6f0\") " pod="openshift-insights/insights-runtime-extractor-6tnpm" Jul 29 15:47:31.948960 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:31.948895 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6tnpm\" (UID: \"47b0d5da-0f97-4139-a01a-cd41ed81f6f0\") " pod="openshift-insights/insights-runtime-extractor-6tnpm" Jul 29 15:47:31.949014 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:31.949003 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:47:31.949058 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:47:31.949050 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-insights-runtime-extractor-tls podName:47b0d5da-0f97-4139-a01a-cd41ed81f6f0 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:47.94903821 +0000 UTC m=+69.793335667 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6tnpm" (UID: "47b0d5da-0f97-4139-a01a-cd41ed81f6f0") : secret "insights-runtime-extractor-tls" not found Jul 29 15:47:31.949385 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:31.949365 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6tnpm\" (UID: \"47b0d5da-0f97-4139-a01a-cd41ed81f6f0\") " pod="openshift-insights/insights-runtime-extractor-6tnpm" Jul 29 15:47:31.959220 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:31.959183 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6b4dc" podStartSLOduration=17.871929881 podStartE2EDuration="19.959172226s" totalImagesPullingTime="2.087242345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:47:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:31.958580472 +0000 UTC m=+53.802877951" watchObservedRunningTime="2026-07-29 15:47:31.959172226 +0000 UTC m=+53.803469750" Jul 29 15:47:38.869852 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:38.869828 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t5rxf" Jul 29 15:47:41.056879 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.056842 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8d698f545-jg4n7"] Jul 29 15:47:41.059902 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.059883 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8d698f545-jg4n7" Jul 29 15:47:41.064796 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.064774 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 29 15:47:41.064904 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.064885 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 29 15:47:41.064993 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.064978 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 29 15:47:41.065154 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.065140 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 29 15:47:41.076220 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.076198 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-v96n8"] Jul 29 15:47:41.078048 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.078031 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-v96n8" Jul 29 15:47:41.080424 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.080406 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8d698f545-jg4n7"] Jul 29 15:47:41.080819 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.080804 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 29 15:47:41.080878 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.080825 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-l4xjr\"" Jul 29 15:47:41.081371 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.081357 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 29 15:47:41.095865 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.095846 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-v96n8"] Jul 29 15:47:41.099029 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.099009 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76667dd646-gw5z4"] Jul 29 15:47:41.111348 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.111321 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c196a07f-eb43-45ad-a237-a08c2594bc37-tmp\") pod \"klusterlet-addon-workmgr-8d698f545-jg4n7\" (UID: \"c196a07f-eb43-45ad-a237-a08c2594bc37\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8d698f545-jg4n7" Jul 29 15:47:41.111463 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.111397 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d2d48012-4f48-46be-a087-92d97c98905a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-v96n8\" (UID: \"d2d48012-4f48-46be-a087-92d97c98905a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-v96n8" Jul 29 15:47:41.111463 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.111452 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbv4f\" (UniqueName: \"kubernetes.io/projected/c196a07f-eb43-45ad-a237-a08c2594bc37-kube-api-access-kbv4f\") pod \"klusterlet-addon-workmgr-8d698f545-jg4n7\" (UID: \"c196a07f-eb43-45ad-a237-a08c2594bc37\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8d698f545-jg4n7" Jul 29 15:47:41.111579 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.111510 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d2d48012-4f48-46be-a087-92d97c98905a-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-v96n8\" (UID: \"d2d48012-4f48-46be-a087-92d97c98905a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-v96n8" Jul 29 15:47:41.111635 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.111586 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c196a07f-eb43-45ad-a237-a08c2594bc37-klusterlet-config\") pod \"klusterlet-addon-workmgr-8d698f545-jg4n7\" (UID: \"c196a07f-eb43-45ad-a237-a08c2594bc37\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8d698f545-jg4n7" Jul 29 15:47:41.174897 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.174865 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-9q4n4"] Jul 29 15:47:41.176940 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.176921 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-9q4n4" Jul 29 15:47:41.179740 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.179720 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7cb5498d56-cr7sg"] Jul 29 15:47:41.179983 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.179962 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 29 15:47:41.180152 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.180125 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 29 15:47:41.180218 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.180189 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-hc8n8\"" Jul 29 15:47:41.181533 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.181516 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cb5498d56-cr7sg" Jul 29 15:47:41.191237 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.191210 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-9q4n4"] Jul 29 15:47:41.205876 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.205855 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cb5498d56-cr7sg"] Jul 29 15:47:41.212158 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.212128 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2b7x\" (UniqueName: \"kubernetes.io/projected/bba31de0-388f-4f77-8eed-0c6acb4d5737-kube-api-access-w2b7x\") pod \"image-registry-7cb5498d56-cr7sg\" (UID: \"bba31de0-388f-4f77-8eed-0c6acb4d5737\") " pod="openshift-image-registry/image-registry-7cb5498d56-cr7sg" Jul 29 15:47:41.212266 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.212168 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bba31de0-388f-4f77-8eed-0c6acb4d5737-ca-trust-extracted\") pod \"image-registry-7cb5498d56-cr7sg\" (UID: \"bba31de0-388f-4f77-8eed-0c6acb4d5737\") " pod="openshift-image-registry/image-registry-7cb5498d56-cr7sg" Jul 29 15:47:41.212266 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.212210 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bba31de0-388f-4f77-8eed-0c6acb4d5737-installation-pull-secrets\") pod \"image-registry-7cb5498d56-cr7sg\" (UID: \"bba31de0-388f-4f77-8eed-0c6acb4d5737\") " pod="openshift-image-registry/image-registry-7cb5498d56-cr7sg" Jul 29 15:47:41.212266 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.212244 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bba31de0-388f-4f77-8eed-0c6acb4d5737-bound-sa-token\") pod \"image-registry-7cb5498d56-cr7sg\" (UID: \"bba31de0-388f-4f77-8eed-0c6acb4d5737\") " pod="openshift-image-registry/image-registry-7cb5498d56-cr7sg" Jul 29 15:47:41.212365 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.212325 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d2d48012-4f48-46be-a087-92d97c98905a-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-v96n8\" (UID: \"d2d48012-4f48-46be-a087-92d97c98905a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-v96n8" Jul 29 15:47:41.212397 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.212365 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bba31de0-388f-4f77-8eed-0c6acb4d5737-trusted-ca\") pod \"image-registry-7cb5498d56-cr7sg\" (UID: \"bba31de0-388f-4f77-8eed-0c6acb4d5737\") " pod="openshift-image-registry/image-registry-7cb5498d56-cr7sg" Jul 29 15:47:41.212397 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.212387 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c196a07f-eb43-45ad-a237-a08c2594bc37-klusterlet-config\") pod \"klusterlet-addon-workmgr-8d698f545-jg4n7\" (UID: \"c196a07f-eb43-45ad-a237-a08c2594bc37\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8d698f545-jg4n7" Jul 29 15:47:41.212468 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.212415 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bba31de0-388f-4f77-8eed-0c6acb4d5737-image-registry-private-configuration\") pod \"image-registry-7cb5498d56-cr7sg\" (UID: \"bba31de0-388f-4f77-8eed-0c6acb4d5737\") " pod="openshift-image-registry/image-registry-7cb5498d56-cr7sg" Jul 29 15:47:41.212529 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.212509 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c196a07f-eb43-45ad-a237-a08c2594bc37-tmp\") pod \"klusterlet-addon-workmgr-8d698f545-jg4n7\" (UID: \"c196a07f-eb43-45ad-a237-a08c2594bc37\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8d698f545-jg4n7" Jul 29 15:47:41.212580 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.212566 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2r7h\" (UniqueName: \"kubernetes.io/projected/d8900764-2321-4a76-bb67-e8b6fd8f0bd4-kube-api-access-k2r7h\") pod \"downloads-7c97dc4555-9q4n4\" (UID: \"d8900764-2321-4a76-bb67-e8b6fd8f0bd4\") " pod="openshift-console/downloads-7c97dc4555-9q4n4" Jul 29 15:47:41.212614 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.212596 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d2d48012-4f48-46be-a087-92d97c98905a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-v96n8\" (UID: \"d2d48012-4f48-46be-a087-92d97c98905a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-v96n8" Jul 29 15:47:41.212661 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.212628 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbv4f\" (UniqueName: \"kubernetes.io/projected/c196a07f-eb43-45ad-a237-a08c2594bc37-kube-api-access-kbv4f\") pod \"klusterlet-addon-workmgr-8d698f545-jg4n7\" (UID: \"c196a07f-eb43-45ad-a237-a08c2594bc37\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8d698f545-jg4n7" Jul 29 15:47:41.212705 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.212657 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bba31de0-388f-4f77-8eed-0c6acb4d5737-registry-certificates\") pod \"image-registry-7cb5498d56-cr7sg\" (UID: \"bba31de0-388f-4f77-8eed-0c6acb4d5737\") " pod="openshift-image-registry/image-registry-7cb5498d56-cr7sg" Jul 29 15:47:41.212705 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.212697 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bba31de0-388f-4f77-8eed-0c6acb4d5737-registry-tls\") pod \"image-registry-7cb5498d56-cr7sg\" (UID: \"bba31de0-388f-4f77-8eed-0c6acb4d5737\") " pod="openshift-image-registry/image-registry-7cb5498d56-cr7sg" Jul 29 15:47:41.212894 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.212873 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c196a07f-eb43-45ad-a237-a08c2594bc37-tmp\") pod \"klusterlet-addon-workmgr-8d698f545-jg4n7\" (UID: \"c196a07f-eb43-45ad-a237-a08c2594bc37\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8d698f545-jg4n7" Jul 29 15:47:41.213046 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.213030 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d2d48012-4f48-46be-a087-92d97c98905a-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-v96n8\" (UID: \"d2d48012-4f48-46be-a087-92d97c98905a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-v96n8" Jul 29 15:47:41.214719 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.214703 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c196a07f-eb43-45ad-a237-a08c2594bc37-klusterlet-config\") pod \"klusterlet-addon-workmgr-8d698f545-jg4n7\" (UID: \"c196a07f-eb43-45ad-a237-a08c2594bc37\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8d698f545-jg4n7" Jul 29 15:47:41.214896 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.214872 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d2d48012-4f48-46be-a087-92d97c98905a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-v96n8\" (UID: \"d2d48012-4f48-46be-a087-92d97c98905a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-v96n8" Jul 29 15:47:41.234840 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.234812 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbv4f\" (UniqueName: \"kubernetes.io/projected/c196a07f-eb43-45ad-a237-a08c2594bc37-kube-api-access-kbv4f\") pod \"klusterlet-addon-workmgr-8d698f545-jg4n7\" (UID: \"c196a07f-eb43-45ad-a237-a08c2594bc37\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8d698f545-jg4n7" Jul 29 15:47:41.313326 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.313250 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bba31de0-388f-4f77-8eed-0c6acb4d5737-registry-tls\") pod \"image-registry-7cb5498d56-cr7sg\" (UID: \"bba31de0-388f-4f77-8eed-0c6acb4d5737\") " pod="openshift-image-registry/image-registry-7cb5498d56-cr7sg" Jul 29 15:47:41.313326 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.313288 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2b7x\" (UniqueName: \"kubernetes.io/projected/bba31de0-388f-4f77-8eed-0c6acb4d5737-kube-api-access-w2b7x\") pod \"image-registry-7cb5498d56-cr7sg\" (UID: \"bba31de0-388f-4f77-8eed-0c6acb4d5737\") " pod="openshift-image-registry/image-registry-7cb5498d56-cr7sg" Jul 29 15:47:41.313326 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.313312 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bba31de0-388f-4f77-8eed-0c6acb4d5737-ca-trust-extracted\") pod \"image-registry-7cb5498d56-cr7sg\" (UID: \"bba31de0-388f-4f77-8eed-0c6acb4d5737\") " pod="openshift-image-registry/image-registry-7cb5498d56-cr7sg" Jul 29 15:47:41.313654 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.313374 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bba31de0-388f-4f77-8eed-0c6acb4d5737-installation-pull-secrets\") pod \"image-registry-7cb5498d56-cr7sg\" (UID: \"bba31de0-388f-4f77-8eed-0c6acb4d5737\") " pod="openshift-image-registry/image-registry-7cb5498d56-cr7sg" Jul 29 15:47:41.313654 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.313403 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bba31de0-388f-4f77-8eed-0c6acb4d5737-bound-sa-token\") pod \"image-registry-7cb5498d56-cr7sg\" (UID: \"bba31de0-388f-4f77-8eed-0c6acb4d5737\") " pod="openshift-image-registry/image-registry-7cb5498d56-cr7sg" Jul 29 15:47:41.313654 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.313611 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bba31de0-388f-4f77-8eed-0c6acb4d5737-trusted-ca\") pod \"image-registry-7cb5498d56-cr7sg\" (UID: \"bba31de0-388f-4f77-8eed-0c6acb4d5737\") " pod="openshift-image-registry/image-registry-7cb5498d56-cr7sg" Jul 29 15:47:41.313805 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.313688 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bba31de0-388f-4f77-8eed-0c6acb4d5737-image-registry-private-configuration\") pod \"image-registry-7cb5498d56-cr7sg\" (UID: \"bba31de0-388f-4f77-8eed-0c6acb4d5737\") " pod="openshift-image-registry/image-registry-7cb5498d56-cr7sg" Jul 29 15:47:41.313805 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.313731 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bba31de0-388f-4f77-8eed-0c6acb4d5737-ca-trust-extracted\") pod \"image-registry-7cb5498d56-cr7sg\" (UID: \"bba31de0-388f-4f77-8eed-0c6acb4d5737\") " pod="openshift-image-registry/image-registry-7cb5498d56-cr7sg" Jul 29 15:47:41.313805 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.313759 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2r7h\" (UniqueName: \"kubernetes.io/projected/d8900764-2321-4a76-bb67-e8b6fd8f0bd4-kube-api-access-k2r7h\") pod \"downloads-7c97dc4555-9q4n4\" (UID: \"d8900764-2321-4a76-bb67-e8b6fd8f0bd4\") " pod="openshift-console/downloads-7c97dc4555-9q4n4" Jul 29 15:47:41.313925 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.313812 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bba31de0-388f-4f77-8eed-0c6acb4d5737-registry-certificates\") pod \"image-registry-7cb5498d56-cr7sg\" (UID: \"bba31de0-388f-4f77-8eed-0c6acb4d5737\") " pod="openshift-image-registry/image-registry-7cb5498d56-cr7sg" Jul 29 15:47:41.314534 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.314506 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bba31de0-388f-4f77-8eed-0c6acb4d5737-registry-certificates\") pod \"image-registry-7cb5498d56-cr7sg\" (UID: \"bba31de0-388f-4f77-8eed-0c6acb4d5737\") " pod="openshift-image-registry/image-registry-7cb5498d56-cr7sg" Jul 29 15:47:41.314800 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.314774 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bba31de0-388f-4f77-8eed-0c6acb4d5737-trusted-ca\") pod \"image-registry-7cb5498d56-cr7sg\" (UID: \"bba31de0-388f-4f77-8eed-0c6acb4d5737\") " pod="openshift-image-registry/image-registry-7cb5498d56-cr7sg" Jul 29 15:47:41.315890 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.315858 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bba31de0-388f-4f77-8eed-0c6acb4d5737-installation-pull-secrets\") pod \"image-registry-7cb5498d56-cr7sg\" (UID: \"bba31de0-388f-4f77-8eed-0c6acb4d5737\") " pod="openshift-image-registry/image-registry-7cb5498d56-cr7sg" Jul 29 15:47:41.315996 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.315948 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bba31de0-388f-4f77-8eed-0c6acb4d5737-registry-tls\") pod \"image-registry-7cb5498d56-cr7sg\" (UID: \"bba31de0-388f-4f77-8eed-0c6acb4d5737\") " pod="openshift-image-registry/image-registry-7cb5498d56-cr7sg" Jul 29 15:47:41.316064 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.315991 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bba31de0-388f-4f77-8eed-0c6acb4d5737-image-registry-private-configuration\") pod \"image-registry-7cb5498d56-cr7sg\" (UID: \"bba31de0-388f-4f77-8eed-0c6acb4d5737\") " pod="openshift-image-registry/image-registry-7cb5498d56-cr7sg" Jul 29 15:47:41.321890 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.321867 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bba31de0-388f-4f77-8eed-0c6acb4d5737-bound-sa-token\") pod \"image-registry-7cb5498d56-cr7sg\" (UID: \"bba31de0-388f-4f77-8eed-0c6acb4d5737\") " pod="openshift-image-registry/image-registry-7cb5498d56-cr7sg" Jul 29 15:47:41.322491 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.322471 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2r7h\" (UniqueName: \"kubernetes.io/projected/d8900764-2321-4a76-bb67-e8b6fd8f0bd4-kube-api-access-k2r7h\") pod \"downloads-7c97dc4555-9q4n4\" (UID: \"d8900764-2321-4a76-bb67-e8b6fd8f0bd4\") " pod="openshift-console/downloads-7c97dc4555-9q4n4" Jul 29 15:47:41.323091 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.323074 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2b7x\" (UniqueName: \"kubernetes.io/projected/bba31de0-388f-4f77-8eed-0c6acb4d5737-kube-api-access-w2b7x\") pod \"image-registry-7cb5498d56-cr7sg\" (UID: \"bba31de0-388f-4f77-8eed-0c6acb4d5737\") " pod="openshift-image-registry/image-registry-7cb5498d56-cr7sg" Jul 29 15:47:41.368706 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.368678 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8d698f545-jg4n7" Jul 29 15:47:41.386849 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.386823 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-v96n8" Jul 29 15:47:41.486835 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.486794 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-9q4n4" Jul 29 15:47:41.493651 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.493625 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cb5498d56-cr7sg" Jul 29 15:47:41.503846 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.503819 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8d698f545-jg4n7"] Jul 29 15:47:41.506777 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:47:41.506751 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc196a07f_eb43_45ad_a237_a08c2594bc37.slice/crio-d83c3b08cc8b63730cb934145fabe1e4d310627dbe70f67c401679c87efe965d WatchSource:0}: Error finding container d83c3b08cc8b63730cb934145fabe1e4d310627dbe70f67c401679c87efe965d: Status 404 returned error can't find the container with id d83c3b08cc8b63730cb934145fabe1e4d310627dbe70f67c401679c87efe965d Jul 29 15:47:41.526777 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.526103 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-v96n8"] Jul 29 15:47:41.528538 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:47:41.528501 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2d48012_4f48_46be_a087_92d97c98905a.slice/crio-aed3fb270e6e0aea071b1b71df43b2827940ad1b2f8c9e8de48cd4ba3f7f519a WatchSource:0}: Error finding container aed3fb270e6e0aea071b1b71df43b2827940ad1b2f8c9e8de48cd4ba3f7f519a: Status 404 returned error can't find the container with id aed3fb270e6e0aea071b1b71df43b2827940ad1b2f8c9e8de48cd4ba3f7f519a Jul 29 15:47:41.622245 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.622214 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-9q4n4"] Jul 29 15:47:41.625108 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:47:41.625083 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8900764_2321_4a76_bb67_e8b6fd8f0bd4.slice/crio-38c6df06b51cf8bc42dfb405d87a64c0d075b25b652ccb1bcccde246c252c16c WatchSource:0}: Error finding container 38c6df06b51cf8bc42dfb405d87a64c0d075b25b652ccb1bcccde246c252c16c: Status 404 returned error can't find the container with id 38c6df06b51cf8bc42dfb405d87a64c0d075b25b652ccb1bcccde246c252c16c Jul 29 15:47:41.638958 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.638937 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cb5498d56-cr7sg"] Jul 29 15:47:41.641325 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:47:41.641304 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbba31de0_388f_4f77_8eed_0c6acb4d5737.slice/crio-76df636b362436da00999793c67ed34ee5eaf2debd3ffc3e1ffacac8336a9480 WatchSource:0}: Error finding container 76df636b362436da00999793c67ed34ee5eaf2debd3ffc3e1ffacac8336a9480: Status 404 returned error can't find the container with id 76df636b362436da00999793c67ed34ee5eaf2debd3ffc3e1ffacac8336a9480 Jul 29 15:47:41.944551 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.944519 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6b4dc" Jul 29 15:47:41.974423 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.974383 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8d698f545-jg4n7" event={"ID":"c196a07f-eb43-45ad-a237-a08c2594bc37","Type":"ContainerStarted","Data":"d83c3b08cc8b63730cb934145fabe1e4d310627dbe70f67c401679c87efe965d"} Jul 29 15:47:41.975779 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.975743 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-9q4n4" event={"ID":"d8900764-2321-4a76-bb67-e8b6fd8f0bd4","Type":"ContainerStarted","Data":"38c6df06b51cf8bc42dfb405d87a64c0d075b25b652ccb1bcccde246c252c16c"} Jul 29 15:47:41.977502 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.977473 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cb5498d56-cr7sg" event={"ID":"bba31de0-388f-4f77-8eed-0c6acb4d5737","Type":"ContainerStarted","Data":"1010f80f336b9ea04bcb3aaedcad873fdb851e83cb223ce9f73b57ed253b576a"} Jul 29 15:47:41.977655 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.977509 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cb5498d56-cr7sg" event={"ID":"bba31de0-388f-4f77-8eed-0c6acb4d5737","Type":"ContainerStarted","Data":"76df636b362436da00999793c67ed34ee5eaf2debd3ffc3e1ffacac8336a9480"} Jul 29 15:47:41.977655 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.977556 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7cb5498d56-cr7sg" Jul 29 15:47:41.979126 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.979103 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-v96n8" event={"ID":"d2d48012-4f48-46be-a087-92d97c98905a","Type":"ContainerStarted","Data":"aed3fb270e6e0aea071b1b71df43b2827940ad1b2f8c9e8de48cd4ba3f7f519a"} Jul 29 15:47:41.998586 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:41.998536 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7cb5498d56-cr7sg" podStartSLOduration=0.998517347 podStartE2EDuration="998.517347ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:47:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:41.99784124 +0000 UTC m=+63.842138719" watchObservedRunningTime="2026-07-29 15:47:41.998517347 +0000 UTC m=+63.842814827" Jul 29 15:47:43.995828 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:43.995784 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-v96n8" event={"ID":"d2d48012-4f48-46be-a087-92d97c98905a","Type":"ContainerStarted","Data":"d380905e169e4e608ba10405f21c5214f4ee3b89f1954b60eaa713058db0e0f2"} Jul 29 15:47:44.344166 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:44.344070 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7377e78e-3c71-4fcb-918c-eb6c54e2d562-metrics-certs\") pod \"network-metrics-daemon-64nqz\" (UID: \"7377e78e-3c71-4fcb-918c-eb6c54e2d562\") " pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:47:44.344166 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:44.344162 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77adaab3-405e-43d8-8dec-badf07ce38f2-original-pull-secret\") pod \"global-pull-secret-syncer-f5gvg\" (UID: \"77adaab3-405e-43d8-8dec-badf07ce38f2\") " pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:47:44.347061 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:44.347038 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 15:47:44.347178 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:44.347038 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 15:47:44.357975 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:44.357952 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7377e78e-3c71-4fcb-918c-eb6c54e2d562-metrics-certs\") pod \"network-metrics-daemon-64nqz\" (UID: \"7377e78e-3c71-4fcb-918c-eb6c54e2d562\") " pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:47:44.359964 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:44.359933 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77adaab3-405e-43d8-8dec-badf07ce38f2-original-pull-secret\") pod \"global-pull-secret-syncer-f5gvg\" (UID: \"77adaab3-405e-43d8-8dec-badf07ce38f2\") " pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:47:44.445036 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:44.444932 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6skr\" (UniqueName: \"kubernetes.io/projected/e7e55e83-cfda-4e11-8182-e93e305e78bb-kube-api-access-t6skr\") pod \"network-check-target-rwvpj\" (UID: \"e7e55e83-cfda-4e11-8182-e93e305e78bb\") " pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:47:44.445300 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:44.445279 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mdhwr\"" Jul 29 15:47:44.447750 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:44.447731 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 15:47:44.452870 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:44.452839 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64nqz" Jul 29 15:47:44.458429 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:44.458384 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 15:47:44.469899 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:44.469715 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6skr\" (UniqueName: \"kubernetes.io/projected/e7e55e83-cfda-4e11-8182-e93e305e78bb-kube-api-access-t6skr\") pod \"network-check-target-rwvpj\" (UID: \"e7e55e83-cfda-4e11-8182-e93e305e78bb\") " pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:47:44.597980 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:44.597875 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-v96n8" podStartSLOduration=1.908301919 podStartE2EDuration="3.597848975s" totalImagesPullingTime="1.689547056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:47:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:44.017909047 +0000 UTC m=+65.862206527" watchObservedRunningTime="2026-07-29 15:47:44.597848975 +0000 UTC m=+66.442146454" Jul 29 15:47:44.598262 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:44.598237 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-64nqz"] Jul 29 15:47:44.601609 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:47:44.601571 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7377e78e_3c71_4fcb_918c_eb6c54e2d562.slice/crio-e116358a8d456796dda7b005cd7fe7399ba812fe84dbc9c043f2f42408fb2e05 WatchSource:0}: Error finding container e116358a8d456796dda7b005cd7fe7399ba812fe84dbc9c043f2f42408fb2e05: Status 404 returned error can't find the container with id e116358a8d456796dda7b005cd7fe7399ba812fe84dbc9c043f2f42408fb2e05 Jul 29 15:47:44.630826 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:44.630801 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5gvg" Jul 29 15:47:44.740812 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:44.740783 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9brzs\"" Jul 29 15:47:44.747520 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:44.747495 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:47:45.002513 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:45.002424 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-64nqz" event={"ID":"7377e78e-3c71-4fcb-918c-eb6c54e2d562","Type":"ContainerStarted","Data":"e116358a8d456796dda7b005cd7fe7399ba812fe84dbc9c043f2f42408fb2e05"} Jul 29 15:47:45.671432 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:45.671400 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fb876c6f4-flqrs"] Jul 29 15:47:45.689100 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:45.689069 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fb876c6f4-flqrs"] Jul 29 15:47:45.689273 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:45.689186 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb876c6f4-flqrs" Jul 29 15:47:45.694847 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:45.694818 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 29 15:47:45.695515 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:45.695488 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 29 15:47:45.695835 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:45.695791 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bzgb7\"" Jul 29 15:47:45.695835 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:45.695802 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 29 15:47:45.696013 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:45.695998 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 29 15:47:45.696223 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:45.696206 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 29 15:47:45.756242 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:45.756212 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-console-serving-cert\") pod \"console-fb876c6f4-flqrs\" (UID: \"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71\") " pod="openshift-console/console-fb876c6f4-flqrs" Jul 29 15:47:45.756395 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:45.756264 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-console-config\") pod \"console-fb876c6f4-flqrs\" (UID: \"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71\") " pod="openshift-console/console-fb876c6f4-flqrs" Jul 29 15:47:45.756395 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:45.756347 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26sv8\" (UniqueName: \"kubernetes.io/projected/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-kube-api-access-26sv8\") pod \"console-fb876c6f4-flqrs\" (UID: \"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71\") " pod="openshift-console/console-fb876c6f4-flqrs" Jul 29 15:47:45.756548 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:45.756396 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-console-oauth-config\") pod \"console-fb876c6f4-flqrs\" (UID: \"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71\") " pod="openshift-console/console-fb876c6f4-flqrs" Jul 29 15:47:45.756548 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:45.756452 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-service-ca\") pod \"console-fb876c6f4-flqrs\" (UID: \"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71\") " pod="openshift-console/console-fb876c6f4-flqrs" Jul 29 15:47:45.756548 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:45.756481 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-oauth-serving-cert\") pod \"console-fb876c6f4-flqrs\" (UID: \"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71\") " pod="openshift-console/console-fb876c6f4-flqrs" Jul 29 15:47:45.857784 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:45.857710 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-console-serving-cert\") pod \"console-fb876c6f4-flqrs\" (UID: \"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71\") " pod="openshift-console/console-fb876c6f4-flqrs" Jul 29 15:47:45.857784 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:45.857760 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-console-config\") pod \"console-fb876c6f4-flqrs\" (UID: \"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71\") " pod="openshift-console/console-fb876c6f4-flqrs" Jul 29 15:47:45.858015 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:45.857896 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26sv8\" (UniqueName: \"kubernetes.io/projected/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-kube-api-access-26sv8\") pod \"console-fb876c6f4-flqrs\" (UID: \"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71\") " pod="openshift-console/console-fb876c6f4-flqrs" Jul 29 15:47:45.858015 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:45.857942 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-console-oauth-config\") pod \"console-fb876c6f4-flqrs\" (UID: \"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71\") " pod="openshift-console/console-fb876c6f4-flqrs" Jul 29 15:47:45.858015 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:45.857993 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-service-ca\") pod \"console-fb876c6f4-flqrs\" (UID: \"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71\") " pod="openshift-console/console-fb876c6f4-flqrs" Jul 29 15:47:45.858167 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:45.858023 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-oauth-serving-cert\") pod \"console-fb876c6f4-flqrs\" (UID: \"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71\") " pod="openshift-console/console-fb876c6f4-flqrs" Jul 29 15:47:45.858532 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:45.858503 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-console-config\") pod \"console-fb876c6f4-flqrs\" (UID: \"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71\") " pod="openshift-console/console-fb876c6f4-flqrs" Jul 29 15:47:45.858776 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:45.858732 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-oauth-serving-cert\") pod \"console-fb876c6f4-flqrs\" (UID: \"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71\") " pod="openshift-console/console-fb876c6f4-flqrs" Jul 29 15:47:45.858935 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:45.858875 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-service-ca\") pod \"console-fb876c6f4-flqrs\" (UID: \"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71\") " pod="openshift-console/console-fb876c6f4-flqrs" Jul 29 15:47:45.861989 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:45.861774 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-console-oauth-config\") pod \"console-fb876c6f4-flqrs\" (UID: \"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71\") " pod="openshift-console/console-fb876c6f4-flqrs" Jul 29 15:47:45.861989 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:45.861802 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-console-serving-cert\") pod \"console-fb876c6f4-flqrs\" (UID: \"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71\") " pod="openshift-console/console-fb876c6f4-flqrs" Jul 29 15:47:45.869205 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:45.869153 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26sv8\" (UniqueName: \"kubernetes.io/projected/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-kube-api-access-26sv8\") pod \"console-fb876c6f4-flqrs\" (UID: \"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71\") " pod="openshift-console/console-fb876c6f4-flqrs" Jul 29 15:47:46.002211 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:46.002130 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb876c6f4-flqrs" Jul 29 15:47:46.199559 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:46.199530 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f5gvg"] Jul 29 15:47:46.204371 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:47:46.204343 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77adaab3_405e_43d8_8dec_badf07ce38f2.slice/crio-3d8fb83813a75d432c36b2b7b66f24ecca5630115cc90ad465953c40a3d6a752 WatchSource:0}: Error finding container 3d8fb83813a75d432c36b2b7b66f24ecca5630115cc90ad465953c40a3d6a752: Status 404 returned error can't find the container with id 3d8fb83813a75d432c36b2b7b66f24ecca5630115cc90ad465953c40a3d6a752 Jul 29 15:47:46.425266 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:46.425198 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rwvpj"] Jul 29 15:47:46.429637 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:46.429521 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fb876c6f4-flqrs"] Jul 29 15:47:46.458220 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:47:46.458187 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7e55e83_cfda_4e11_8182_e93e305e78bb.slice/crio-42cfbb6e408dc53b7d8ea9333541b07295266ea365d7c85ea63b99a90d08ca74 WatchSource:0}: Error finding container 42cfbb6e408dc53b7d8ea9333541b07295266ea365d7c85ea63b99a90d08ca74: Status 404 returned error can't find the container with id 42cfbb6e408dc53b7d8ea9333541b07295266ea365d7c85ea63b99a90d08ca74 Jul 29 15:47:46.459035 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:47:46.459004 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfa5d991_357c_4cef_a6f3_5a59cc1b7f71.slice/crio-ce3f1f8fad417e3814a6a073029895939e0ead78be0ff5bac3d6d05dd02af18a WatchSource:0}: Error finding container ce3f1f8fad417e3814a6a073029895939e0ead78be0ff5bac3d6d05dd02af18a: Status 404 returned error can't find the container with id ce3f1f8fad417e3814a6a073029895939e0ead78be0ff5bac3d6d05dd02af18a Jul 29 15:47:47.012382 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:47.012342 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8d698f545-jg4n7" event={"ID":"c196a07f-eb43-45ad-a237-a08c2594bc37","Type":"ContainerStarted","Data":"59c200d49b487f8b2c85bfa1699cf9854c8a733765a764be7b8b3103b010bcac"} Jul 29 15:47:47.012568 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:47.012543 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8d698f545-jg4n7" Jul 29 15:47:47.014182 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:47.014019 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rwvpj" event={"ID":"e7e55e83-cfda-4e11-8182-e93e305e78bb","Type":"ContainerStarted","Data":"42cfbb6e408dc53b7d8ea9333541b07295266ea365d7c85ea63b99a90d08ca74"} Jul 29 15:47:47.014525 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:47.014504 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8d698f545-jg4n7" Jul 29 15:47:47.015712 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:47.015690 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb876c6f4-flqrs" event={"ID":"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71","Type":"ContainerStarted","Data":"ce3f1f8fad417e3814a6a073029895939e0ead78be0ff5bac3d6d05dd02af18a"} Jul 29 15:47:47.016901 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:47.016853 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f5gvg" event={"ID":"77adaab3-405e-43d8-8dec-badf07ce38f2","Type":"ContainerStarted","Data":"3d8fb83813a75d432c36b2b7b66f24ecca5630115cc90ad465953c40a3d6a752"} Jul 29 15:47:47.038484 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:47.038414 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8d698f545-jg4n7" podStartSLOduration=1.039113987 podStartE2EDuration="6.038394594s" totalImagesPullingTime="4.999280607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:47:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:47.037147616 +0000 UTC m=+68.881445097" watchObservedRunningTime="2026-07-29 15:47:47.038394594 +0000 UTC m=+68.882692074" Jul 29 15:47:47.980458 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:47.980401 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6tnpm\" (UID: \"47b0d5da-0f97-4139-a01a-cd41ed81f6f0\") " pod="openshift-insights/insights-runtime-extractor-6tnpm" Jul 29 15:47:47.989413 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:47.985232 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47b0d5da-0f97-4139-a01a-cd41ed81f6f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6tnpm\" (UID: \"47b0d5da-0f97-4139-a01a-cd41ed81f6f0\") " pod="openshift-insights/insights-runtime-extractor-6tnpm" Jul 29 15:47:48.024617 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:48.024504 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-64nqz" event={"ID":"7377e78e-3c71-4fcb-918c-eb6c54e2d562","Type":"ContainerStarted","Data":"b74e7c32eed62f0474289eacb9d9a190c5adef7078aba349e932beea0c0ba3a9"} Jul 29 15:47:48.024617 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:48.024561 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-64nqz" event={"ID":"7377e78e-3c71-4fcb-918c-eb6c54e2d562","Type":"ContainerStarted","Data":"d0daa8892e62bf98e6409485955340480010a13b5960fcdf0deac434f532a9f4"} Jul 29 15:47:48.045613 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:48.045556 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-64nqz" podStartSLOduration=66.341975251 podStartE2EDuration="1m9.045536673s" totalImagesPullingTime="2.703561422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:46:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:48.045066502 +0000 UTC m=+69.889363982" watchObservedRunningTime="2026-07-29 15:47:48.045536673 +0000 UTC m=+69.889834149" Jul 29 15:47:48.148662 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:48.147297 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-vp5kv"] Jul 29 15:47:48.150510 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:48.149927 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-vp5kv" Jul 29 15:47:48.157339 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:48.157307 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 29 15:47:48.157486 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:48.157388 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 29 15:47:48.157635 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:48.157617 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 29 15:47:48.157719 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:48.157659 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 29 15:47:48.158096 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:48.157942 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-tl98k\"" Jul 29 15:47:48.158096 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:48.157942 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 29 15:47:48.178152 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:48.178004 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-vp5kv"] Jul 29 15:47:48.241145 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:48.240993 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d2ddt\"" Jul 29 15:47:48.246777 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:48.246509 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6tnpm" Jul 29 15:47:48.285370 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:48.285336 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/813b208d-e0f3-4eeb-8642-c619eea337a9-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-vp5kv\" (UID: \"813b208d-e0f3-4eeb-8642-c619eea337a9\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vp5kv" Jul 29 15:47:48.285548 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:48.285397 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/813b208d-e0f3-4eeb-8642-c619eea337a9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-vp5kv\" (UID: \"813b208d-e0f3-4eeb-8642-c619eea337a9\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vp5kv" Jul 29 15:47:48.285548 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:48.285481 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/813b208d-e0f3-4eeb-8642-c619eea337a9-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-vp5kv\" (UID: \"813b208d-e0f3-4eeb-8642-c619eea337a9\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vp5kv" Jul 29 15:47:48.285716 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:48.285588 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m56pb\" (UniqueName: \"kubernetes.io/projected/813b208d-e0f3-4eeb-8642-c619eea337a9-kube-api-access-m56pb\") pod \"prometheus-operator-84d69f794d-vp5kv\" (UID: \"813b208d-e0f3-4eeb-8642-c619eea337a9\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vp5kv" Jul 29 15:47:48.387085 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:48.386060 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m56pb\" (UniqueName: \"kubernetes.io/projected/813b208d-e0f3-4eeb-8642-c619eea337a9-kube-api-access-m56pb\") pod \"prometheus-operator-84d69f794d-vp5kv\" (UID: \"813b208d-e0f3-4eeb-8642-c619eea337a9\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vp5kv" Jul 29 15:47:48.387085 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:48.386186 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/813b208d-e0f3-4eeb-8642-c619eea337a9-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-vp5kv\" (UID: \"813b208d-e0f3-4eeb-8642-c619eea337a9\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vp5kv" Jul 29 15:47:48.387085 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:48.386220 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/813b208d-e0f3-4eeb-8642-c619eea337a9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-vp5kv\" (UID: \"813b208d-e0f3-4eeb-8642-c619eea337a9\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vp5kv" Jul 29 15:47:48.387085 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:48.386280 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/813b208d-e0f3-4eeb-8642-c619eea337a9-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-vp5kv\" (UID: \"813b208d-e0f3-4eeb-8642-c619eea337a9\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vp5kv" Jul 29 15:47:48.388305 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:48.388278 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/813b208d-e0f3-4eeb-8642-c619eea337a9-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-vp5kv\" (UID: \"813b208d-e0f3-4eeb-8642-c619eea337a9\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vp5kv" Jul 29 15:47:48.401431 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:48.401376 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/813b208d-e0f3-4eeb-8642-c619eea337a9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-vp5kv\" (UID: \"813b208d-e0f3-4eeb-8642-c619eea337a9\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vp5kv" Jul 29 15:47:48.402069 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:48.402043 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/813b208d-e0f3-4eeb-8642-c619eea337a9-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-vp5kv\" (UID: \"813b208d-e0f3-4eeb-8642-c619eea337a9\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vp5kv" Jul 29 15:47:48.403408 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:48.403365 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m56pb\" (UniqueName: \"kubernetes.io/projected/813b208d-e0f3-4eeb-8642-c619eea337a9-kube-api-access-m56pb\") pod \"prometheus-operator-84d69f794d-vp5kv\" (UID: \"813b208d-e0f3-4eeb-8642-c619eea337a9\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vp5kv" Jul 29 15:47:48.440245 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:48.440210 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6tnpm"] Jul 29 15:47:48.446087 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:47:48.446051 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47b0d5da_0f97_4139_a01a_cd41ed81f6f0.slice/crio-d88091e92758347c0533141bdcf3dca939fbd23fe771b0801f0d6029753d4697 WatchSource:0}: Error finding container d88091e92758347c0533141bdcf3dca939fbd23fe771b0801f0d6029753d4697: Status 404 returned error can't find the container with id d88091e92758347c0533141bdcf3dca939fbd23fe771b0801f0d6029753d4697 Jul 29 15:47:48.464095 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:48.463892 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-vp5kv" Jul 29 15:47:48.685868 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:48.685786 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-vp5kv"] Jul 29 15:47:48.688108 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:47:48.688081 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod813b208d_e0f3_4eeb_8642_c619eea337a9.slice/crio-9f4a8c35a7261a78823942a4d2eb6b0c17e21b0c95e7663249a72a04dd95a54d WatchSource:0}: Error finding container 9f4a8c35a7261a78823942a4d2eb6b0c17e21b0c95e7663249a72a04dd95a54d: Status 404 returned error can't find the container with id 9f4a8c35a7261a78823942a4d2eb6b0c17e21b0c95e7663249a72a04dd95a54d Jul 29 15:47:49.032215 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:49.032117 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6tnpm" event={"ID":"47b0d5da-0f97-4139-a01a-cd41ed81f6f0","Type":"ContainerStarted","Data":"d88091e92758347c0533141bdcf3dca939fbd23fe771b0801f0d6029753d4697"} Jul 29 15:47:49.036643 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:49.036136 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-vp5kv" event={"ID":"813b208d-e0f3-4eeb-8642-c619eea337a9","Type":"ContainerStarted","Data":"9f4a8c35a7261a78823942a4d2eb6b0c17e21b0c95e7663249a72a04dd95a54d"} Jul 29 15:47:51.106740 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:47:51.106481 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:48:02.993871 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:02.993756 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7cb5498d56-cr7sg" Jul 29 15:48:04.431323 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:04.431240 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fb876c6f4-flqrs"] Jul 29 15:48:05.108464 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:05.108409 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f5gvg" event={"ID":"77adaab3-405e-43d8-8dec-badf07ce38f2","Type":"ContainerStarted","Data":"8aefaf353fb1816a0d049578728bbafacbffcc06ccce7160b264b3d600dc8af5"} Jul 29 15:48:05.110231 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:05.110175 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6tnpm" event={"ID":"47b0d5da-0f97-4139-a01a-cd41ed81f6f0","Type":"ContainerStarted","Data":"bbb158e61bda5d1d6aa375060b2edefd78bfed321df8e65d15ee92300e75e923"} Jul 29 15:48:05.112566 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:05.111850 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-9q4n4" event={"ID":"d8900764-2321-4a76-bb67-e8b6fd8f0bd4","Type":"ContainerStarted","Data":"fe380e17f689fcc23835b5224782485f7bdf2a6f5dbc39860016b02eaf27a305"} Jul 29 15:48:05.112665 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:05.112655 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-9q4n4" Jul 29 15:48:05.114216 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:05.113977 2584 patch_prober.go:28] interesting pod/downloads-7c97dc4555-9q4n4 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.13:8080/\": dial tcp 10.133.0.13:8080: connect: connection refused" start-of-body= Jul 29 15:48:05.114216 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:05.114021 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7c97dc4555-9q4n4" podUID="d8900764-2321-4a76-bb67-e8b6fd8f0bd4" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.13:8080/\": dial tcp 10.133.0.13:8080: connect: connection refused" Jul 29 15:48:05.115123 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:05.115101 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rwvpj" event={"ID":"e7e55e83-cfda-4e11-8182-e93e305e78bb","Type":"ContainerStarted","Data":"b844614cdc52641da3f42a71e05a73b57d06286116c84f360f3542b577bf15f0"} Jul 29 15:48:05.115228 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:05.115216 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:48:05.116659 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:05.116633 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb876c6f4-flqrs" event={"ID":"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71","Type":"ContainerStarted","Data":"7a64ad9dec82f23b32e78d002cba920245abc9f4ca7bcb589a4a7128c7368aa7"} Jul 29 15:48:05.118580 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:05.118560 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-vp5kv" event={"ID":"813b208d-e0f3-4eeb-8642-c619eea337a9","Type":"ContainerStarted","Data":"8f34a83e9a50f59f6c13cfa65ca149e842a3b71b3acb66a15de1a7042f8922eb"} Jul 29 15:48:05.118676 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:05.118603 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-vp5kv" event={"ID":"813b208d-e0f3-4eeb-8642-c619eea337a9","Type":"ContainerStarted","Data":"84f8a71aff8d2befb02cc4d70d7fc97a7f4447cba9be370a636db5080e38bbd9"} Jul 29 15:48:05.129325 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:05.129285 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-f5gvg" podStartSLOduration=67.645202678 podStartE2EDuration="1m26.129273006s" totalImagesPullingTime="18.484070328s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:46:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:48:05.128715174 +0000 UTC m=+86.973012654" watchObservedRunningTime="2026-07-29 15:48:05.129273006 +0000 UTC m=+86.973570484" Jul 29 15:48:05.151674 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:05.151634 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-9q4n4" podStartSLOduration=1.034491095 podStartE2EDuration="24.151621672s" totalImagesPullingTime="23.117130577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:47:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:48:05.15020901 +0000 UTC m=+86.994506490" watchObservedRunningTime="2026-07-29 15:48:05.151621672 +0000 UTC m=+86.995919148" Jul 29 15:48:05.180933 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:05.180895 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fb876c6f4-flqrs" podStartSLOduration=2.517124744 podStartE2EDuration="20.180881553s" totalImagesPullingTime="17.663756809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:47:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:48:05.179510369 +0000 UTC m=+87.023807849" watchObservedRunningTime="2026-07-29 15:48:05.180881553 +0000 UTC m=+87.025179106" Jul 29 15:48:05.199931 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:05.199888 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rwvpj" podStartSLOduration=68.53570505 podStartE2EDuration="1m26.19987155s" totalImagesPullingTime="17.6641665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:46:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:48:05.199667625 +0000 UTC m=+87.043965106" watchObservedRunningTime="2026-07-29 15:48:05.19987155 +0000 UTC m=+87.044169029" Jul 29 15:48:05.222817 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:05.222777 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-vp5kv" podStartSLOduration=1.232389608 podStartE2EDuration="17.222759512s" totalImagesPullingTime="15.990369904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:47:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:48:05.2225265 +0000 UTC m=+87.066823980" watchObservedRunningTime="2026-07-29 15:48:05.222759512 +0000 UTC m=+87.067056992" Jul 29 15:48:06.002596 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:06.002560 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fb876c6f4-flqrs" Jul 29 15:48:06.117257 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:06.117184 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-76667dd646-gw5z4" podUID="24d9aedf-e77f-4e07-9495-cea45eb83a5c" containerName="registry" containerID="cri-o://b8021a5b51b2080fcd2c08870f66f2d880eee5597298d9c77c5307262ceb1b0f" gracePeriod=30 Jul 29 15:48:06.128027 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:06.128003 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-9q4n4" Jul 29 15:48:06.408058 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:06.408026 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:48:06.536279 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:06.536238 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-bound-sa-token\") pod \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " Jul 29 15:48:06.536577 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:06.536328 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/24d9aedf-e77f-4e07-9495-cea45eb83a5c-image-registry-private-configuration\") pod \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " Jul 29 15:48:06.536577 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:06.536365 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mstww\" (UniqueName: \"kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-kube-api-access-mstww\") pod \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " Jul 29 15:48:06.540370 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:06.536395 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24d9aedf-e77f-4e07-9495-cea45eb83a5c-trusted-ca\") pod \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " Jul 29 15:48:06.540370 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:06.536837 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/24d9aedf-e77f-4e07-9495-cea45eb83a5c-installation-pull-secrets\") pod \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " Jul 29 15:48:06.540370 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:06.536876 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-registry-tls\") pod \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " Jul 29 15:48:06.540370 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:06.536904 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/24d9aedf-e77f-4e07-9495-cea45eb83a5c-ca-trust-extracted\") pod \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " Jul 29 15:48:06.540370 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:06.536928 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/24d9aedf-e77f-4e07-9495-cea45eb83a5c-registry-certificates\") pod \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\" (UID: \"24d9aedf-e77f-4e07-9495-cea45eb83a5c\") " Jul 29 15:48:06.540370 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:06.537432 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24d9aedf-e77f-4e07-9495-cea45eb83a5c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "24d9aedf-e77f-4e07-9495-cea45eb83a5c" (UID: "24d9aedf-e77f-4e07-9495-cea45eb83a5c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:48:06.540370 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:06.537581 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24d9aedf-e77f-4e07-9495-cea45eb83a5c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "24d9aedf-e77f-4e07-9495-cea45eb83a5c" (UID: "24d9aedf-e77f-4e07-9495-cea45eb83a5c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:48:06.540766 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:06.540409 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24d9aedf-e77f-4e07-9495-cea45eb83a5c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "24d9aedf-e77f-4e07-9495-cea45eb83a5c" (UID: "24d9aedf-e77f-4e07-9495-cea45eb83a5c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:48:06.543304 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:06.543268 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24d9aedf-e77f-4e07-9495-cea45eb83a5c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "24d9aedf-e77f-4e07-9495-cea45eb83a5c" (UID: "24d9aedf-e77f-4e07-9495-cea45eb83a5c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:48:06.543403 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:06.543383 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "24d9aedf-e77f-4e07-9495-cea45eb83a5c" (UID: "24d9aedf-e77f-4e07-9495-cea45eb83a5c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:48:06.544368 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:06.544345 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "24d9aedf-e77f-4e07-9495-cea45eb83a5c" (UID: "24d9aedf-e77f-4e07-9495-cea45eb83a5c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:48:06.544496 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:06.544420 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-kube-api-access-mstww" (OuterVolumeSpecName: "kube-api-access-mstww") pod "24d9aedf-e77f-4e07-9495-cea45eb83a5c" (UID: "24d9aedf-e77f-4e07-9495-cea45eb83a5c"). InnerVolumeSpecName "kube-api-access-mstww". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:48:06.551551 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:06.551528 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24d9aedf-e77f-4e07-9495-cea45eb83a5c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "24d9aedf-e77f-4e07-9495-cea45eb83a5c" (UID: "24d9aedf-e77f-4e07-9495-cea45eb83a5c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:48:06.638234 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:06.638154 2584 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-registry-tls\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:48:06.638234 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:06.638188 2584 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/24d9aedf-e77f-4e07-9495-cea45eb83a5c-ca-trust-extracted\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:48:06.638234 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:06.638202 2584 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/24d9aedf-e77f-4e07-9495-cea45eb83a5c-registry-certificates\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:48:06.638234 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:06.638214 2584 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-bound-sa-token\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:48:06.638234 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:06.638228 2584 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/24d9aedf-e77f-4e07-9495-cea45eb83a5c-image-registry-private-configuration\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:48:06.638611 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:06.638241 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mstww\" (UniqueName: \"kubernetes.io/projected/24d9aedf-e77f-4e07-9495-cea45eb83a5c-kube-api-access-mstww\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:48:06.638611 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:06.638253 2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24d9aedf-e77f-4e07-9495-cea45eb83a5c-trusted-ca\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:48:06.638611 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:06.638265 2584 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/24d9aedf-e77f-4e07-9495-cea45eb83a5c-installation-pull-secrets\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:48:07.128861 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.128819 2584 generic.go:356] "Generic (PLEG): container finished" podID="24d9aedf-e77f-4e07-9495-cea45eb83a5c" containerID="b8021a5b51b2080fcd2c08870f66f2d880eee5597298d9c77c5307262ceb1b0f" exitCode=0 Jul 29 15:48:07.129504 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.129484 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76667dd646-gw5z4" Jul 29 15:48:07.129954 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.129685 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76667dd646-gw5z4" event={"ID":"24d9aedf-e77f-4e07-9495-cea45eb83a5c","Type":"ContainerDied","Data":"b8021a5b51b2080fcd2c08870f66f2d880eee5597298d9c77c5307262ceb1b0f"} Jul 29 15:48:07.129954 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.129808 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76667dd646-gw5z4" event={"ID":"24d9aedf-e77f-4e07-9495-cea45eb83a5c","Type":"ContainerDied","Data":"10360dc148a125b074b9ddfd0cb398c683026b3ac44b9bbee206573dc607ef6c"} Jul 29 15:48:07.129954 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.129837 2584 scope.go:117] "RemoveContainer" containerID="b8021a5b51b2080fcd2c08870f66f2d880eee5597298d9c77c5307262ceb1b0f" Jul 29 15:48:07.147846 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.147821 2584 scope.go:117] "RemoveContainer" containerID="b8021a5b51b2080fcd2c08870f66f2d880eee5597298d9c77c5307262ceb1b0f" Jul 29 15:48:07.148386 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:48:07.148354 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8021a5b51b2080fcd2c08870f66f2d880eee5597298d9c77c5307262ceb1b0f\": container with ID starting with b8021a5b51b2080fcd2c08870f66f2d880eee5597298d9c77c5307262ceb1b0f not found: ID does not exist" containerID="b8021a5b51b2080fcd2c08870f66f2d880eee5597298d9c77c5307262ceb1b0f" Jul 29 15:48:07.148499 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.148392 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8021a5b51b2080fcd2c08870f66f2d880eee5597298d9c77c5307262ceb1b0f"} err="failed to get container status \"b8021a5b51b2080fcd2c08870f66f2d880eee5597298d9c77c5307262ceb1b0f\": rpc error: code = NotFound desc = could not find container \"b8021a5b51b2080fcd2c08870f66f2d880eee5597298d9c77c5307262ceb1b0f\": container with ID starting with b8021a5b51b2080fcd2c08870f66f2d880eee5597298d9c77c5307262ceb1b0f not found: ID does not exist" Jul 29 15:48:07.149109 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.149070 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76667dd646-gw5z4"] Jul 29 15:48:07.152694 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.152647 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-76667dd646-gw5z4"] Jul 29 15:48:07.583958 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.583892 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-v2k6j"] Jul 29 15:48:07.584402 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.584209 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24d9aedf-e77f-4e07-9495-cea45eb83a5c" containerName="registry" Jul 29 15:48:07.584402 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.584230 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="24d9aedf-e77f-4e07-9495-cea45eb83a5c" containerName="registry" Jul 29 15:48:07.584402 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.584302 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="24d9aedf-e77f-4e07-9495-cea45eb83a5c" containerName="registry" Jul 29 15:48:07.613600 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.613575 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v2k6j" Jul 29 15:48:07.617366 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.617336 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 29 15:48:07.617660 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.617628 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 29 15:48:07.619533 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.619508 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 29 15:48:07.619869 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.619747 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sghl4\"" Jul 29 15:48:07.746413 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.746373 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2gvz\" (UniqueName: \"kubernetes.io/projected/ccbab069-b021-406e-acbc-a2380e67aa67-kube-api-access-m2gvz\") pod \"node-exporter-v2k6j\" (UID: \"ccbab069-b021-406e-acbc-a2380e67aa67\") " pod="openshift-monitoring/node-exporter-v2k6j" Jul 29 15:48:07.746621 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.746430 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ccbab069-b021-406e-acbc-a2380e67aa67-root\") pod \"node-exporter-v2k6j\" (UID: \"ccbab069-b021-406e-acbc-a2380e67aa67\") " pod="openshift-monitoring/node-exporter-v2k6j" Jul 29 15:48:07.746621 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.746510 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccbab069-b021-406e-acbc-a2380e67aa67-metrics-client-ca\") pod \"node-exporter-v2k6j\" (UID: \"ccbab069-b021-406e-acbc-a2380e67aa67\") " pod="openshift-monitoring/node-exporter-v2k6j" Jul 29 15:48:07.746621 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.746539 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ccbab069-b021-406e-acbc-a2380e67aa67-node-exporter-accelerators-collector-config\") pod \"node-exporter-v2k6j\" (UID: \"ccbab069-b021-406e-acbc-a2380e67aa67\") " pod="openshift-monitoring/node-exporter-v2k6j" Jul 29 15:48:07.746621 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.746573 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ccbab069-b021-406e-acbc-a2380e67aa67-node-exporter-wtmp\") pod \"node-exporter-v2k6j\" (UID: \"ccbab069-b021-406e-acbc-a2380e67aa67\") " pod="openshift-monitoring/node-exporter-v2k6j" Jul 29 15:48:07.746621 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.746604 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccbab069-b021-406e-acbc-a2380e67aa67-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v2k6j\" (UID: \"ccbab069-b021-406e-acbc-a2380e67aa67\") " pod="openshift-monitoring/node-exporter-v2k6j" Jul 29 15:48:07.746876 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.746641 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccbab069-b021-406e-acbc-a2380e67aa67-sys\") pod \"node-exporter-v2k6j\" (UID: \"ccbab069-b021-406e-acbc-a2380e67aa67\") " pod="openshift-monitoring/node-exporter-v2k6j" Jul 29 15:48:07.746876 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.746668 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ccbab069-b021-406e-acbc-a2380e67aa67-node-exporter-textfile\") pod \"node-exporter-v2k6j\" (UID: \"ccbab069-b021-406e-acbc-a2380e67aa67\") " pod="openshift-monitoring/node-exporter-v2k6j" Jul 29 15:48:07.746876 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.746705 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ccbab069-b021-406e-acbc-a2380e67aa67-node-exporter-tls\") pod \"node-exporter-v2k6j\" (UID: \"ccbab069-b021-406e-acbc-a2380e67aa67\") " pod="openshift-monitoring/node-exporter-v2k6j" Jul 29 15:48:07.847939 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.847857 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccbab069-b021-406e-acbc-a2380e67aa67-sys\") pod \"node-exporter-v2k6j\" (UID: \"ccbab069-b021-406e-acbc-a2380e67aa67\") " pod="openshift-monitoring/node-exporter-v2k6j" Jul 29 15:48:07.847939 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.847904 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ccbab069-b021-406e-acbc-a2380e67aa67-node-exporter-textfile\") pod \"node-exporter-v2k6j\" (UID: \"ccbab069-b021-406e-acbc-a2380e67aa67\") " pod="openshift-monitoring/node-exporter-v2k6j" Jul 29 15:48:07.848248 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.847954 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ccbab069-b021-406e-acbc-a2380e67aa67-node-exporter-tls\") pod \"node-exporter-v2k6j\" (UID: \"ccbab069-b021-406e-acbc-a2380e67aa67\") " pod="openshift-monitoring/node-exporter-v2k6j" Jul 29 15:48:07.848248 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.847986 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2gvz\" (UniqueName: \"kubernetes.io/projected/ccbab069-b021-406e-acbc-a2380e67aa67-kube-api-access-m2gvz\") pod \"node-exporter-v2k6j\" (UID: \"ccbab069-b021-406e-acbc-a2380e67aa67\") " pod="openshift-monitoring/node-exporter-v2k6j" Jul 29 15:48:07.848248 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.848018 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ccbab069-b021-406e-acbc-a2380e67aa67-root\") pod \"node-exporter-v2k6j\" (UID: \"ccbab069-b021-406e-acbc-a2380e67aa67\") " pod="openshift-monitoring/node-exporter-v2k6j" Jul 29 15:48:07.848248 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.848045 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccbab069-b021-406e-acbc-a2380e67aa67-metrics-client-ca\") pod \"node-exporter-v2k6j\" (UID: \"ccbab069-b021-406e-acbc-a2380e67aa67\") " pod="openshift-monitoring/node-exporter-v2k6j" Jul 29 15:48:07.848248 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.848071 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ccbab069-b021-406e-acbc-a2380e67aa67-node-exporter-accelerators-collector-config\") pod \"node-exporter-v2k6j\" (UID: \"ccbab069-b021-406e-acbc-a2380e67aa67\") " pod="openshift-monitoring/node-exporter-v2k6j" Jul 29 15:48:07.848248 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.848116 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ccbab069-b021-406e-acbc-a2380e67aa67-node-exporter-wtmp\") pod \"node-exporter-v2k6j\" (UID: \"ccbab069-b021-406e-acbc-a2380e67aa67\") " pod="openshift-monitoring/node-exporter-v2k6j" Jul 29 15:48:07.848248 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.848158 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccbab069-b021-406e-acbc-a2380e67aa67-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v2k6j\" (UID: \"ccbab069-b021-406e-acbc-a2380e67aa67\") " pod="openshift-monitoring/node-exporter-v2k6j" Jul 29 15:48:07.848609 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.848515 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccbab069-b021-406e-acbc-a2380e67aa67-sys\") pod \"node-exporter-v2k6j\" (UID: \"ccbab069-b021-406e-acbc-a2380e67aa67\") " pod="openshift-monitoring/node-exporter-v2k6j" Jul 29 15:48:07.849521 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.848793 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ccbab069-b021-406e-acbc-a2380e67aa67-node-exporter-wtmp\") pod \"node-exporter-v2k6j\" (UID: \"ccbab069-b021-406e-acbc-a2380e67aa67\") " pod="openshift-monitoring/node-exporter-v2k6j" Jul 29 15:48:07.849521 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.849119 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ccbab069-b021-406e-acbc-a2380e67aa67-root\") pod \"node-exporter-v2k6j\" (UID: \"ccbab069-b021-406e-acbc-a2380e67aa67\") " pod="openshift-monitoring/node-exporter-v2k6j" Jul 29 15:48:07.849521 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.849463 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccbab069-b021-406e-acbc-a2380e67aa67-metrics-client-ca\") pod \"node-exporter-v2k6j\" (UID: \"ccbab069-b021-406e-acbc-a2380e67aa67\") " pod="openshift-monitoring/node-exporter-v2k6j" Jul 29 15:48:07.850254 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.850094 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ccbab069-b021-406e-acbc-a2380e67aa67-node-exporter-accelerators-collector-config\") pod \"node-exporter-v2k6j\" (UID: \"ccbab069-b021-406e-acbc-a2380e67aa67\") " pod="openshift-monitoring/node-exporter-v2k6j" Jul 29 15:48:07.850254 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.850218 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ccbab069-b021-406e-acbc-a2380e67aa67-node-exporter-textfile\") pod \"node-exporter-v2k6j\" (UID: \"ccbab069-b021-406e-acbc-a2380e67aa67\") " pod="openshift-monitoring/node-exporter-v2k6j" Jul 29 15:48:07.851220 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.851164 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccbab069-b021-406e-acbc-a2380e67aa67-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v2k6j\" (UID: \"ccbab069-b021-406e-acbc-a2380e67aa67\") " pod="openshift-monitoring/node-exporter-v2k6j" Jul 29 15:48:07.851332 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.851224 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ccbab069-b021-406e-acbc-a2380e67aa67-node-exporter-tls\") pod \"node-exporter-v2k6j\" (UID: \"ccbab069-b021-406e-acbc-a2380e67aa67\") " pod="openshift-monitoring/node-exporter-v2k6j" Jul 29 15:48:07.869221 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.869200 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2gvz\" (UniqueName: \"kubernetes.io/projected/ccbab069-b021-406e-acbc-a2380e67aa67-kube-api-access-m2gvz\") pod \"node-exporter-v2k6j\" (UID: \"ccbab069-b021-406e-acbc-a2380e67aa67\") " pod="openshift-monitoring/node-exporter-v2k6j" Jul 29 15:48:07.927693 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:07.927660 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v2k6j" Jul 29 15:48:08.608096 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.608057 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 15:48:08.660274 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.660234 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 15:48:08.660555 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.660508 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.663854 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.663607 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 29 15:48:08.663854 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.663685 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hsckv\"" Jul 29 15:48:08.663854 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.663707 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 29 15:48:08.664098 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.663944 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 29 15:48:08.664098 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.663982 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 29 15:48:08.664362 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.664344 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 29 15:48:08.664362 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.664355 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 29 15:48:08.664538 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.664427 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 29 15:48:08.664609 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.664593 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 29 15:48:08.664812 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.664798 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 29 15:48:08.727776 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.727742 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24d9aedf-e77f-4e07-9495-cea45eb83a5c" path="/var/lib/kubelet/pods/24d9aedf-e77f-4e07-9495-cea45eb83a5c/volumes" Jul 29 15:48:08.760190 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.760067 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.760190 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.760108 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-config-volume\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.760190 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.760177 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-web-config\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.760509 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.760231 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.760509 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.760328 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.760509 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.760366 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.760509 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.760410 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.760509 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.760493 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.760749 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.760521 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-config-out\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.760749 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.760546 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k9r4\" (UniqueName: \"kubernetes.io/projected/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-kube-api-access-8k9r4\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.760749 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.760579 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.760749 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.760649 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.760749 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.760698 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.861562 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.861484 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.861562 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.861527 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.861845 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.861564 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.861845 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.861602 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.861845 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.861622 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-config-out\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.861845 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.861645 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k9r4\" (UniqueName: \"kubernetes.io/projected/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-kube-api-access-8k9r4\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.861845 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.861673 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.861845 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.861708 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.861845 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.861754 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.861845 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.861784 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.861845 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.861809 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-config-volume\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.861845 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.861832 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-web-config\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.862328 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.861874 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.863567 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.863540 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.863925 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.863898 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.864122 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.864096 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.870975 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.867055 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.870975 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.868053 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-config-out\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.870975 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.869379 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-web-config\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.870975 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.869730 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.871305 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.871248 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.875791 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.875763 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.876260 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.876234 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.876351 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.876310 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k9r4\" (UniqueName: \"kubernetes.io/projected/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-kube-api-access-8k9r4\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.876406 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.876376 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-config-volume\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.877393 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.877373 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:08.975048 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:08.975018 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:09.606873 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.606843 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5c75994844-84vcx"] Jul 29 15:48:09.636257 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.636224 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5c75994844-84vcx"] Jul 29 15:48:09.636700 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.636385 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" Jul 29 15:48:09.640467 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.639589 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6a0bgrajrdvi7\"" Jul 29 15:48:09.640467 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.639681 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 29 15:48:09.640467 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.639704 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 29 15:48:09.640467 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.640141 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 29 15:48:09.640734 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.640581 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 29 15:48:09.640734 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.640725 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 29 15:48:09.643648 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.640918 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-99m4h\"" Jul 29 15:48:09.770525 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.770490 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c61d7238-7ce5-4ecd-b5db-88d237d63d70-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c75994844-84vcx\" (UID: \"c61d7238-7ce5-4ecd-b5db-88d237d63d70\") " pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" Jul 29 15:48:09.770775 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.770542 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c61d7238-7ce5-4ecd-b5db-88d237d63d70-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c75994844-84vcx\" (UID: \"c61d7238-7ce5-4ecd-b5db-88d237d63d70\") " pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" Jul 29 15:48:09.770775 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.770574 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74gck\" (UniqueName: \"kubernetes.io/projected/c61d7238-7ce5-4ecd-b5db-88d237d63d70-kube-api-access-74gck\") pod \"thanos-querier-5c75994844-84vcx\" (UID: \"c61d7238-7ce5-4ecd-b5db-88d237d63d70\") " pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" Jul 29 15:48:09.770775 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.770600 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c61d7238-7ce5-4ecd-b5db-88d237d63d70-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c75994844-84vcx\" (UID: \"c61d7238-7ce5-4ecd-b5db-88d237d63d70\") " pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" Jul 29 15:48:09.770775 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.770633 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c61d7238-7ce5-4ecd-b5db-88d237d63d70-metrics-client-ca\") pod \"thanos-querier-5c75994844-84vcx\" (UID: \"c61d7238-7ce5-4ecd-b5db-88d237d63d70\") " pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" Jul 29 15:48:09.770775 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.770660 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c61d7238-7ce5-4ecd-b5db-88d237d63d70-secret-thanos-querier-tls\") pod \"thanos-querier-5c75994844-84vcx\" (UID: \"c61d7238-7ce5-4ecd-b5db-88d237d63d70\") " pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" Jul 29 15:48:09.771078 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.770793 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c61d7238-7ce5-4ecd-b5db-88d237d63d70-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c75994844-84vcx\" (UID: \"c61d7238-7ce5-4ecd-b5db-88d237d63d70\") " pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" Jul 29 15:48:09.771078 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.770823 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c61d7238-7ce5-4ecd-b5db-88d237d63d70-secret-grpc-tls\") pod \"thanos-querier-5c75994844-84vcx\" (UID: \"c61d7238-7ce5-4ecd-b5db-88d237d63d70\") " pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" Jul 29 15:48:09.871999 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.871929 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c61d7238-7ce5-4ecd-b5db-88d237d63d70-metrics-client-ca\") pod \"thanos-querier-5c75994844-84vcx\" (UID: \"c61d7238-7ce5-4ecd-b5db-88d237d63d70\") " pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" Jul 29 15:48:09.871999 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.871982 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c61d7238-7ce5-4ecd-b5db-88d237d63d70-secret-thanos-querier-tls\") pod \"thanos-querier-5c75994844-84vcx\" (UID: \"c61d7238-7ce5-4ecd-b5db-88d237d63d70\") " pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" Jul 29 15:48:09.872269 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.872142 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c61d7238-7ce5-4ecd-b5db-88d237d63d70-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c75994844-84vcx\" (UID: \"c61d7238-7ce5-4ecd-b5db-88d237d63d70\") " pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" Jul 29 15:48:09.872269 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.872209 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c61d7238-7ce5-4ecd-b5db-88d237d63d70-secret-grpc-tls\") pod \"thanos-querier-5c75994844-84vcx\" (UID: \"c61d7238-7ce5-4ecd-b5db-88d237d63d70\") " pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" Jul 29 15:48:09.872403 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.872308 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c61d7238-7ce5-4ecd-b5db-88d237d63d70-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c75994844-84vcx\" (UID: \"c61d7238-7ce5-4ecd-b5db-88d237d63d70\") " pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" Jul 29 15:48:09.872403 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.872359 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c61d7238-7ce5-4ecd-b5db-88d237d63d70-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c75994844-84vcx\" (UID: \"c61d7238-7ce5-4ecd-b5db-88d237d63d70\") " pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" Jul 29 15:48:09.872601 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.872392 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74gck\" (UniqueName: \"kubernetes.io/projected/c61d7238-7ce5-4ecd-b5db-88d237d63d70-kube-api-access-74gck\") pod \"thanos-querier-5c75994844-84vcx\" (UID: \"c61d7238-7ce5-4ecd-b5db-88d237d63d70\") " pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" Jul 29 15:48:09.872601 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.872477 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c61d7238-7ce5-4ecd-b5db-88d237d63d70-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c75994844-84vcx\" (UID: \"c61d7238-7ce5-4ecd-b5db-88d237d63d70\") " pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" Jul 29 15:48:09.872971 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.872922 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c61d7238-7ce5-4ecd-b5db-88d237d63d70-metrics-client-ca\") pod \"thanos-querier-5c75994844-84vcx\" (UID: \"c61d7238-7ce5-4ecd-b5db-88d237d63d70\") " pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" Jul 29 15:48:09.876472 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.875637 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c61d7238-7ce5-4ecd-b5db-88d237d63d70-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c75994844-84vcx\" (UID: \"c61d7238-7ce5-4ecd-b5db-88d237d63d70\") " pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" Jul 29 15:48:09.876472 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.876077 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c61d7238-7ce5-4ecd-b5db-88d237d63d70-secret-thanos-querier-tls\") pod \"thanos-querier-5c75994844-84vcx\" (UID: \"c61d7238-7ce5-4ecd-b5db-88d237d63d70\") " pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" Jul 29 15:48:09.876472 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.876188 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c61d7238-7ce5-4ecd-b5db-88d237d63d70-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c75994844-84vcx\" (UID: \"c61d7238-7ce5-4ecd-b5db-88d237d63d70\") " pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" Jul 29 15:48:09.876472 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.876408 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c61d7238-7ce5-4ecd-b5db-88d237d63d70-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c75994844-84vcx\" (UID: \"c61d7238-7ce5-4ecd-b5db-88d237d63d70\") " pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" Jul 29 15:48:09.878828 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.878403 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c61d7238-7ce5-4ecd-b5db-88d237d63d70-secret-grpc-tls\") pod \"thanos-querier-5c75994844-84vcx\" (UID: \"c61d7238-7ce5-4ecd-b5db-88d237d63d70\") " pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" Jul 29 15:48:09.878828 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.878784 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c61d7238-7ce5-4ecd-b5db-88d237d63d70-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c75994844-84vcx\" (UID: \"c61d7238-7ce5-4ecd-b5db-88d237d63d70\") " pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" Jul 29 15:48:09.883923 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.883902 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74gck\" (UniqueName: \"kubernetes.io/projected/c61d7238-7ce5-4ecd-b5db-88d237d63d70-kube-api-access-74gck\") pod \"thanos-querier-5c75994844-84vcx\" (UID: \"c61d7238-7ce5-4ecd-b5db-88d237d63d70\") " pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" Jul 29 15:48:09.953568 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:09.953538 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" Jul 29 15:48:10.716160 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:10.716136 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 15:48:10.718654 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:48:10.718626 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dd38e52_b5ea_41ff_8e13_b6cf4c1b6210.slice/crio-51e8375fb9f3ecdf3df0c0614df38766ba561273c4f6df47f92b793f6ee5f508 WatchSource:0}: Error finding container 51e8375fb9f3ecdf3df0c0614df38766ba561273c4f6df47f92b793f6ee5f508: Status 404 returned error can't find the container with id 51e8375fb9f3ecdf3df0c0614df38766ba561273c4f6df47f92b793f6ee5f508 Jul 29 15:48:10.735673 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:10.735657 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5c75994844-84vcx"] Jul 29 15:48:10.737783 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:48:10.737723 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc61d7238_7ce5_4ecd_b5db_88d237d63d70.slice/crio-d4a2fe1dd04e9810fad53dfb10b9a6f64bdadc2ab45471a816cf8466ebc4b964 WatchSource:0}: Error finding container d4a2fe1dd04e9810fad53dfb10b9a6f64bdadc2ab45471a816cf8466ebc4b964: Status 404 returned error can't find the container with id d4a2fe1dd04e9810fad53dfb10b9a6f64bdadc2ab45471a816cf8466ebc4b964 Jul 29 15:48:11.148359 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:11.148325 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" event={"ID":"c61d7238-7ce5-4ecd-b5db-88d237d63d70","Type":"ContainerStarted","Data":"d4a2fe1dd04e9810fad53dfb10b9a6f64bdadc2ab45471a816cf8466ebc4b964"} Jul 29 15:48:11.149801 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:11.149774 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v2k6j" event={"ID":"ccbab069-b021-406e-acbc-a2380e67aa67","Type":"ContainerStarted","Data":"1a7ff6df5bb0e00f5735e0e576951f0fb2bacc597976975bd5fea188f0caa64c"} Jul 29 15:48:11.151152 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:11.151123 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210","Type":"ContainerStarted","Data":"51e8375fb9f3ecdf3df0c0614df38766ba561273c4f6df47f92b793f6ee5f508"} Jul 29 15:48:11.153099 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:11.153073 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6tnpm" event={"ID":"47b0d5da-0f97-4139-a01a-cd41ed81f6f0","Type":"ContainerStarted","Data":"400f4f209b188cd4fc12ef46cfb5c862b62203f9a4b2df29f0b7d6b684f12dc7"} Jul 29 15:48:13.842289 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.842142 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 15:48:13.868883 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.868849 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 15:48:13.869054 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.869014 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:13.872325 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.872231 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 29 15:48:13.872528 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.872513 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 29 15:48:13.872780 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.872708 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 29 15:48:13.872960 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.872939 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2hm71hs70ke3u\"" Jul 29 15:48:13.873181 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.873142 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 29 15:48:13.873653 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.873630 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 29 15:48:13.873800 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.873780 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-j5nbd\"" Jul 29 15:48:13.874023 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.873993 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 29 15:48:13.874489 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.874466 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 29 15:48:13.874769 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.874751 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 29 15:48:13.879215 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.876317 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 29 15:48:13.879215 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.876469 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 29 15:48:13.879215 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.876323 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 29 15:48:13.879215 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.876562 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 29 15:48:13.879215 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.876647 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 29 15:48:13.879215 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.876871 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 29 15:48:13.883920 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.883744 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 29 15:48:13.916103 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.916070 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:13.916228 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.916111 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:13.916228 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.916162 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlnq8\" (UniqueName: \"kubernetes.io/projected/b9188423-43a6-49bc-a099-86cb74579158-kube-api-access-zlnq8\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:13.916228 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.916185 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b9188423-43a6-49bc-a099-86cb74579158-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:13.916228 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.916219 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:13.916404 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.916257 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:13.916404 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.916280 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:13.916404 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.916308 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-config\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:13.916404 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.916331 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:13.916404 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.916354 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:13.916678 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.916497 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9188423-43a6-49bc-a099-86cb74579158-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:13.916678 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.916534 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:13.916678 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.916601 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:13.916678 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.916627 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:13.916678 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.916651 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:13.916678 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.916676 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:13.916954 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.916701 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:13.916954 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.916726 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:13.916954 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.916761 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-web-config\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:13.916954 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:13.916788 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9188423-43a6-49bc-a099-86cb74579158-config-out\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.017741 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.017714 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.017741 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.017746 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.017980 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.017769 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.017980 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.017797 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-web-config\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.017980 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.017826 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9188423-43a6-49bc-a099-86cb74579158-config-out\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.017980 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.017861 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.017980 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.017885 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.017980 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.017920 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlnq8\" (UniqueName: \"kubernetes.io/projected/b9188423-43a6-49bc-a099-86cb74579158-kube-api-access-zlnq8\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.017980 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.017946 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b9188423-43a6-49bc-a099-86cb74579158-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.017980 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.017976 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.018384 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.018006 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.018384 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.018029 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.018384 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.018056 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-config\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.018384 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.018081 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.018384 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.018105 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.018384 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.018146 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9188423-43a6-49bc-a099-86cb74579158-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.018384 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.018166 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.018384 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.018201 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.018384 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.018230 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.018384 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.018254 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.018920 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.018499 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.018920 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.018529 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.018920 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.018543 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.019695 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.019666 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b9188423-43a6-49bc-a099-86cb74579158-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.020677 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.020653 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.021008 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.020987 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.023900 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.022421 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.023900 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.022526 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.024208 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.024173 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.024357 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.024333 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.024897 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.024858 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.025126 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.025081 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-web-config\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.025432 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.025406 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.025432 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.025430 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9188423-43a6-49bc-a099-86cb74579158-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.025704 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.025675 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9188423-43a6-49bc-a099-86cb74579158-config-out\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.025829 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.025810 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-config\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.026463 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.026064 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.026463 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.026212 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.027067 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.027045 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.029131 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.029106 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlnq8\" (UniqueName: \"kubernetes.io/projected/b9188423-43a6-49bc-a099-86cb74579158-kube-api-access-zlnq8\") pod \"prometheus-k8s-0\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:14.186329 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:14.186298 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:16.302823 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:16.302797 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 15:48:16.313375 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:48:16.313346 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9188423_43a6_49bc_a099_86cb74579158.slice/crio-2c6494481e146e791d51e1559ccb6626b7b9b359f45c1e7fc12ccf0e68b08f2e WatchSource:0}: Error finding container 2c6494481e146e791d51e1559ccb6626b7b9b359f45c1e7fc12ccf0e68b08f2e: Status 404 returned error can't find the container with id 2c6494481e146e791d51e1559ccb6626b7b9b359f45c1e7fc12ccf0e68b08f2e Jul 29 15:48:17.186327 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:17.186296 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6tnpm" event={"ID":"47b0d5da-0f97-4139-a01a-cd41ed81f6f0","Type":"ContainerStarted","Data":"124e0892c65c9c8a8e943240123165de848dbe80682d1e256cc7508136ff3daf"} Jul 29 15:48:17.188378 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:17.188355 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" event={"ID":"c61d7238-7ce5-4ecd-b5db-88d237d63d70","Type":"ContainerStarted","Data":"620c6b982dd21dc90a45fa87e62b540682e0ab66abfa19faea9a523a9764f6dd"} Jul 29 15:48:17.188499 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:17.188413 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" event={"ID":"c61d7238-7ce5-4ecd-b5db-88d237d63d70","Type":"ContainerStarted","Data":"a60d205107b0f8d00b4b5a86124e49a13af225f78e3d1262b9e1d936612bbd89"} Jul 29 15:48:17.188499 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:17.188463 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" event={"ID":"c61d7238-7ce5-4ecd-b5db-88d237d63d70","Type":"ContainerStarted","Data":"22f77f1d75ca252c654d5e5ffb2b6d73d169a56b7b83be3d42ea629c0c8a0f8f"} Jul 29 15:48:17.189661 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:17.189642 2584 generic.go:356] "Generic (PLEG): container finished" podID="b9188423-43a6-49bc-a099-86cb74579158" containerID="2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828" exitCode=0 Jul 29 15:48:17.189757 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:17.189715 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9188423-43a6-49bc-a099-86cb74579158","Type":"ContainerDied","Data":"2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828"} Jul 29 15:48:17.189820 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:17.189763 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9188423-43a6-49bc-a099-86cb74579158","Type":"ContainerStarted","Data":"2c6494481e146e791d51e1559ccb6626b7b9b359f45c1e7fc12ccf0e68b08f2e"} Jul 29 15:48:17.191332 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:17.191227 2584 generic.go:356] "Generic (PLEG): container finished" podID="ccbab069-b021-406e-acbc-a2380e67aa67" containerID="82a2dd9f2a0175764ce50169262f985c212863a1ee84163f2e55457b44c0e075" exitCode=0 Jul 29 15:48:17.191332 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:17.191312 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v2k6j" event={"ID":"ccbab069-b021-406e-acbc-a2380e67aa67","Type":"ContainerDied","Data":"82a2dd9f2a0175764ce50169262f985c212863a1ee84163f2e55457b44c0e075"} Jul 29 15:48:17.192979 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:17.192957 2584 generic.go:356] "Generic (PLEG): container finished" podID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerID="df5da648ac9b254933c1a21975ed76022f365b0301dbf1336b2e0f51f576a173" exitCode=0 Jul 29 15:48:17.193065 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:17.192997 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210","Type":"ContainerDied","Data":"df5da648ac9b254933c1a21975ed76022f365b0301dbf1336b2e0f51f576a173"} Jul 29 15:48:17.221802 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:17.221759 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6tnpm" podStartSLOduration=33.298556887 podStartE2EDuration="1m1.221742129s" totalImagesPullingTime="27.923185242s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:47:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:48:17.218597034 +0000 UTC m=+99.062894512" watchObservedRunningTime="2026-07-29 15:48:17.221742129 +0000 UTC m=+99.066039606" Jul 29 15:48:18.203421 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:18.203012 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v2k6j" event={"ID":"ccbab069-b021-406e-acbc-a2380e67aa67","Type":"ContainerStarted","Data":"1ee41f8d2163d154871ff8ae4485500bd1955e46f30f23043b9edf032b0ab919"} Jul 29 15:48:18.203421 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:18.203072 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v2k6j" event={"ID":"ccbab069-b021-406e-acbc-a2380e67aa67","Type":"ContainerStarted","Data":"4982798eaac9b491efb101f6ec707136fc6f25d7eb2cc0b14c862e64ea7c6a2a"} Jul 29 15:48:18.206725 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:18.206597 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" event={"ID":"c61d7238-7ce5-4ecd-b5db-88d237d63d70","Type":"ContainerStarted","Data":"cfa8b8164b1a5780eea429935261016225ddecdeef7be1ae29d908e8cb2431ad"} Jul 29 15:48:18.206725 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:18.206668 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" event={"ID":"c61d7238-7ce5-4ecd-b5db-88d237d63d70","Type":"ContainerStarted","Data":"38fb0180fd9423e635165c5f8d84a7e617843712979835e2248cddc903a8f682"} Jul 29 15:48:18.226456 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:18.226381 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-v2k6j" podStartSLOduration=5.541043776 podStartE2EDuration="11.226361856s" totalImagesPullingTime="5.595843073s" totalInitContainerRuntime="89.475007ms" isStatefulPod=true podCreationTimestamp="2026-07-29 15:48:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:48:18.223772973 +0000 UTC m=+100.068070454" watchObservedRunningTime="2026-07-29 15:48:18.226361856 +0000 UTC m=+100.070659337" Jul 29 15:48:19.215030 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:19.214974 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" event={"ID":"c61d7238-7ce5-4ecd-b5db-88d237d63d70","Type":"ContainerStarted","Data":"cc63623c14e9c4c8899ebb3ffcd5ab8dead902f391888b5fdc01b8686d44b79a"} Jul 29 15:48:19.240547 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:19.240493 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" podStartSLOduration=3.709378112 podStartE2EDuration="10.240467002s" totalImagesPullingTime="6.53108889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:48:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:48:19.238224529 +0000 UTC m=+101.082522009" watchObservedRunningTime="2026-07-29 15:48:19.240467002 +0000 UTC m=+101.084764482" Jul 29 15:48:20.219992 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:20.219950 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" Jul 29 15:48:21.236206 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:21.236169 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210","Type":"ContainerStarted","Data":"7631a2b62d74bae047e377ccbc926c23f496f1f7408ed5ce3d4bb40bb049d443"} Jul 29 15:48:21.236587 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:21.236260 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210","Type":"ContainerStarted","Data":"5853ad976cf43877936288455b94f358392125d9b0f0a32d191b84572c7c1dd2"} Jul 29 15:48:21.236587 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:21.236309 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210","Type":"ContainerStarted","Data":"27ba22c3cfc1bb1a53592c1658e9b0efb8be8e58a9bc0ba4492eb16ee00ecc9b"} Jul 29 15:48:21.240477 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:21.240353 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9188423-43a6-49bc-a099-86cb74579158","Type":"ContainerStarted","Data":"6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3"} Jul 29 15:48:21.256362 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:21.255513 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5c75994844-84vcx" Jul 29 15:48:22.246257 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:22.246218 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9188423-43a6-49bc-a099-86cb74579158","Type":"ContainerStarted","Data":"6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736"} Jul 29 15:48:22.246766 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:22.246296 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9188423-43a6-49bc-a099-86cb74579158","Type":"ContainerStarted","Data":"0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e"} Jul 29 15:48:22.246766 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:22.246332 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9188423-43a6-49bc-a099-86cb74579158","Type":"ContainerStarted","Data":"446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57"} Jul 29 15:48:22.246766 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:22.246357 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9188423-43a6-49bc-a099-86cb74579158","Type":"ContainerStarted","Data":"e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110"} Jul 29 15:48:22.246766 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:22.246387 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9188423-43a6-49bc-a099-86cb74579158","Type":"ContainerStarted","Data":"763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055"} Jul 29 15:48:22.249422 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:22.249395 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210","Type":"ContainerStarted","Data":"13537d428da7b253893ef3931726014a74085e7fcf9e0a933081340f78185071"} Jul 29 15:48:22.249543 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:22.249474 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210","Type":"ContainerStarted","Data":"78016ad4ce1e5b67783d3f1e99e602e34475ff7235e19bc5dc128c0adee4b532"} Jul 29 15:48:22.249543 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:22.249501 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210","Type":"ContainerStarted","Data":"700cf6894b7178b8fc219f9681d9a613f5e758d5784b01eb64050ef639edd186"} Jul 29 15:48:22.278194 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:22.278146 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.457670439 podStartE2EDuration="9.278131526s" totalImagesPullingTime="3.797518356s" totalInitContainerRuntime="22.942731ms" isStatefulPod=false podCreationTimestamp="2026-07-29 15:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:48:22.276588798 +0000 UTC m=+104.120886300" watchObservedRunningTime="2026-07-29 15:48:22.278131526 +0000 UTC m=+104.122429004" Jul 29 15:48:22.305534 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:22.305489 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.442444038 podStartE2EDuration="14.305474676s" totalImagesPullingTime="8.857363491s" totalInitContainerRuntime="5.667147ms" isStatefulPod=false podCreationTimestamp="2026-07-29 15:48:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:48:22.303912771 +0000 UTC m=+104.148210253" watchObservedRunningTime="2026-07-29 15:48:22.305474676 +0000 UTC m=+104.149772155" Jul 29 15:48:24.187358 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:24.187314 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:30.137040 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:30.136971 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-fb876c6f4-flqrs" podUID="bfa5d991-357c-4cef-a6f3-5a59cc1b7f71" containerName="console" containerID="cri-o://7a64ad9dec82f23b32e78d002cba920245abc9f4ca7bcb589a4a7128c7368aa7" gracePeriod=15 Jul 29 15:48:30.285087 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:30.285062 2584 generic.go:356] "Generic (PLEG): container finished" podID="bfa5d991-357c-4cef-a6f3-5a59cc1b7f71" containerID="7a64ad9dec82f23b32e78d002cba920245abc9f4ca7bcb589a4a7128c7368aa7" exitCode=0 Jul 29 15:48:30.285192 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:30.285107 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb876c6f4-flqrs" event={"ID":"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71","Type":"ContainerDied","Data":"7a64ad9dec82f23b32e78d002cba920245abc9f4ca7bcb589a4a7128c7368aa7"} Jul 29 15:48:30.426390 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:30.426367 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb876c6f4-flqrs" Jul 29 15:48:30.569359 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:30.569336 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-console-serving-cert\") pod \"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71\" (UID: \"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71\") " Jul 29 15:48:30.569493 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:30.569378 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26sv8\" (UniqueName: \"kubernetes.io/projected/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-kube-api-access-26sv8\") pod \"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71\" (UID: \"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71\") " Jul 29 15:48:30.569493 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:30.569425 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-console-oauth-config\") pod \"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71\" (UID: \"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71\") " Jul 29 15:48:30.569493 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:30.569486 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-oauth-serving-cert\") pod \"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71\" (UID: \"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71\") " Jul 29 15:48:30.569662 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:30.569518 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-service-ca\") pod \"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71\" (UID: \"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71\") " Jul 29 15:48:30.569662 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:30.569538 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-console-config\") pod \"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71\" (UID: \"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71\") " Jul 29 15:48:30.569922 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:30.569893 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bfa5d991-357c-4cef-a6f3-5a59cc1b7f71" (UID: "bfa5d991-357c-4cef-a6f3-5a59cc1b7f71"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:48:30.569922 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:30.569909 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-service-ca" (OuterVolumeSpecName: "service-ca") pod "bfa5d991-357c-4cef-a6f3-5a59cc1b7f71" (UID: "bfa5d991-357c-4cef-a6f3-5a59cc1b7f71"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:48:30.570071 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:30.569975 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-console-config" (OuterVolumeSpecName: "console-config") pod "bfa5d991-357c-4cef-a6f3-5a59cc1b7f71" (UID: "bfa5d991-357c-4cef-a6f3-5a59cc1b7f71"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:48:30.571901 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:30.571880 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bfa5d991-357c-4cef-a6f3-5a59cc1b7f71" (UID: "bfa5d991-357c-4cef-a6f3-5a59cc1b7f71"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:48:30.572000 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:30.571967 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bfa5d991-357c-4cef-a6f3-5a59cc1b7f71" (UID: "bfa5d991-357c-4cef-a6f3-5a59cc1b7f71"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:48:30.572000 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:30.571974 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-kube-api-access-26sv8" (OuterVolumeSpecName: "kube-api-access-26sv8") pod "bfa5d991-357c-4cef-a6f3-5a59cc1b7f71" (UID: "bfa5d991-357c-4cef-a6f3-5a59cc1b7f71"). InnerVolumeSpecName "kube-api-access-26sv8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:48:30.670832 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:30.670803 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26sv8\" (UniqueName: \"kubernetes.io/projected/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-kube-api-access-26sv8\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:48:30.670832 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:30.670831 2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-console-oauth-config\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:48:30.670832 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:30.670844 2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-oauth-serving-cert\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:48:30.671065 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:30.670856 2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-service-ca\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:48:30.671065 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:30.670869 2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-console-config\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:48:30.671065 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:30.670879 2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71-console-serving-cert\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:48:31.289905 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:31.289864 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb876c6f4-flqrs" event={"ID":"bfa5d991-357c-4cef-a6f3-5a59cc1b7f71","Type":"ContainerDied","Data":"ce3f1f8fad417e3814a6a073029895939e0ead78be0ff5bac3d6d05dd02af18a"} Jul 29 15:48:31.289905 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:31.289899 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb876c6f4-flqrs" Jul 29 15:48:31.290365 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:31.289946 2584 scope.go:117] "RemoveContainer" containerID="7a64ad9dec82f23b32e78d002cba920245abc9f4ca7bcb589a4a7128c7368aa7" Jul 29 15:48:31.307186 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:31.307163 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fb876c6f4-flqrs"] Jul 29 15:48:31.310932 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:31.310912 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fb876c6f4-flqrs"] Jul 29 15:48:32.726508 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:32.726469 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfa5d991-357c-4cef-a6f3-5a59cc1b7f71" path="/var/lib/kubelet/pods/bfa5d991-357c-4cef-a6f3-5a59cc1b7f71/volumes" Jul 29 15:48:36.124454 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:48:36.124405 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rwvpj" Jul 29 15:49:14.187503 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:14.187433 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:14.207019 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:14.206992 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:14.472772 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:14.472702 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:27.841548 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:27.841515 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 15:49:27.841945 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:27.841800 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerName="alertmanager" containerID="cri-o://27ba22c3cfc1bb1a53592c1658e9b0efb8be8e58a9bc0ba4492eb16ee00ecc9b" gracePeriod=120 Jul 29 15:49:27.841945 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:27.841881 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerName="kube-rbac-proxy-web" containerID="cri-o://7631a2b62d74bae047e377ccbc926c23f496f1f7408ed5ce3d4bb40bb049d443" gracePeriod=120 Jul 29 15:49:27.841945 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:27.841869 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerName="kube-rbac-proxy-metric" containerID="cri-o://78016ad4ce1e5b67783d3f1e99e602e34475ff7235e19bc5dc128c0adee4b532" gracePeriod=120 Jul 29 15:49:27.841945 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:27.841912 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerName="config-reloader" containerID="cri-o://5853ad976cf43877936288455b94f358392125d9b0f0a32d191b84572c7c1dd2" gracePeriod=120 Jul 29 15:49:27.842150 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:27.841957 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerName="prom-label-proxy" containerID="cri-o://13537d428da7b253893ef3931726014a74085e7fcf9e0a933081340f78185071" gracePeriod=120 Jul 29 15:49:27.842150 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:27.841916 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerName="kube-rbac-proxy" containerID="cri-o://700cf6894b7178b8fc219f9681d9a613f5e758d5784b01eb64050ef639edd186" gracePeriod=120 Jul 29 15:49:28.512149 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:28.512112 2584 generic.go:356] "Generic (PLEG): container finished" podID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerID="13537d428da7b253893ef3931726014a74085e7fcf9e0a933081340f78185071" exitCode=0 Jul 29 15:49:28.512149 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:28.512135 2584 generic.go:356] "Generic (PLEG): container finished" podID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerID="78016ad4ce1e5b67783d3f1e99e602e34475ff7235e19bc5dc128c0adee4b532" exitCode=0 Jul 29 15:49:28.512149 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:28.512142 2584 generic.go:356] "Generic (PLEG): container finished" podID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerID="700cf6894b7178b8fc219f9681d9a613f5e758d5784b01eb64050ef639edd186" exitCode=0 Jul 29 15:49:28.512149 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:28.512150 2584 generic.go:356] "Generic (PLEG): container finished" podID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerID="5853ad976cf43877936288455b94f358392125d9b0f0a32d191b84572c7c1dd2" exitCode=0 Jul 29 15:49:28.512149 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:28.512156 2584 generic.go:356] "Generic (PLEG): container finished" podID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerID="27ba22c3cfc1bb1a53592c1658e9b0efb8be8e58a9bc0ba4492eb16ee00ecc9b" exitCode=0 Jul 29 15:49:28.512429 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:28.512183 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210","Type":"ContainerDied","Data":"13537d428da7b253893ef3931726014a74085e7fcf9e0a933081340f78185071"} Jul 29 15:49:28.512429 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:28.512248 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210","Type":"ContainerDied","Data":"78016ad4ce1e5b67783d3f1e99e602e34475ff7235e19bc5dc128c0adee4b532"} Jul 29 15:49:28.512429 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:28.512275 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210","Type":"ContainerDied","Data":"700cf6894b7178b8fc219f9681d9a613f5e758d5784b01eb64050ef639edd186"} Jul 29 15:49:28.512429 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:28.512298 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210","Type":"ContainerDied","Data":"5853ad976cf43877936288455b94f358392125d9b0f0a32d191b84572c7c1dd2"} Jul 29 15:49:28.512429 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:28.512321 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210","Type":"ContainerDied","Data":"27ba22c3cfc1bb1a53592c1658e9b0efb8be8e58a9bc0ba4492eb16ee00ecc9b"} Jul 29 15:49:29.090904 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.090881 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.218271 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.218190 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-alertmanager-trusted-ca-bundle\") pod \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " Jul 29 15:49:29.218271 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.218225 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-config-out\") pod \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " Jul 29 15:49:29.218271 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.218246 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-secret-alertmanager-kube-rbac-proxy\") pod \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " Jul 29 15:49:29.218271 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.218264 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8k9r4\" (UniqueName: \"kubernetes.io/projected/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-kube-api-access-8k9r4\") pod \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " Jul 29 15:49:29.218612 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.218287 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-cluster-tls-config\") pod \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " Jul 29 15:49:29.218612 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.218326 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-tls-assets\") pod \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " Jul 29 15:49:29.218612 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.218365 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-secret-alertmanager-main-tls\") pod \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " Jul 29 15:49:29.218612 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.218392 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-secret-alertmanager-kube-rbac-proxy-metric\") pod \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " Jul 29 15:49:29.218612 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.218421 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-secret-alertmanager-kube-rbac-proxy-web\") pod \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " Jul 29 15:49:29.218612 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.218468 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-alertmanager-main-db\") pod \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " Jul 29 15:49:29.218612 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.218496 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-web-config\") pod \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " Jul 29 15:49:29.218612 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.218523 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-config-volume\") pod \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " Jul 29 15:49:29.218612 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.218554 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-metrics-client-ca\") pod \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\" (UID: \"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210\") " Jul 29 15:49:29.219019 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.218679 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" (UID: "7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:49:29.219019 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.218913 2584 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:29.219019 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.218995 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" (UID: "7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:49:29.219373 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.219341 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" (UID: "7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:49:29.221477 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.221354 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-config-out" (OuterVolumeSpecName: "config-out") pod "7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" (UID: "7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:49:29.221477 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.221448 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" (UID: "7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:49:29.221735 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.221704 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" (UID: "7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:49:29.221798 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.221730 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" (UID: "7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:49:29.221842 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.221792 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-kube-api-access-8k9r4" (OuterVolumeSpecName: "kube-api-access-8k9r4") pod "7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" (UID: "7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210"). InnerVolumeSpecName "kube-api-access-8k9r4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:49:29.221842 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.221821 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" (UID: "7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:49:29.221842 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.221823 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" (UID: "7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:49:29.222218 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.222196 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-config-volume" (OuterVolumeSpecName: "config-volume") pod "7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" (UID: "7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:49:29.225971 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.225937 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" (UID: "7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:49:29.231974 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.231955 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-web-config" (OuterVolumeSpecName: "web-config") pod "7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" (UID: "7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:49:29.319467 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.319424 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8k9r4\" (UniqueName: \"kubernetes.io/projected/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-kube-api-access-8k9r4\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:29.319467 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.319463 2584 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-cluster-tls-config\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:29.319579 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.319473 2584 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-tls-assets\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:29.319579 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.319482 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-secret-alertmanager-main-tls\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:29.319579 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.319491 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:29.319579 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.319500 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:29.319579 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.319508 2584 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-alertmanager-main-db\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:29.319579 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.319536 2584 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-web-config\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:29.319579 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.319544 2584 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-config-volume\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:29.319579 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.319552 2584 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-metrics-client-ca\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:29.319579 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.319559 2584 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-config-out\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:29.319579 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.319568 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:29.518736 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.518662 2584 generic.go:356] "Generic (PLEG): container finished" podID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerID="7631a2b62d74bae047e377ccbc926c23f496f1f7408ed5ce3d4bb40bb049d443" exitCode=0 Jul 29 15:49:29.518736 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.518712 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210","Type":"ContainerDied","Data":"7631a2b62d74bae047e377ccbc926c23f496f1f7408ed5ce3d4bb40bb049d443"} Jul 29 15:49:29.518889 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.518743 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.518889 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.518791 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210","Type":"ContainerDied","Data":"51e8375fb9f3ecdf3df0c0614df38766ba561273c4f6df47f92b793f6ee5f508"} Jul 29 15:49:29.518889 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.518824 2584 scope.go:117] "RemoveContainer" containerID="13537d428da7b253893ef3931726014a74085e7fcf9e0a933081340f78185071" Jul 29 15:49:29.526740 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.526572 2584 scope.go:117] "RemoveContainer" containerID="78016ad4ce1e5b67783d3f1e99e602e34475ff7235e19bc5dc128c0adee4b532" Jul 29 15:49:29.534320 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.534303 2584 scope.go:117] "RemoveContainer" containerID="700cf6894b7178b8fc219f9681d9a613f5e758d5784b01eb64050ef639edd186" Jul 29 15:49:29.540758 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.540734 2584 scope.go:117] "RemoveContainer" containerID="7631a2b62d74bae047e377ccbc926c23f496f1f7408ed5ce3d4bb40bb049d443" Jul 29 15:49:29.544922 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.544904 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 15:49:29.548586 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.548563 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 15:49:29.551605 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.551348 2584 scope.go:117] "RemoveContainer" containerID="5853ad976cf43877936288455b94f358392125d9b0f0a32d191b84572c7c1dd2" Jul 29 15:49:29.559214 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.559198 2584 scope.go:117] "RemoveContainer" containerID="27ba22c3cfc1bb1a53592c1658e9b0efb8be8e58a9bc0ba4492eb16ee00ecc9b" Jul 29 15:49:29.565811 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.565793 2584 scope.go:117] "RemoveContainer" containerID="df5da648ac9b254933c1a21975ed76022f365b0301dbf1336b2e0f51f576a173" Jul 29 15:49:29.573583 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.573567 2584 scope.go:117] "RemoveContainer" containerID="13537d428da7b253893ef3931726014a74085e7fcf9e0a933081340f78185071" Jul 29 15:49:29.573833 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:49:29.573809 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13537d428da7b253893ef3931726014a74085e7fcf9e0a933081340f78185071\": container with ID starting with 13537d428da7b253893ef3931726014a74085e7fcf9e0a933081340f78185071 not found: ID does not exist" containerID="13537d428da7b253893ef3931726014a74085e7fcf9e0a933081340f78185071" Jul 29 15:49:29.573917 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.573839 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13537d428da7b253893ef3931726014a74085e7fcf9e0a933081340f78185071"} err="failed to get container status \"13537d428da7b253893ef3931726014a74085e7fcf9e0a933081340f78185071\": rpc error: code = NotFound desc = could not find container \"13537d428da7b253893ef3931726014a74085e7fcf9e0a933081340f78185071\": container with ID starting with 13537d428da7b253893ef3931726014a74085e7fcf9e0a933081340f78185071 not found: ID does not exist" Jul 29 15:49:29.573917 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.573858 2584 scope.go:117] "RemoveContainer" containerID="78016ad4ce1e5b67783d3f1e99e602e34475ff7235e19bc5dc128c0adee4b532" Jul 29 15:49:29.574118 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:49:29.574103 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78016ad4ce1e5b67783d3f1e99e602e34475ff7235e19bc5dc128c0adee4b532\": container with ID starting with 78016ad4ce1e5b67783d3f1e99e602e34475ff7235e19bc5dc128c0adee4b532 not found: ID does not exist" containerID="78016ad4ce1e5b67783d3f1e99e602e34475ff7235e19bc5dc128c0adee4b532" Jul 29 15:49:29.574167 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.574121 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78016ad4ce1e5b67783d3f1e99e602e34475ff7235e19bc5dc128c0adee4b532"} err="failed to get container status \"78016ad4ce1e5b67783d3f1e99e602e34475ff7235e19bc5dc128c0adee4b532\": rpc error: code = NotFound desc = could not find container \"78016ad4ce1e5b67783d3f1e99e602e34475ff7235e19bc5dc128c0adee4b532\": container with ID starting with 78016ad4ce1e5b67783d3f1e99e602e34475ff7235e19bc5dc128c0adee4b532 not found: ID does not exist" Jul 29 15:49:29.574167 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.574134 2584 scope.go:117] "RemoveContainer" containerID="700cf6894b7178b8fc219f9681d9a613f5e758d5784b01eb64050ef639edd186" Jul 29 15:49:29.574362 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:49:29.574348 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"700cf6894b7178b8fc219f9681d9a613f5e758d5784b01eb64050ef639edd186\": container with ID starting with 700cf6894b7178b8fc219f9681d9a613f5e758d5784b01eb64050ef639edd186 not found: ID does not exist" containerID="700cf6894b7178b8fc219f9681d9a613f5e758d5784b01eb64050ef639edd186" Jul 29 15:49:29.574398 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.574373 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"700cf6894b7178b8fc219f9681d9a613f5e758d5784b01eb64050ef639edd186"} err="failed to get container status \"700cf6894b7178b8fc219f9681d9a613f5e758d5784b01eb64050ef639edd186\": rpc error: code = NotFound desc = could not find container \"700cf6894b7178b8fc219f9681d9a613f5e758d5784b01eb64050ef639edd186\": container with ID starting with 700cf6894b7178b8fc219f9681d9a613f5e758d5784b01eb64050ef639edd186 not found: ID does not exist" Jul 29 15:49:29.574398 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.574386 2584 scope.go:117] "RemoveContainer" containerID="7631a2b62d74bae047e377ccbc926c23f496f1f7408ed5ce3d4bb40bb049d443" Jul 29 15:49:29.574624 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:49:29.574610 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7631a2b62d74bae047e377ccbc926c23f496f1f7408ed5ce3d4bb40bb049d443\": container with ID starting with 7631a2b62d74bae047e377ccbc926c23f496f1f7408ed5ce3d4bb40bb049d443 not found: ID does not exist" containerID="7631a2b62d74bae047e377ccbc926c23f496f1f7408ed5ce3d4bb40bb049d443" Jul 29 15:49:29.574681 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.574627 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7631a2b62d74bae047e377ccbc926c23f496f1f7408ed5ce3d4bb40bb049d443"} err="failed to get container status \"7631a2b62d74bae047e377ccbc926c23f496f1f7408ed5ce3d4bb40bb049d443\": rpc error: code = NotFound desc = could not find container \"7631a2b62d74bae047e377ccbc926c23f496f1f7408ed5ce3d4bb40bb049d443\": container with ID starting with 7631a2b62d74bae047e377ccbc926c23f496f1f7408ed5ce3d4bb40bb049d443 not found: ID does not exist" Jul 29 15:49:29.574681 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.574640 2584 scope.go:117] "RemoveContainer" containerID="5853ad976cf43877936288455b94f358392125d9b0f0a32d191b84572c7c1dd2" Jul 29 15:49:29.574842 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:49:29.574827 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5853ad976cf43877936288455b94f358392125d9b0f0a32d191b84572c7c1dd2\": container with ID starting with 5853ad976cf43877936288455b94f358392125d9b0f0a32d191b84572c7c1dd2 not found: ID does not exist" containerID="5853ad976cf43877936288455b94f358392125d9b0f0a32d191b84572c7c1dd2" Jul 29 15:49:29.574882 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.574845 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5853ad976cf43877936288455b94f358392125d9b0f0a32d191b84572c7c1dd2"} err="failed to get container status \"5853ad976cf43877936288455b94f358392125d9b0f0a32d191b84572c7c1dd2\": rpc error: code = NotFound desc = could not find container \"5853ad976cf43877936288455b94f358392125d9b0f0a32d191b84572c7c1dd2\": container with ID starting with 5853ad976cf43877936288455b94f358392125d9b0f0a32d191b84572c7c1dd2 not found: ID does not exist" Jul 29 15:49:29.574882 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.574857 2584 scope.go:117] "RemoveContainer" containerID="27ba22c3cfc1bb1a53592c1658e9b0efb8be8e58a9bc0ba4492eb16ee00ecc9b" Jul 29 15:49:29.575074 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:49:29.575058 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27ba22c3cfc1bb1a53592c1658e9b0efb8be8e58a9bc0ba4492eb16ee00ecc9b\": container with ID starting with 27ba22c3cfc1bb1a53592c1658e9b0efb8be8e58a9bc0ba4492eb16ee00ecc9b not found: ID does not exist" containerID="27ba22c3cfc1bb1a53592c1658e9b0efb8be8e58a9bc0ba4492eb16ee00ecc9b" Jul 29 15:49:29.575129 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.575077 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ba22c3cfc1bb1a53592c1658e9b0efb8be8e58a9bc0ba4492eb16ee00ecc9b"} err="failed to get container status \"27ba22c3cfc1bb1a53592c1658e9b0efb8be8e58a9bc0ba4492eb16ee00ecc9b\": rpc error: code = NotFound desc = could not find container \"27ba22c3cfc1bb1a53592c1658e9b0efb8be8e58a9bc0ba4492eb16ee00ecc9b\": container with ID starting with 27ba22c3cfc1bb1a53592c1658e9b0efb8be8e58a9bc0ba4492eb16ee00ecc9b not found: ID does not exist" Jul 29 15:49:29.575129 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.575088 2584 scope.go:117] "RemoveContainer" containerID="df5da648ac9b254933c1a21975ed76022f365b0301dbf1336b2e0f51f576a173" Jul 29 15:49:29.575276 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:49:29.575261 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df5da648ac9b254933c1a21975ed76022f365b0301dbf1336b2e0f51f576a173\": container with ID starting with df5da648ac9b254933c1a21975ed76022f365b0301dbf1336b2e0f51f576a173 not found: ID does not exist" containerID="df5da648ac9b254933c1a21975ed76022f365b0301dbf1336b2e0f51f576a173" Jul 29 15:49:29.575318 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.575279 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df5da648ac9b254933c1a21975ed76022f365b0301dbf1336b2e0f51f576a173"} err="failed to get container status \"df5da648ac9b254933c1a21975ed76022f365b0301dbf1336b2e0f51f576a173\": rpc error: code = NotFound desc = could not find container \"df5da648ac9b254933c1a21975ed76022f365b0301dbf1336b2e0f51f576a173\": container with ID starting with df5da648ac9b254933c1a21975ed76022f365b0301dbf1336b2e0f51f576a173 not found: ID does not exist" Jul 29 15:49:29.578311 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.578293 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 15:49:29.578611 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.578598 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfa5d991-357c-4cef-a6f3-5a59cc1b7f71" containerName="console" Jul 29 15:49:29.578657 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.578613 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfa5d991-357c-4cef-a6f3-5a59cc1b7f71" containerName="console" Jul 29 15:49:29.578657 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.578621 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerName="kube-rbac-proxy" Jul 29 15:49:29.578657 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.578626 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerName="kube-rbac-proxy" Jul 29 15:49:29.578657 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.578633 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerName="kube-rbac-proxy-metric" Jul 29 15:49:29.578657 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.578640 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerName="kube-rbac-proxy-metric" Jul 29 15:49:29.578657 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.578647 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerName="config-reloader" Jul 29 15:49:29.578657 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.578652 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerName="config-reloader" Jul 29 15:49:29.578851 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.578660 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerName="init-config-reloader" Jul 29 15:49:29.578851 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.578666 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerName="init-config-reloader" Jul 29 15:49:29.578851 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.578672 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerName="alertmanager" Jul 29 15:49:29.578851 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.578677 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerName="alertmanager" Jul 29 15:49:29.578851 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.578690 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerName="kube-rbac-proxy-web" Jul 29 15:49:29.578851 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.578695 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerName="kube-rbac-proxy-web" Jul 29 15:49:29.578851 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.578702 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerName="prom-label-proxy" Jul 29 15:49:29.578851 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.578706 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerName="prom-label-proxy" Jul 29 15:49:29.578851 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.578748 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerName="config-reloader" Jul 29 15:49:29.578851 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.578757 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerName="kube-rbac-proxy" Jul 29 15:49:29.578851 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.578764 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerName="kube-rbac-proxy-metric" Jul 29 15:49:29.578851 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.578769 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerName="prom-label-proxy" Jul 29 15:49:29.578851 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.578774 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerName="alertmanager" Jul 29 15:49:29.578851 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.578780 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" containerName="kube-rbac-proxy-web" Jul 29 15:49:29.578851 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.578785 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfa5d991-357c-4cef-a6f3-5a59cc1b7f71" containerName="console" Jul 29 15:49:29.582421 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.582402 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.585372 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.585355 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 29 15:49:29.585491 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.585405 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 29 15:49:29.585491 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.585416 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 29 15:49:29.585604 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.585506 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 29 15:49:29.585604 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.585356 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 29 15:49:29.585884 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.585771 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hsckv\"" Jul 29 15:49:29.585884 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.585784 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 29 15:49:29.585884 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.585819 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 29 15:49:29.586046 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.585893 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 29 15:49:29.591553 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.591534 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 29 15:49:29.598177 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.598159 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 15:49:29.721829 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.721803 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/384ee368-3867-4897-8374-284b28166f55-config-volume\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.721829 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.721830 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/384ee368-3867-4897-8374-284b28166f55-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.721988 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.721864 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/384ee368-3867-4897-8374-284b28166f55-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.722040 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.721986 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/384ee368-3867-4897-8374-284b28166f55-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.722091 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.722067 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/384ee368-3867-4897-8374-284b28166f55-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.722130 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.722118 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l9zd\" (UniqueName: \"kubernetes.io/projected/384ee368-3867-4897-8374-284b28166f55-kube-api-access-4l9zd\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.722166 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.722150 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/384ee368-3867-4897-8374-284b28166f55-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.722205 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.722177 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/384ee368-3867-4897-8374-284b28166f55-config-out\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.722250 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.722222 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/384ee368-3867-4897-8374-284b28166f55-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.722344 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.722250 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/384ee368-3867-4897-8374-284b28166f55-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.722344 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.722283 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/384ee368-3867-4897-8374-284b28166f55-web-config\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.722344 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.722304 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/384ee368-3867-4897-8374-284b28166f55-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.722344 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.722322 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/384ee368-3867-4897-8374-284b28166f55-tls-assets\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.823301 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.823238 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/384ee368-3867-4897-8374-284b28166f55-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.823301 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.823272 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/384ee368-3867-4897-8374-284b28166f55-tls-assets\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.823500 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.823325 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/384ee368-3867-4897-8374-284b28166f55-config-volume\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.823500 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.823349 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/384ee368-3867-4897-8374-284b28166f55-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.823500 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.823384 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/384ee368-3867-4897-8374-284b28166f55-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.823500 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.823418 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/384ee368-3867-4897-8374-284b28166f55-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.823500 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.823481 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/384ee368-3867-4897-8374-284b28166f55-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.823748 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.823525 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l9zd\" (UniqueName: \"kubernetes.io/projected/384ee368-3867-4897-8374-284b28166f55-kube-api-access-4l9zd\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.823748 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.823555 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/384ee368-3867-4897-8374-284b28166f55-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.823748 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.823597 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/384ee368-3867-4897-8374-284b28166f55-config-out\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.823748 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.823662 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/384ee368-3867-4897-8374-284b28166f55-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.823748 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.823687 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/384ee368-3867-4897-8374-284b28166f55-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.823748 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.823729 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/384ee368-3867-4897-8374-284b28166f55-web-config\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.824032 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.823820 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/384ee368-3867-4897-8374-284b28166f55-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.826198 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.826167 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/384ee368-3867-4897-8374-284b28166f55-tls-assets\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.826301 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.826247 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/384ee368-3867-4897-8374-284b28166f55-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.826368 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.826294 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/384ee368-3867-4897-8374-284b28166f55-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.826453 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.826415 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/384ee368-3867-4897-8374-284b28166f55-web-config\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.826569 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.826548 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/384ee368-3867-4897-8374-284b28166f55-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.826723 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.826703 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/384ee368-3867-4897-8374-284b28166f55-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.826808 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.826731 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/384ee368-3867-4897-8374-284b28166f55-config-out\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.827016 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.826996 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/384ee368-3867-4897-8374-284b28166f55-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.827093 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.827028 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/384ee368-3867-4897-8374-284b28166f55-config-volume\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.827129 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.827090 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/384ee368-3867-4897-8374-284b28166f55-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.828339 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.828314 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/384ee368-3867-4897-8374-284b28166f55-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.832477 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.832461 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l9zd\" (UniqueName: \"kubernetes.io/projected/384ee368-3867-4897-8374-284b28166f55-kube-api-access-4l9zd\") pod \"alertmanager-main-0\" (UID: \"384ee368-3867-4897-8374-284b28166f55\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:29.893366 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:29.893346 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:49:30.026854 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:30.026831 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 15:49:30.028828 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:49:30.028802 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod384ee368_3867_4897_8374_284b28166f55.slice/crio-5fc177c435b9bde5a70f7be6a2e9e89566b1e4ef418dcb7624fa16aa6f74c5e2 WatchSource:0}: Error finding container 5fc177c435b9bde5a70f7be6a2e9e89566b1e4ef418dcb7624fa16aa6f74c5e2: Status 404 returned error can't find the container with id 5fc177c435b9bde5a70f7be6a2e9e89566b1e4ef418dcb7624fa16aa6f74c5e2 Jul 29 15:49:30.524277 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:30.524243 2584 generic.go:356] "Generic (PLEG): container finished" podID="384ee368-3867-4897-8374-284b28166f55" containerID="5693f3a13919c15b073260634c5b7796377164c793cf0b39039a78ab95d407be" exitCode=0 Jul 29 15:49:30.524631 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:30.524308 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"384ee368-3867-4897-8374-284b28166f55","Type":"ContainerDied","Data":"5693f3a13919c15b073260634c5b7796377164c793cf0b39039a78ab95d407be"} Jul 29 15:49:30.524631 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:30.524379 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"384ee368-3867-4897-8374-284b28166f55","Type":"ContainerStarted","Data":"5fc177c435b9bde5a70f7be6a2e9e89566b1e4ef418dcb7624fa16aa6f74c5e2"} Jul 29 15:49:30.732047 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:30.732017 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210" path="/var/lib/kubelet/pods/7dd38e52-b5ea-41ff-8e13-b6cf4c1b6210/volumes" Jul 29 15:49:31.531721 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:31.531688 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"384ee368-3867-4897-8374-284b28166f55","Type":"ContainerStarted","Data":"5cb8c8f60cc0e386c69c263fa54c3559c387b7627b2883e22e754686e2a862d9"} Jul 29 15:49:31.532155 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:31.531763 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"384ee368-3867-4897-8374-284b28166f55","Type":"ContainerStarted","Data":"16361f563d8e6f4b9b36cca68abc514dede92af941dc86868222a15108dc4b6a"} Jul 29 15:49:31.532155 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:31.531835 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"384ee368-3867-4897-8374-284b28166f55","Type":"ContainerStarted","Data":"867ae841f3d6615fa2d3aa23530a7c65053f221aad70435fe7116efb4874d672"} Jul 29 15:49:31.532155 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:31.531877 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"384ee368-3867-4897-8374-284b28166f55","Type":"ContainerStarted","Data":"88744ad572ea048e8a5669c6df27275d88883533df9831c6b46ce75a94a2374e"} Jul 29 15:49:31.532155 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:31.531920 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"384ee368-3867-4897-8374-284b28166f55","Type":"ContainerStarted","Data":"93d46ec9a052996000b1912b5e82344046a8e3b209d31ebae04423404f1a156a"} Jul 29 15:49:31.532155 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:31.531966 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"384ee368-3867-4897-8374-284b28166f55","Type":"ContainerStarted","Data":"398676e07248627a639b4fad1ac5972a52db4c9c1caa791bcbe73f97e067fe43"} Jul 29 15:49:31.567132 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:31.567085 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.546006121 podStartE2EDuration="2.567071101s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.06498ms" isStatefulPod=false podCreationTimestamp="2026-07-29 15:49:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:49:31.564192061 +0000 UTC m=+173.408489540" watchObservedRunningTime="2026-07-29 15:49:31.567071101 +0000 UTC m=+173.411368579" Jul 29 15:49:32.137913 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.137880 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 15:49:32.138413 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.138246 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b9188423-43a6-49bc-a099-86cb74579158" containerName="prometheus" containerID="cri-o://6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3" gracePeriod=600 Jul 29 15:49:32.138413 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.138283 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b9188423-43a6-49bc-a099-86cb74579158" containerName="kube-rbac-proxy-thanos" containerID="cri-o://6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736" gracePeriod=600 Jul 29 15:49:32.138413 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.138283 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b9188423-43a6-49bc-a099-86cb74579158" containerName="thanos-sidecar" containerID="cri-o://e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110" gracePeriod=600 Jul 29 15:49:32.138413 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.138297 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b9188423-43a6-49bc-a099-86cb74579158" containerName="kube-rbac-proxy" containerID="cri-o://0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e" gracePeriod=600 Jul 29 15:49:32.138413 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.138283 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b9188423-43a6-49bc-a099-86cb74579158" containerName="kube-rbac-proxy-web" containerID="cri-o://446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57" gracePeriod=600 Jul 29 15:49:32.138763 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.138549 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b9188423-43a6-49bc-a099-86cb74579158" containerName="config-reloader" containerID="cri-o://763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055" gracePeriod=600 Jul 29 15:49:32.392367 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.392315 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.449130 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.449106 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-config\") pod \"b9188423-43a6-49bc-a099-86cb74579158\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " Jul 29 15:49:32.449273 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.449147 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9188423-43a6-49bc-a099-86cb74579158-tls-assets\") pod \"b9188423-43a6-49bc-a099-86cb74579158\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " Jul 29 15:49:32.449273 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.449176 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-prometheus-k8s-rulefiles-1\") pod \"b9188423-43a6-49bc-a099-86cb74579158\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " Jul 29 15:49:32.449273 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.449205 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b9188423-43a6-49bc-a099-86cb74579158-prometheus-k8s-db\") pod \"b9188423-43a6-49bc-a099-86cb74579158\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " Jul 29 15:49:32.449425 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.449320 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"b9188423-43a6-49bc-a099-86cb74579158\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " Jul 29 15:49:32.449425 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.449367 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-grpc-tls\") pod \"b9188423-43a6-49bc-a099-86cb74579158\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " Jul 29 15:49:32.449425 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.449398 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-metrics-client-certs\") pod \"b9188423-43a6-49bc-a099-86cb74579158\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " Jul 29 15:49:32.449605 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.449433 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9188423-43a6-49bc-a099-86cb74579158-config-out\") pod \"b9188423-43a6-49bc-a099-86cb74579158\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " Jul 29 15:49:32.449605 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.449479 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-web-config\") pod \"b9188423-43a6-49bc-a099-86cb74579158\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " Jul 29 15:49:32.449605 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.449511 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlnq8\" (UniqueName: \"kubernetes.io/projected/b9188423-43a6-49bc-a099-86cb74579158-kube-api-access-zlnq8\") pod \"b9188423-43a6-49bc-a099-86cb74579158\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " Jul 29 15:49:32.449605 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.449544 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-configmap-kubelet-serving-ca-bundle\") pod \"b9188423-43a6-49bc-a099-86cb74579158\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " Jul 29 15:49:32.449605 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.449573 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "b9188423-43a6-49bc-a099-86cb74579158" (UID: "b9188423-43a6-49bc-a099-86cb74579158"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:49:32.449605 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.449582 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-kube-rbac-proxy\") pod \"b9188423-43a6-49bc-a099-86cb74579158\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " Jul 29 15:49:32.449887 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.449642 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-prometheus-k8s-tls\") pod \"b9188423-43a6-49bc-a099-86cb74579158\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " Jul 29 15:49:32.449887 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.449691 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-configmap-serving-certs-ca-bundle\") pod \"b9188423-43a6-49bc-a099-86cb74579158\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " Jul 29 15:49:32.449887 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.449723 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-configmap-metrics-client-ca\") pod \"b9188423-43a6-49bc-a099-86cb74579158\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " Jul 29 15:49:32.449887 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.449773 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-prometheus-k8s-rulefiles-0\") pod \"b9188423-43a6-49bc-a099-86cb74579158\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " Jul 29 15:49:32.449887 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.449802 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-prometheus-trusted-ca-bundle\") pod \"b9188423-43a6-49bc-a099-86cb74579158\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " Jul 29 15:49:32.449887 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.449830 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"b9188423-43a6-49bc-a099-86cb74579158\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " Jul 29 15:49:32.449887 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.449864 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-thanos-prometheus-http-client-file\") pod \"b9188423-43a6-49bc-a099-86cb74579158\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " Jul 29 15:49:32.450219 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.449898 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-prometheus-k8s-rulefiles-2\") pod \"b9188423-43a6-49bc-a099-86cb74579158\" (UID: \"b9188423-43a6-49bc-a099-86cb74579158\") " Jul 29 15:49:32.450219 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.450181 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:32.450599 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.450306 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9188423-43a6-49bc-a099-86cb74579158-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "b9188423-43a6-49bc-a099-86cb74579158" (UID: "b9188423-43a6-49bc-a099-86cb74579158"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:49:32.450599 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.450460 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "b9188423-43a6-49bc-a099-86cb74579158" (UID: "b9188423-43a6-49bc-a099-86cb74579158"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:49:32.450931 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.450751 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "b9188423-43a6-49bc-a099-86cb74579158" (UID: "b9188423-43a6-49bc-a099-86cb74579158"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:49:32.451506 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.450989 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "b9188423-43a6-49bc-a099-86cb74579158" (UID: "b9188423-43a6-49bc-a099-86cb74579158"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:49:32.452153 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.451950 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-config" (OuterVolumeSpecName: "config") pod "b9188423-43a6-49bc-a099-86cb74579158" (UID: "b9188423-43a6-49bc-a099-86cb74579158"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:49:32.453025 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.452993 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "b9188423-43a6-49bc-a099-86cb74579158" (UID: "b9188423-43a6-49bc-a099-86cb74579158"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:49:32.453530 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.453274 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "b9188423-43a6-49bc-a099-86cb74579158" (UID: "b9188423-43a6-49bc-a099-86cb74579158"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:49:32.453530 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.453298 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "b9188423-43a6-49bc-a099-86cb74579158" (UID: "b9188423-43a6-49bc-a099-86cb74579158"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:49:32.453801 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.453775 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "b9188423-43a6-49bc-a099-86cb74579158" (UID: "b9188423-43a6-49bc-a099-86cb74579158"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:49:32.453995 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.453966 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "b9188423-43a6-49bc-a099-86cb74579158" (UID: "b9188423-43a6-49bc-a099-86cb74579158"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:49:32.454115 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.454086 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9188423-43a6-49bc-a099-86cb74579158-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b9188423-43a6-49bc-a099-86cb74579158" (UID: "b9188423-43a6-49bc-a099-86cb74579158"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:49:32.454521 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.454422 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "b9188423-43a6-49bc-a099-86cb74579158" (UID: "b9188423-43a6-49bc-a099-86cb74579158"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:49:32.454521 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.454464 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "b9188423-43a6-49bc-a099-86cb74579158" (UID: "b9188423-43a6-49bc-a099-86cb74579158"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:49:32.454521 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.454482 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "b9188423-43a6-49bc-a099-86cb74579158" (UID: "b9188423-43a6-49bc-a099-86cb74579158"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:49:32.455505 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.455483 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9188423-43a6-49bc-a099-86cb74579158-kube-api-access-zlnq8" (OuterVolumeSpecName: "kube-api-access-zlnq8") pod "b9188423-43a6-49bc-a099-86cb74579158" (UID: "b9188423-43a6-49bc-a099-86cb74579158"). InnerVolumeSpecName "kube-api-access-zlnq8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:49:32.455600 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.455584 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "b9188423-43a6-49bc-a099-86cb74579158" (UID: "b9188423-43a6-49bc-a099-86cb74579158"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:49:32.456151 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.456127 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "b9188423-43a6-49bc-a099-86cb74579158" (UID: "b9188423-43a6-49bc-a099-86cb74579158"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:49:32.456208 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.456127 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9188423-43a6-49bc-a099-86cb74579158-config-out" (OuterVolumeSpecName: "config-out") pod "b9188423-43a6-49bc-a099-86cb74579158" (UID: "b9188423-43a6-49bc-a099-86cb74579158"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:49:32.464953 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.464929 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-web-config" (OuterVolumeSpecName: "web-config") pod "b9188423-43a6-49bc-a099-86cb74579158" (UID: "b9188423-43a6-49bc-a099-86cb74579158"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:49:32.538845 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.538818 2584 generic.go:356] "Generic (PLEG): container finished" podID="b9188423-43a6-49bc-a099-86cb74579158" containerID="6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736" exitCode=0 Jul 29 15:49:32.538845 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.538840 2584 generic.go:356] "Generic (PLEG): container finished" podID="b9188423-43a6-49bc-a099-86cb74579158" containerID="0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e" exitCode=0 Jul 29 15:49:32.538845 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.538846 2584 generic.go:356] "Generic (PLEG): container finished" podID="b9188423-43a6-49bc-a099-86cb74579158" containerID="446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57" exitCode=0 Jul 29 15:49:32.539187 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.538852 2584 generic.go:356] "Generic (PLEG): container finished" podID="b9188423-43a6-49bc-a099-86cb74579158" containerID="e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110" exitCode=0 Jul 29 15:49:32.539187 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.538857 2584 generic.go:356] "Generic (PLEG): container finished" podID="b9188423-43a6-49bc-a099-86cb74579158" containerID="763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055" exitCode=0 Jul 29 15:49:32.539187 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.538861 2584 generic.go:356] "Generic (PLEG): container finished" podID="b9188423-43a6-49bc-a099-86cb74579158" containerID="6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3" exitCode=0 Jul 29 15:49:32.539187 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.538900 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.539187 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.538896 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9188423-43a6-49bc-a099-86cb74579158","Type":"ContainerDied","Data":"6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736"} Jul 29 15:49:32.539187 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.539042 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9188423-43a6-49bc-a099-86cb74579158","Type":"ContainerDied","Data":"0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e"} Jul 29 15:49:32.539187 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.539086 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9188423-43a6-49bc-a099-86cb74579158","Type":"ContainerDied","Data":"446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57"} Jul 29 15:49:32.539187 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.539102 2584 scope.go:117] "RemoveContainer" containerID="6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736" Jul 29 15:49:32.539187 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.539127 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9188423-43a6-49bc-a099-86cb74579158","Type":"ContainerDied","Data":"e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110"} Jul 29 15:49:32.539187 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.539169 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9188423-43a6-49bc-a099-86cb74579158","Type":"ContainerDied","Data":"763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055"} Jul 29 15:49:32.539675 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.539210 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9188423-43a6-49bc-a099-86cb74579158","Type":"ContainerDied","Data":"6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3"} Jul 29 15:49:32.539675 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.539249 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9188423-43a6-49bc-a099-86cb74579158","Type":"ContainerDied","Data":"2c6494481e146e791d51e1559ccb6626b7b9b359f45c1e7fc12ccf0e68b08f2e"} Jul 29 15:49:32.546620 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.546599 2584 scope.go:117] "RemoveContainer" containerID="0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e" Jul 29 15:49:32.551045 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.551025 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlnq8\" (UniqueName: \"kubernetes.io/projected/b9188423-43a6-49bc-a099-86cb74579158-kube-api-access-zlnq8\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:32.551143 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.551049 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:32.551143 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.551063 2584 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-kube-rbac-proxy\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:32.551143 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.551075 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:32.551143 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.551089 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:32.551143 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.551102 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-configmap-metrics-client-ca\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:32.551143 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.551116 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:32.551143 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.551131 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:32.551410 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.551144 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:32.551410 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.551160 2584 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:32.551410 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.551174 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b9188423-43a6-49bc-a099-86cb74579158-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:32.551410 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.551187 2584 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-config\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:32.551410 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.551200 2584 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9188423-43a6-49bc-a099-86cb74579158-tls-assets\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:32.551410 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.551213 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b9188423-43a6-49bc-a099-86cb74579158-prometheus-k8s-db\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:32.551410 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.551227 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:32.551410 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.551242 2584 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-grpc-tls\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:32.551410 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.551256 2584 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-secret-metrics-client-certs\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:32.551410 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.551270 2584 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9188423-43a6-49bc-a099-86cb74579158-config-out\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:32.551410 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.551282 2584 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9188423-43a6-49bc-a099-86cb74579158-web-config\") on node \"ip-10-0-141-213.ec2.internal\" DevicePath \"\"" Jul 29 15:49:32.554038 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.554024 2584 scope.go:117] "RemoveContainer" containerID="446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57" Jul 29 15:49:32.561425 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.561409 2584 scope.go:117] "RemoveContainer" containerID="e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110" Jul 29 15:49:32.564817 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.564796 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 15:49:32.568350 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.568334 2584 scope.go:117] "RemoveContainer" containerID="763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055" Jul 29 15:49:32.569474 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.569433 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 15:49:32.574529 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.574514 2584 scope.go:117] "RemoveContainer" containerID="6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3" Jul 29 15:49:32.581163 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.581150 2584 scope.go:117] "RemoveContainer" containerID="2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828" Jul 29 15:49:32.587283 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.587267 2584 scope.go:117] "RemoveContainer" containerID="6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736" Jul 29 15:49:32.587550 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:49:32.587532 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736\": container with ID starting with 6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736 not found: ID does not exist" containerID="6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736" Jul 29 15:49:32.587593 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.587557 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736"} err="failed to get container status \"6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736\": rpc error: code = NotFound desc = could not find container \"6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736\": container with ID starting with 6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736 not found: ID does not exist" Jul 29 15:49:32.587593 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.587572 2584 scope.go:117] "RemoveContainer" containerID="0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e" Jul 29 15:49:32.587816 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:49:32.587798 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e\": container with ID starting with 0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e not found: ID does not exist" containerID="0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e" Jul 29 15:49:32.587854 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.587821 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e"} err="failed to get container status \"0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e\": rpc error: code = NotFound desc = could not find container \"0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e\": container with ID starting with 0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e not found: ID does not exist" Jul 29 15:49:32.587854 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.587836 2584 scope.go:117] "RemoveContainer" containerID="446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57" Jul 29 15:49:32.588062 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:49:32.588044 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57\": container with ID starting with 446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57 not found: ID does not exist" containerID="446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57" Jul 29 15:49:32.588125 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.588069 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57"} err="failed to get container status \"446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57\": rpc error: code = NotFound desc = could not find container \"446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57\": container with ID starting with 446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57 not found: ID does not exist" Jul 29 15:49:32.588125 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.588089 2584 scope.go:117] "RemoveContainer" containerID="e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110" Jul 29 15:49:32.588320 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:49:32.588305 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110\": container with ID starting with e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110 not found: ID does not exist" containerID="e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110" Jul 29 15:49:32.588357 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.588323 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110"} err="failed to get container status \"e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110\": rpc error: code = NotFound desc = could not find container \"e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110\": container with ID starting with e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110 not found: ID does not exist" Jul 29 15:49:32.588357 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.588335 2584 scope.go:117] "RemoveContainer" containerID="763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055" Jul 29 15:49:32.588699 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:49:32.588682 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055\": container with ID starting with 763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055 not found: ID does not exist" containerID="763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055" Jul 29 15:49:32.588760 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.588706 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055"} err="failed to get container status \"763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055\": rpc error: code = NotFound desc = could not find container \"763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055\": container with ID starting with 763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055 not found: ID does not exist" Jul 29 15:49:32.588760 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.588725 2584 scope.go:117] "RemoveContainer" containerID="6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3" Jul 29 15:49:32.588964 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:49:32.588947 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3\": container with ID starting with 6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3 not found: ID does not exist" containerID="6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3" Jul 29 15:49:32.589002 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.588969 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3"} err="failed to get container status \"6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3\": rpc error: code = NotFound desc = could not find container \"6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3\": container with ID starting with 6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3 not found: ID does not exist" Jul 29 15:49:32.589002 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.588985 2584 scope.go:117] "RemoveContainer" containerID="2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828" Jul 29 15:49:32.589179 ip-10-0-141-213 kubenswrapper[2584]: E0729 15:49:32.589163 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828\": container with ID starting with 2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828 not found: ID does not exist" containerID="2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828" Jul 29 15:49:32.589241 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.589185 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828"} err="failed to get container status \"2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828\": rpc error: code = NotFound desc = could not find container \"2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828\": container with ID starting with 2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828 not found: ID does not exist" Jul 29 15:49:32.589241 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.589203 2584 scope.go:117] "RemoveContainer" containerID="6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736" Jul 29 15:49:32.589428 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.589411 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736"} err="failed to get container status \"6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736\": rpc error: code = NotFound desc = could not find container \"6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736\": container with ID starting with 6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736 not found: ID does not exist" Jul 29 15:49:32.589493 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.589431 2584 scope.go:117] "RemoveContainer" containerID="0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e" Jul 29 15:49:32.589685 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.589668 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e"} err="failed to get container status \"0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e\": rpc error: code = NotFound desc = could not find container \"0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e\": container with ID starting with 0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e not found: ID does not exist" Jul 29 15:49:32.589728 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.589685 2584 scope.go:117] "RemoveContainer" containerID="446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57" Jul 29 15:49:32.589879 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.589863 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57"} err="failed to get container status \"446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57\": rpc error: code = NotFound desc = could not find container \"446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57\": container with ID starting with 446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57 not found: ID does not exist" Jul 29 15:49:32.589945 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.589881 2584 scope.go:117] "RemoveContainer" containerID="e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110" Jul 29 15:49:32.590108 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.590091 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110"} err="failed to get container status \"e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110\": rpc error: code = NotFound desc = could not find container \"e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110\": container with ID starting with e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110 not found: ID does not exist" Jul 29 15:49:32.590158 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.590109 2584 scope.go:117] "RemoveContainer" containerID="763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055" Jul 29 15:49:32.590291 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.590271 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055"} err="failed to get container status \"763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055\": rpc error: code = NotFound desc = could not find container \"763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055\": container with ID starting with 763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055 not found: ID does not exist" Jul 29 15:49:32.590340 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.590292 2584 scope.go:117] "RemoveContainer" containerID="6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3" Jul 29 15:49:32.590497 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.590481 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3"} err="failed to get container status \"6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3\": rpc error: code = NotFound desc = could not find container \"6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3\": container with ID starting with 6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3 not found: ID does not exist" Jul 29 15:49:32.590552 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.590497 2584 scope.go:117] "RemoveContainer" containerID="2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828" Jul 29 15:49:32.590752 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.590735 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828"} err="failed to get container status \"2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828\": rpc error: code = NotFound desc = could not find container \"2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828\": container with ID starting with 2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828 not found: ID does not exist" Jul 29 15:49:32.590752 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.590751 2584 scope.go:117] "RemoveContainer" containerID="6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736" Jul 29 15:49:32.590945 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.590930 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736"} err="failed to get container status \"6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736\": rpc error: code = NotFound desc = could not find container \"6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736\": container with ID starting with 6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736 not found: ID does not exist" Jul 29 15:49:32.591032 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.590945 2584 scope.go:117] "RemoveContainer" containerID="0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e" Jul 29 15:49:32.591108 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.591093 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e"} err="failed to get container status \"0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e\": rpc error: code = NotFound desc = could not find container \"0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e\": container with ID starting with 0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e not found: ID does not exist" Jul 29 15:49:32.591144 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.591108 2584 scope.go:117] "RemoveContainer" containerID="446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57" Jul 29 15:49:32.591279 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.591264 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57"} err="failed to get container status \"446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57\": rpc error: code = NotFound desc = could not find container \"446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57\": container with ID starting with 446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57 not found: ID does not exist" Jul 29 15:49:32.591319 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.591278 2584 scope.go:117] "RemoveContainer" containerID="e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110" Jul 29 15:49:32.591526 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.591509 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110"} err="failed to get container status \"e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110\": rpc error: code = NotFound desc = could not find container \"e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110\": container with ID starting with e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110 not found: ID does not exist" Jul 29 15:49:32.591526 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.591526 2584 scope.go:117] "RemoveContainer" containerID="763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055" Jul 29 15:49:32.591727 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.591712 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055"} err="failed to get container status \"763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055\": rpc error: code = NotFound desc = could not find container \"763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055\": container with ID starting with 763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055 not found: ID does not exist" Jul 29 15:49:32.591727 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.591726 2584 scope.go:117] "RemoveContainer" containerID="6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3" Jul 29 15:49:32.591939 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.591922 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3"} err="failed to get container status \"6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3\": rpc error: code = NotFound desc = could not find container \"6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3\": container with ID starting with 6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3 not found: ID does not exist" Jul 29 15:49:32.591984 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.591939 2584 scope.go:117] "RemoveContainer" containerID="2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828" Jul 29 15:49:32.592163 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.592143 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828"} err="failed to get container status \"2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828\": rpc error: code = NotFound desc = could not find container \"2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828\": container with ID starting with 2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828 not found: ID does not exist" Jul 29 15:49:32.592230 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.592164 2584 scope.go:117] "RemoveContainer" containerID="6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736" Jul 29 15:49:32.592371 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.592355 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736"} err="failed to get container status \"6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736\": rpc error: code = NotFound desc = could not find container \"6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736\": container with ID starting with 6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736 not found: ID does not exist" Jul 29 15:49:32.592420 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.592372 2584 scope.go:117] "RemoveContainer" containerID="0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e" Jul 29 15:49:32.592581 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.592565 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e"} err="failed to get container status \"0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e\": rpc error: code = NotFound desc = could not find container \"0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e\": container with ID starting with 0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e not found: ID does not exist" Jul 29 15:49:32.592637 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.592581 2584 scope.go:117] "RemoveContainer" containerID="446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57" Jul 29 15:49:32.592773 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.592757 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57"} err="failed to get container status \"446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57\": rpc error: code = NotFound desc = could not find container \"446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57\": container with ID starting with 446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57 not found: ID does not exist" Jul 29 15:49:32.592820 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.592774 2584 scope.go:117] "RemoveContainer" containerID="e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110" Jul 29 15:49:32.592985 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.592968 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110"} err="failed to get container status \"e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110\": rpc error: code = NotFound desc = could not find container \"e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110\": container with ID starting with e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110 not found: ID does not exist" Jul 29 15:49:32.593052 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.592986 2584 scope.go:117] "RemoveContainer" containerID="763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055" Jul 29 15:49:32.593236 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.593220 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055"} err="failed to get container status \"763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055\": rpc error: code = NotFound desc = could not find container \"763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055\": container with ID starting with 763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055 not found: ID does not exist" Jul 29 15:49:32.593274 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.593237 2584 scope.go:117] "RemoveContainer" containerID="6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3" Jul 29 15:49:32.593495 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.593476 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3"} err="failed to get container status \"6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3\": rpc error: code = NotFound desc = could not find container \"6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3\": container with ID starting with 6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3 not found: ID does not exist" Jul 29 15:49:32.593553 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.593495 2584 scope.go:117] "RemoveContainer" containerID="2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828" Jul 29 15:49:32.594204 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.593762 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828"} err="failed to get container status \"2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828\": rpc error: code = NotFound desc = could not find container \"2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828\": container with ID starting with 2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828 not found: ID does not exist" Jul 29 15:49:32.594204 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.593789 2584 scope.go:117] "RemoveContainer" containerID="6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736" Jul 29 15:49:32.594836 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.594817 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736"} err="failed to get container status \"6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736\": rpc error: code = NotFound desc = could not find container \"6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736\": container with ID starting with 6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736 not found: ID does not exist" Jul 29 15:49:32.594925 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.594837 2584 scope.go:117] "RemoveContainer" containerID="0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e" Jul 29 15:49:32.595087 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.595071 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e"} err="failed to get container status \"0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e\": rpc error: code = NotFound desc = could not find container \"0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e\": container with ID starting with 0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e not found: ID does not exist" Jul 29 15:49:32.595152 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.595090 2584 scope.go:117] "RemoveContainer" containerID="446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57" Jul 29 15:49:32.595341 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.595323 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57"} err="failed to get container status \"446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57\": rpc error: code = NotFound desc = could not find container \"446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57\": container with ID starting with 446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57 not found: ID does not exist" Jul 29 15:49:32.595389 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.595342 2584 scope.go:117] "RemoveContainer" containerID="e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110" Jul 29 15:49:32.595585 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.595562 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110"} err="failed to get container status \"e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110\": rpc error: code = NotFound desc = could not find container \"e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110\": container with ID starting with e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110 not found: ID does not exist" Jul 29 15:49:32.595646 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.595588 2584 scope.go:117] "RemoveContainer" containerID="763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055" Jul 29 15:49:32.595826 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.595806 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055"} err="failed to get container status \"763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055\": rpc error: code = NotFound desc = could not find container \"763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055\": container with ID starting with 763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055 not found: ID does not exist" Jul 29 15:49:32.595877 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.595826 2584 scope.go:117] "RemoveContainer" containerID="6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3" Jul 29 15:49:32.595976 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.595959 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 15:49:32.596063 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.596014 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3"} err="failed to get container status \"6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3\": rpc error: code = NotFound desc = could not find container \"6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3\": container with ID starting with 6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3 not found: ID does not exist" Jul 29 15:49:32.596063 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.596036 2584 scope.go:117] "RemoveContainer" containerID="2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828" Jul 29 15:49:32.596222 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.596202 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828"} err="failed to get container status \"2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828\": rpc error: code = NotFound desc = could not find container \"2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828\": container with ID starting with 2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828 not found: ID does not exist" Jul 29 15:49:32.596265 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.596224 2584 scope.go:117] "RemoveContainer" containerID="6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736" Jul 29 15:49:32.596265 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.596233 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9188423-43a6-49bc-a099-86cb74579158" containerName="kube-rbac-proxy-thanos" Jul 29 15:49:32.596265 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.596245 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9188423-43a6-49bc-a099-86cb74579158" containerName="kube-rbac-proxy-thanos" Jul 29 15:49:32.596265 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.596258 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9188423-43a6-49bc-a099-86cb74579158" containerName="prometheus" Jul 29 15:49:32.596265 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.596263 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9188423-43a6-49bc-a099-86cb74579158" containerName="prometheus" Jul 29 15:49:32.596473 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.596271 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9188423-43a6-49bc-a099-86cb74579158" containerName="thanos-sidecar" Jul 29 15:49:32.596473 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.596277 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9188423-43a6-49bc-a099-86cb74579158" containerName="thanos-sidecar" Jul 29 15:49:32.596473 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.596285 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9188423-43a6-49bc-a099-86cb74579158" containerName="init-config-reloader" Jul 29 15:49:32.596473 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.596291 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9188423-43a6-49bc-a099-86cb74579158" containerName="init-config-reloader" Jul 29 15:49:32.596473 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.596304 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9188423-43a6-49bc-a099-86cb74579158" containerName="config-reloader" Jul 29 15:49:32.596473 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.596313 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9188423-43a6-49bc-a099-86cb74579158" containerName="config-reloader" Jul 29 15:49:32.596473 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.596324 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9188423-43a6-49bc-a099-86cb74579158" containerName="kube-rbac-proxy-web" Jul 29 15:49:32.596473 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.596330 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9188423-43a6-49bc-a099-86cb74579158" containerName="kube-rbac-proxy-web" Jul 29 15:49:32.596473 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.596335 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9188423-43a6-49bc-a099-86cb74579158" containerName="kube-rbac-proxy" Jul 29 15:49:32.596473 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.596339 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9188423-43a6-49bc-a099-86cb74579158" containerName="kube-rbac-proxy" Jul 29 15:49:32.596473 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.596380 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9188423-43a6-49bc-a099-86cb74579158" containerName="kube-rbac-proxy-thanos" Jul 29 15:49:32.596473 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.596390 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9188423-43a6-49bc-a099-86cb74579158" containerName="kube-rbac-proxy-web" Jul 29 15:49:32.596473 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.596398 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9188423-43a6-49bc-a099-86cb74579158" containerName="prometheus" Jul 29 15:49:32.596473 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.596404 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9188423-43a6-49bc-a099-86cb74579158" containerName="thanos-sidecar" Jul 29 15:49:32.596473 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.596409 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9188423-43a6-49bc-a099-86cb74579158" containerName="kube-rbac-proxy" Jul 29 15:49:32.596473 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.596416 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9188423-43a6-49bc-a099-86cb74579158" containerName="config-reloader" Jul 29 15:49:32.596473 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.596457 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736"} err="failed to get container status \"6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736\": rpc error: code = NotFound desc = could not find container \"6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736\": container with ID starting with 6ee0189e20b706069e42212e6ee80d511a08b6fd97de52189b717e9829e2d736 not found: ID does not exist" Jul 29 15:49:32.596473 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.596484 2584 scope.go:117] "RemoveContainer" containerID="0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e" Jul 29 15:49:32.597075 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.596700 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e"} err="failed to get container status \"0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e\": rpc error: code = NotFound desc = could not find container \"0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e\": container with ID starting with 0f589859aec9ab305552424bedf1faa841973e6bbae4b84abd03b4ecb578282e not found: ID does not exist" Jul 29 15:49:32.597075 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.596714 2584 scope.go:117] "RemoveContainer" containerID="446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57" Jul 29 15:49:32.597075 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.596933 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57"} err="failed to get container status \"446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57\": rpc error: code = NotFound desc = could not find container \"446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57\": container with ID starting with 446bdd6dcba5933869267c51fab05fd83c34f703053969132e3cd7ee85d57e57 not found: ID does not exist" Jul 29 15:49:32.597075 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.596950 2584 scope.go:117] "RemoveContainer" containerID="e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110" Jul 29 15:49:32.597208 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.597164 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110"} err="failed to get container status \"e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110\": rpc error: code = NotFound desc = could not find container \"e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110\": container with ID starting with e34dc48ddb08a9c380d9872c6f465d69a83d8b010cd74abc1e45de23b06f8110 not found: ID does not exist" Jul 29 15:49:32.597208 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.597183 2584 scope.go:117] "RemoveContainer" containerID="763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055" Jul 29 15:49:32.597427 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.597404 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055"} err="failed to get container status \"763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055\": rpc error: code = NotFound desc = could not find container \"763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055\": container with ID starting with 763644eaf6aa157736975a19a2382b87725de57816c776c49b3b038bdf9dc055 not found: ID does not exist" Jul 29 15:49:32.597505 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.597428 2584 scope.go:117] "RemoveContainer" containerID="6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3" Jul 29 15:49:32.597730 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.597706 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3"} err="failed to get container status \"6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3\": rpc error: code = NotFound desc = could not find container \"6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3\": container with ID starting with 6b421d13dc4117aa73a6938259a064acb40577d82c5996cf12b9eabb43da21e3 not found: ID does not exist" Jul 29 15:49:32.597799 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.597734 2584 scope.go:117] "RemoveContainer" containerID="2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828" Jul 29 15:49:32.597969 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.597944 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828"} err="failed to get container status \"2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828\": rpc error: code = NotFound desc = could not find container \"2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828\": container with ID starting with 2723b96cca4beedc44f2d10f4f3f3526ab640c7a87452f6a32728fd03f7c0828 not found: ID does not exist" Jul 29 15:49:32.600321 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.600303 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.603256 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.603235 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 29 15:49:32.603492 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.603474 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 29 15:49:32.603606 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.603561 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 29 15:49:32.603606 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.603566 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2hm71hs70ke3u\"" Jul 29 15:49:32.603606 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.603574 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-j5nbd\"" Jul 29 15:49:32.603787 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.603773 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 29 15:49:32.603879 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.603863 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 29 15:49:32.603944 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.603881 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 29 15:49:32.603944 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.603863 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 29 15:49:32.603944 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.603916 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 29 15:49:32.604118 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.603881 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 29 15:49:32.604694 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.604366 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 29 15:49:32.604694 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.604409 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 29 15:49:32.604694 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.604428 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 29 15:49:32.604694 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.604541 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 29 15:49:32.610373 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.609259 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 29 15:49:32.611759 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.611741 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 29 15:49:32.615034 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.615012 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 15:49:32.652323 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.652298 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.652425 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.652356 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.652503 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.652480 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.652556 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.652513 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.652556 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.652547 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.652647 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.652574 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.652707 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.652657 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-config\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.652707 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.652702 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-web-config\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.652817 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.652734 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.652817 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.652763 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.652916 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.652843 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.652916 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.652899 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-config-out\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.653012 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.652921 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.653012 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.652938 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.653012 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.652997 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.653106 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.653018 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.653106 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.653078 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.653106 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.653098 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.653211 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.653113 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzpds\" (UniqueName: \"kubernetes.io/projected/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-kube-api-access-wzpds\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.653211 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.653135 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.726799 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.726778 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9188423-43a6-49bc-a099-86cb74579158" path="/var/lib/kubelet/pods/b9188423-43a6-49bc-a099-86cb74579158/volumes" Jul 29 15:49:32.753696 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.753675 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.753768 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.753699 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.753768 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.753720 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-config\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.753768 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.753739 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-web-config\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.753911 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.753768 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.753911 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.753792 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.757667 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.753907 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.757667 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.753956 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-config-out\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.757667 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.753982 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.757667 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.754004 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.757667 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.754032 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.757667 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.754058 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.757667 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.754094 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.757667 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.754126 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.757667 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.754151 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzpds\" (UniqueName: \"kubernetes.io/projected/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-kube-api-access-wzpds\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.757667 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.754154 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.757667 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.754179 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.757667 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.754226 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.757667 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.754266 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.757667 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.754290 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.757667 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.754321 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.757667 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.754425 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.757667 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.754620 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.758593 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.755098 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.758593 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.755358 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.758593 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.755992 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.758593 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.756275 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.758593 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.756831 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.758593 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.756974 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.758593 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.757386 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.758593 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.757510 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-web-config\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.758593 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.757921 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-config\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.758593 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.758149 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.759096 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.758620 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.759096 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.758817 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-config-out\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.759096 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.758933 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.759292 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.759273 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.759382 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.759367 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.759658 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.759642 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.763542 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.763525 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzpds\" (UniqueName: \"kubernetes.io/projected/f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb-kube-api-access-wzpds\") pod \"prometheus-k8s-0\" (UID: \"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:32.912946 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:32.912883 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:33.048837 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:33.048815 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 15:49:33.050650 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:49:33.050627 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0a5f16e_0f89_47fc_a3c5_8c745ffc25eb.slice/crio-482773de731b9795b3b7badcea711335dc7be645fa1bfba7cbca0b0afc34521e WatchSource:0}: Error finding container 482773de731b9795b3b7badcea711335dc7be645fa1bfba7cbca0b0afc34521e: Status 404 returned error can't find the container with id 482773de731b9795b3b7badcea711335dc7be645fa1bfba7cbca0b0afc34521e Jul 29 15:49:33.544217 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:33.544136 2584 generic.go:356] "Generic (PLEG): container finished" podID="f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb" containerID="a211a2a90d0b99b636089486628b2e7ca7d5ecd5cb499e4cc714330337e516f9" exitCode=0 Jul 29 15:49:33.544616 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:33.544219 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb","Type":"ContainerDied","Data":"a211a2a90d0b99b636089486628b2e7ca7d5ecd5cb499e4cc714330337e516f9"} Jul 29 15:49:33.544616 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:33.544294 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb","Type":"ContainerStarted","Data":"482773de731b9795b3b7badcea711335dc7be645fa1bfba7cbca0b0afc34521e"} Jul 29 15:49:34.554069 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:34.554034 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb","Type":"ContainerStarted","Data":"c4677ab955f6edc7ae2fa331ec431d2c2adf7af2b670635e624decefd7be6e7e"} Jul 29 15:49:34.554479 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:34.554128 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb","Type":"ContainerStarted","Data":"bbdbfe038d29013a3a47e95fea8356317cb7d7cb112a651f276bd0f3fde9ae95"} Jul 29 15:49:34.554479 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:34.554161 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb","Type":"ContainerStarted","Data":"f6c4246719e7c818a6a79f5c42bf5a2ec4b83b7955ef8cee64ae591d880cb81d"} Jul 29 15:49:34.554479 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:34.554200 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb","Type":"ContainerStarted","Data":"7e7587e618264cd2cd6f8be6d05c562fcd3efe12073589c211633751a0b4ecf7"} Jul 29 15:49:34.554479 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:34.554230 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb","Type":"ContainerStarted","Data":"835da6b037d9070714f3fdc1d54cc49dc0437425f7d0cee2c0436fa5e696f128"} Jul 29 15:49:34.554479 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:34.554256 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb","Type":"ContainerStarted","Data":"00cec4f61d1ec495720359fe3e177d9d2acb3ad47034f2e2d0c27d15db9d3090"} Jul 29 15:49:34.588001 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:34.586420 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.566748318 podStartE2EDuration="2.586399838s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.65152ms" isStatefulPod=false podCreationTimestamp="2026-07-29 15:49:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:49:34.585513019 +0000 UTC m=+176.429810501" watchObservedRunningTime="2026-07-29 15:49:34.586399838 +0000 UTC m=+176.430697317" Jul 29 15:49:37.913339 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:49:37.913297 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:50:32.913218 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:50:32.913182 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:50:32.928389 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:50:32.928365 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:50:33.799685 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:50:33.799657 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:51:38.538962 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:51:38.538930 2584 kubelet.go:1648] "Image garbage collection succeeded" Jul 29 15:54:37.878361 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:37.878327 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9885897b8-qf7cr"] Jul 29 15:54:37.880912 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:37.880896 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9885897b8-qf7cr" Jul 29 15:54:37.886635 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:37.886611 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 29 15:54:37.886635 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:37.886631 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 29 15:54:37.887861 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:37.887838 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 29 15:54:37.887972 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:37.887923 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 29 15:54:37.887972 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:37.887923 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bzgb7\"" Jul 29 15:54:37.887972 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:37.887945 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 29 15:54:37.893626 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:37.893607 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 29 15:54:37.896841 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:37.896820 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9885897b8-qf7cr"] Jul 29 15:54:38.049973 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:38.049939 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6766b040-117d-4858-bbcf-eecf03571986-console-oauth-config\") pod \"console-9885897b8-qf7cr\" (UID: \"6766b040-117d-4858-bbcf-eecf03571986\") " pod="openshift-console/console-9885897b8-qf7cr" Jul 29 15:54:38.049973 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:38.049971 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl4qp\" (UniqueName: \"kubernetes.io/projected/6766b040-117d-4858-bbcf-eecf03571986-kube-api-access-pl4qp\") pod \"console-9885897b8-qf7cr\" (UID: \"6766b040-117d-4858-bbcf-eecf03571986\") " pod="openshift-console/console-9885897b8-qf7cr" Jul 29 15:54:38.050179 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:38.049997 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6766b040-117d-4858-bbcf-eecf03571986-console-serving-cert\") pod \"console-9885897b8-qf7cr\" (UID: \"6766b040-117d-4858-bbcf-eecf03571986\") " pod="openshift-console/console-9885897b8-qf7cr" Jul 29 15:54:38.050179 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:38.050013 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6766b040-117d-4858-bbcf-eecf03571986-trusted-ca-bundle\") pod \"console-9885897b8-qf7cr\" (UID: \"6766b040-117d-4858-bbcf-eecf03571986\") " pod="openshift-console/console-9885897b8-qf7cr" Jul 29 15:54:38.050179 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:38.050111 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6766b040-117d-4858-bbcf-eecf03571986-service-ca\") pod \"console-9885897b8-qf7cr\" (UID: \"6766b040-117d-4858-bbcf-eecf03571986\") " pod="openshift-console/console-9885897b8-qf7cr" Jul 29 15:54:38.050179 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:38.050159 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6766b040-117d-4858-bbcf-eecf03571986-oauth-serving-cert\") pod \"console-9885897b8-qf7cr\" (UID: \"6766b040-117d-4858-bbcf-eecf03571986\") " pod="openshift-console/console-9885897b8-qf7cr" Jul 29 15:54:38.050318 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:38.050215 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6766b040-117d-4858-bbcf-eecf03571986-console-config\") pod \"console-9885897b8-qf7cr\" (UID: \"6766b040-117d-4858-bbcf-eecf03571986\") " pod="openshift-console/console-9885897b8-qf7cr" Jul 29 15:54:38.151278 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:38.151259 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6766b040-117d-4858-bbcf-eecf03571986-console-oauth-config\") pod \"console-9885897b8-qf7cr\" (UID: \"6766b040-117d-4858-bbcf-eecf03571986\") " pod="openshift-console/console-9885897b8-qf7cr" Jul 29 15:54:38.151392 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:38.151286 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl4qp\" (UniqueName: \"kubernetes.io/projected/6766b040-117d-4858-bbcf-eecf03571986-kube-api-access-pl4qp\") pod \"console-9885897b8-qf7cr\" (UID: \"6766b040-117d-4858-bbcf-eecf03571986\") " pod="openshift-console/console-9885897b8-qf7cr" Jul 29 15:54:38.151392 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:38.151317 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6766b040-117d-4858-bbcf-eecf03571986-console-serving-cert\") pod \"console-9885897b8-qf7cr\" (UID: \"6766b040-117d-4858-bbcf-eecf03571986\") " pod="openshift-console/console-9885897b8-qf7cr" Jul 29 15:54:38.151392 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:38.151334 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6766b040-117d-4858-bbcf-eecf03571986-trusted-ca-bundle\") pod \"console-9885897b8-qf7cr\" (UID: \"6766b040-117d-4858-bbcf-eecf03571986\") " pod="openshift-console/console-9885897b8-qf7cr" Jul 29 15:54:38.151392 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:38.151372 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6766b040-117d-4858-bbcf-eecf03571986-service-ca\") pod \"console-9885897b8-qf7cr\" (UID: \"6766b040-117d-4858-bbcf-eecf03571986\") " pod="openshift-console/console-9885897b8-qf7cr" Jul 29 15:54:38.151641 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:38.151404 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6766b040-117d-4858-bbcf-eecf03571986-oauth-serving-cert\") pod \"console-9885897b8-qf7cr\" (UID: \"6766b040-117d-4858-bbcf-eecf03571986\") " pod="openshift-console/console-9885897b8-qf7cr" Jul 29 15:54:38.151641 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:38.151425 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6766b040-117d-4858-bbcf-eecf03571986-console-config\") pod \"console-9885897b8-qf7cr\" (UID: \"6766b040-117d-4858-bbcf-eecf03571986\") " pod="openshift-console/console-9885897b8-qf7cr" Jul 29 15:54:38.152134 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:38.152114 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6766b040-117d-4858-bbcf-eecf03571986-console-config\") pod \"console-9885897b8-qf7cr\" (UID: \"6766b040-117d-4858-bbcf-eecf03571986\") " pod="openshift-console/console-9885897b8-qf7cr" Jul 29 15:54:38.152289 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:38.152268 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6766b040-117d-4858-bbcf-eecf03571986-oauth-serving-cert\") pod \"console-9885897b8-qf7cr\" (UID: \"6766b040-117d-4858-bbcf-eecf03571986\") " pod="openshift-console/console-9885897b8-qf7cr" Jul 29 15:54:38.152331 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:38.152294 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6766b040-117d-4858-bbcf-eecf03571986-trusted-ca-bundle\") pod \"console-9885897b8-qf7cr\" (UID: \"6766b040-117d-4858-bbcf-eecf03571986\") " pod="openshift-console/console-9885897b8-qf7cr" Jul 29 15:54:38.152392 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:38.152376 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6766b040-117d-4858-bbcf-eecf03571986-service-ca\") pod \"console-9885897b8-qf7cr\" (UID: \"6766b040-117d-4858-bbcf-eecf03571986\") " pod="openshift-console/console-9885897b8-qf7cr" Jul 29 15:54:38.153693 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:38.153672 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6766b040-117d-4858-bbcf-eecf03571986-console-oauth-config\") pod \"console-9885897b8-qf7cr\" (UID: \"6766b040-117d-4858-bbcf-eecf03571986\") " pod="openshift-console/console-9885897b8-qf7cr" Jul 29 15:54:38.153800 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:38.153784 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6766b040-117d-4858-bbcf-eecf03571986-console-serving-cert\") pod \"console-9885897b8-qf7cr\" (UID: \"6766b040-117d-4858-bbcf-eecf03571986\") " pod="openshift-console/console-9885897b8-qf7cr" Jul 29 15:54:38.162112 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:38.162088 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl4qp\" (UniqueName: \"kubernetes.io/projected/6766b040-117d-4858-bbcf-eecf03571986-kube-api-access-pl4qp\") pod \"console-9885897b8-qf7cr\" (UID: \"6766b040-117d-4858-bbcf-eecf03571986\") " pod="openshift-console/console-9885897b8-qf7cr" Jul 29 15:54:38.190055 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:38.190034 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9885897b8-qf7cr" Jul 29 15:54:38.315779 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:38.315753 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9885897b8-qf7cr"] Jul 29 15:54:38.319104 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:54:38.319080 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6766b040_117d_4858_bbcf_eecf03571986.slice/crio-28bf8dec00e73a09f057f5e4e10207ea89ccf75a4d31836dbf83696b3b18b709 WatchSource:0}: Error finding container 28bf8dec00e73a09f057f5e4e10207ea89ccf75a4d31836dbf83696b3b18b709: Status 404 returned error can't find the container with id 28bf8dec00e73a09f057f5e4e10207ea89ccf75a4d31836dbf83696b3b18b709 Jul 29 15:54:38.696576 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:38.696545 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9885897b8-qf7cr" event={"ID":"6766b040-117d-4858-bbcf-eecf03571986","Type":"ContainerStarted","Data":"6e70de8a3425eb6f948e813110998ed975c94cad2be94100319fdfc749b4e87d"} Jul 29 15:54:38.696760 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:38.696589 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9885897b8-qf7cr" event={"ID":"6766b040-117d-4858-bbcf-eecf03571986","Type":"ContainerStarted","Data":"28bf8dec00e73a09f057f5e4e10207ea89ccf75a4d31836dbf83696b3b18b709"} Jul 29 15:54:38.720967 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:38.720924 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9885897b8-qf7cr" podStartSLOduration=1.7209084319999999 podStartE2EDuration="1.720908432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:54:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:54:38.719575494 +0000 UTC m=+480.563872985" watchObservedRunningTime="2026-07-29 15:54:38.720908432 +0000 UTC m=+480.565205912" Jul 29 15:54:48.190150 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:48.190117 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9885897b8-qf7cr" Jul 29 15:54:48.190669 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:48.190466 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9885897b8-qf7cr" Jul 29 15:54:48.195096 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:48.195072 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9885897b8-qf7cr" Jul 29 15:54:48.740672 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:48.740643 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9885897b8-qf7cr" Jul 29 15:54:52.504596 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:52.504563 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw"] Jul 29 15:54:52.507529 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:52.507510 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw" Jul 29 15:54:52.510537 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:52.510512 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jul 29 15:54:52.510714 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:52.510698 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 29 15:54:52.511943 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:52.511922 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-9r5cq\"" Jul 29 15:54:52.512131 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:52.512116 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 29 15:54:52.512131 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:52.512124 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jul 29 15:54:52.517518 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:52.517500 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw"] Jul 29 15:54:52.660476 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:52.660430 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/3c78fc3d-81e6-4072-b54f-f10e1df1c611-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw\" (UID: \"3c78fc3d-81e6-4072-b54f-f10e1df1c611\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw" Jul 29 15:54:52.660583 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:52.660487 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr96l\" (UniqueName: \"kubernetes.io/projected/3c78fc3d-81e6-4072-b54f-f10e1df1c611-kube-api-access-gr96l\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw\" (UID: \"3c78fc3d-81e6-4072-b54f-f10e1df1c611\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw" Jul 29 15:54:52.660583 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:52.660521 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c78fc3d-81e6-4072-b54f-f10e1df1c611-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw\" (UID: \"3c78fc3d-81e6-4072-b54f-f10e1df1c611\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw" Jul 29 15:54:52.760919 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:52.760859 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/3c78fc3d-81e6-4072-b54f-f10e1df1c611-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw\" (UID: \"3c78fc3d-81e6-4072-b54f-f10e1df1c611\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw" Jul 29 15:54:52.760919 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:52.760892 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr96l\" (UniqueName: \"kubernetes.io/projected/3c78fc3d-81e6-4072-b54f-f10e1df1c611-kube-api-access-gr96l\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw\" (UID: \"3c78fc3d-81e6-4072-b54f-f10e1df1c611\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw" Jul 29 15:54:52.761056 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:52.760961 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c78fc3d-81e6-4072-b54f-f10e1df1c611-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw\" (UID: \"3c78fc3d-81e6-4072-b54f-f10e1df1c611\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw" Jul 29 15:54:52.761568 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:52.761546 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/3c78fc3d-81e6-4072-b54f-f10e1df1c611-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw\" (UID: \"3c78fc3d-81e6-4072-b54f-f10e1df1c611\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw" Jul 29 15:54:52.763196 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:52.763172 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c78fc3d-81e6-4072-b54f-f10e1df1c611-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw\" (UID: \"3c78fc3d-81e6-4072-b54f-f10e1df1c611\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw" Jul 29 15:54:52.771019 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:52.771000 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr96l\" (UniqueName: \"kubernetes.io/projected/3c78fc3d-81e6-4072-b54f-f10e1df1c611-kube-api-access-gr96l\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw\" (UID: \"3c78fc3d-81e6-4072-b54f-f10e1df1c611\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw" Jul 29 15:54:52.829398 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:52.829379 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw" Jul 29 15:54:52.954742 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:52.954713 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw"] Jul 29 15:54:52.957697 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:54:52.957671 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c78fc3d_81e6_4072_b54f_f10e1df1c611.slice/crio-ad00607304d586714a7ce3da7646482731cea1a454cf49183275f57b3b029a0d WatchSource:0}: Error finding container ad00607304d586714a7ce3da7646482731cea1a454cf49183275f57b3b029a0d: Status 404 returned error can't find the container with id ad00607304d586714a7ce3da7646482731cea1a454cf49183275f57b3b029a0d Jul 29 15:54:52.959507 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:52.959489 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 15:54:53.757647 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:53.757614 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw" event={"ID":"3c78fc3d-81e6-4072-b54f-f10e1df1c611","Type":"ContainerStarted","Data":"ad00607304d586714a7ce3da7646482731cea1a454cf49183275f57b3b029a0d"} Jul 29 15:54:55.770546 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:55.770513 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw" event={"ID":"3c78fc3d-81e6-4072-b54f-f10e1df1c611","Type":"ContainerStarted","Data":"16d775ca38870b38acefa0aa4b52e7dcaa65fa60cec3c42c38d18b07808d39d3"} Jul 29 15:54:55.770907 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:55.770652 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw" Jul 29 15:54:55.791363 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:54:55.791302 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw" podStartSLOduration=1.567048346 podStartE2EDuration="3.791284127s" totalImagesPullingTime="2.224235781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:54:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:54:55.787754136 +0000 UTC m=+497.632051614" watchObservedRunningTime="2026-07-29 15:54:55.791284127 +0000 UTC m=+497.635581608" Jul 29 15:55:11.779913 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:55:11.779885 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw" Jul 29 15:55:48.715823 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:55:48.715670 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw_3c78fc3d-81e6-4072-b54f-f10e1df1c611/manager/0.log" Jul 29 15:55:49.194858 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:55:49.194830 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw_3c78fc3d-81e6-4072-b54f-f10e1df1c611/manager/0.log" Jul 29 15:55:49.690555 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:55:49.690523 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw_3c78fc3d-81e6-4072-b54f-f10e1df1c611/manager/0.log" Jul 29 15:56:27.757205 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:27.757171 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vcsgn/must-gather-qcntf"] Jul 29 15:56:27.761490 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:27.761456 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vcsgn/must-gather-qcntf" Jul 29 15:56:27.764754 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:27.764728 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vcsgn\"/\"kube-root-ca.crt\"" Jul 29 15:56:27.764881 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:27.764756 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vcsgn\"/\"default-dockercfg-bs4j9\"" Jul 29 15:56:27.765681 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:27.765653 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vcsgn\"/\"openshift-service-ca.crt\"" Jul 29 15:56:27.768883 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:27.768862 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vcsgn/must-gather-qcntf"] Jul 29 15:56:27.870181 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:27.870158 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/85de69ff-7ce4-4a15-8bab-4b2fd21f74f8-must-gather-output\") pod \"must-gather-qcntf\" (UID: \"85de69ff-7ce4-4a15-8bab-4b2fd21f74f8\") " pod="openshift-must-gather-vcsgn/must-gather-qcntf" Jul 29 15:56:27.870279 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:27.870198 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cl8h\" (UniqueName: \"kubernetes.io/projected/85de69ff-7ce4-4a15-8bab-4b2fd21f74f8-kube-api-access-9cl8h\") pod \"must-gather-qcntf\" (UID: \"85de69ff-7ce4-4a15-8bab-4b2fd21f74f8\") " pod="openshift-must-gather-vcsgn/must-gather-qcntf" Jul 29 15:56:27.971402 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:27.971377 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/85de69ff-7ce4-4a15-8bab-4b2fd21f74f8-must-gather-output\") pod \"must-gather-qcntf\" (UID: \"85de69ff-7ce4-4a15-8bab-4b2fd21f74f8\") " pod="openshift-must-gather-vcsgn/must-gather-qcntf" Jul 29 15:56:27.971532 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:27.971420 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cl8h\" (UniqueName: \"kubernetes.io/projected/85de69ff-7ce4-4a15-8bab-4b2fd21f74f8-kube-api-access-9cl8h\") pod \"must-gather-qcntf\" (UID: \"85de69ff-7ce4-4a15-8bab-4b2fd21f74f8\") " pod="openshift-must-gather-vcsgn/must-gather-qcntf" Jul 29 15:56:27.971687 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:27.971671 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/85de69ff-7ce4-4a15-8bab-4b2fd21f74f8-must-gather-output\") pod \"must-gather-qcntf\" (UID: \"85de69ff-7ce4-4a15-8bab-4b2fd21f74f8\") " pod="openshift-must-gather-vcsgn/must-gather-qcntf" Jul 29 15:56:27.979155 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:27.979135 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cl8h\" (UniqueName: \"kubernetes.io/projected/85de69ff-7ce4-4a15-8bab-4b2fd21f74f8-kube-api-access-9cl8h\") pod \"must-gather-qcntf\" (UID: \"85de69ff-7ce4-4a15-8bab-4b2fd21f74f8\") " pod="openshift-must-gather-vcsgn/must-gather-qcntf" Jul 29 15:56:28.072051 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:28.071989 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vcsgn/must-gather-qcntf" Jul 29 15:56:28.198897 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:28.198866 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vcsgn/must-gather-qcntf"] Jul 29 15:56:28.201704 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:56:28.201678 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod85de69ff_7ce4_4a15_8bab_4b2fd21f74f8.slice/crio-b5607cf4f309dc25c52d1693dda8407707238a1664dee17c400c0c5e2250410e WatchSource:0}: Error finding container b5607cf4f309dc25c52d1693dda8407707238a1664dee17c400c0c5e2250410e: Status 404 returned error can't find the container with id b5607cf4f309dc25c52d1693dda8407707238a1664dee17c400c0c5e2250410e Jul 29 15:56:29.151254 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:29.151222 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vcsgn/must-gather-qcntf" event={"ID":"85de69ff-7ce4-4a15-8bab-4b2fd21f74f8","Type":"ContainerStarted","Data":"b5607cf4f309dc25c52d1693dda8407707238a1664dee17c400c0c5e2250410e"} Jul 29 15:56:30.160528 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:30.160491 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vcsgn/must-gather-qcntf" event={"ID":"85de69ff-7ce4-4a15-8bab-4b2fd21f74f8","Type":"ContainerStarted","Data":"18dba4cbe8b8a9de2388c4d94759c2049d1444bb69b0087ec020d5b5684e823b"} Jul 29 15:56:30.161056 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:30.161032 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vcsgn/must-gather-qcntf" event={"ID":"85de69ff-7ce4-4a15-8bab-4b2fd21f74f8","Type":"ContainerStarted","Data":"073a22815107df05bde2362164389be6240a4e62d07b109a180117d50d30c542"} Jul 29 15:56:30.181572 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:30.181518 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vcsgn/must-gather-qcntf" podStartSLOduration=2.021216415 podStartE2EDuration="3.181499773s" totalImagesPullingTime="1.160283358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:56:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:56:30.178845782 +0000 UTC m=+592.023143264" watchObservedRunningTime="2026-07-29 15:56:30.181499773 +0000 UTC m=+592.025797254" Jul 29 15:56:30.699299 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:30.699271 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-f5gvg_77adaab3-405e-43d8-8dec-badf07ce38f2/global-pull-secret-syncer/0.log" Jul 29 15:56:30.878554 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:30.878523 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wtfzb_4c187f2d-0062-43b4-a61d-b92a4a85793c/konnectivity-agent/0.log" Jul 29 15:56:30.939879 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:30.939852 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-213.ec2.internal_a2ba8c9c359a1f1e65affdf9bc68bd46/haproxy/0.log" Jul 29 15:56:34.875789 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:34.875756 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_384ee368-3867-4897-8374-284b28166f55/alertmanager/0.log" Jul 29 15:56:34.902821 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:34.902755 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_384ee368-3867-4897-8374-284b28166f55/config-reloader/0.log" Jul 29 15:56:34.925408 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:34.925332 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_384ee368-3867-4897-8374-284b28166f55/kube-rbac-proxy-web/0.log" Jul 29 15:56:34.953076 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:34.952943 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_384ee368-3867-4897-8374-284b28166f55/kube-rbac-proxy/0.log" Jul 29 15:56:34.975779 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:34.975747 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_384ee368-3867-4897-8374-284b28166f55/kube-rbac-proxy-metric/0.log" Jul 29 15:56:34.997777 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:34.997739 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_384ee368-3867-4897-8374-284b28166f55/prom-label-proxy/0.log" Jul 29 15:56:35.023737 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:35.023664 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_384ee368-3867-4897-8374-284b28166f55/init-config-reloader/0.log" Jul 29 15:56:35.370110 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:35.370030 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v2k6j_ccbab069-b021-406e-acbc-a2380e67aa67/node-exporter/0.log" Jul 29 15:56:35.396907 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:35.396882 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v2k6j_ccbab069-b021-406e-acbc-a2380e67aa67/kube-rbac-proxy/0.log" Jul 29 15:56:35.422941 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:35.422915 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v2k6j_ccbab069-b021-406e-acbc-a2380e67aa67/init-textfile/0.log" Jul 29 15:56:35.530103 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:35.530077 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb/prometheus/0.log" Jul 29 15:56:35.554348 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:35.554319 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb/config-reloader/0.log" Jul 29 15:56:35.576658 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:35.576634 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb/thanos-sidecar/0.log" Jul 29 15:56:35.597744 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:35.597724 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb/kube-rbac-proxy-web/0.log" Jul 29 15:56:35.627236 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:35.627146 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb/kube-rbac-proxy/0.log" Jul 29 15:56:35.652649 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:35.652612 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb/kube-rbac-proxy-thanos/0.log" Jul 29 15:56:35.678184 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:35.678139 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0a5f16e-0f89-47fc-a3c5-8c745ffc25eb/init-config-reloader/0.log" Jul 29 15:56:35.712376 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:35.712342 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-vp5kv_813b208d-e0f3-4eeb-8642-c619eea337a9/prometheus-operator/0.log" Jul 29 15:56:35.740585 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:35.740546 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-vp5kv_813b208d-e0f3-4eeb-8642-c619eea337a9/kube-rbac-proxy/0.log" Jul 29 15:56:35.890564 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:35.890487 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c75994844-84vcx_c61d7238-7ce5-4ecd-b5db-88d237d63d70/thanos-query/0.log" Jul 29 15:56:35.921998 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:35.921965 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c75994844-84vcx_c61d7238-7ce5-4ecd-b5db-88d237d63d70/kube-rbac-proxy-web/0.log" Jul 29 15:56:35.950692 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:35.950663 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c75994844-84vcx_c61d7238-7ce5-4ecd-b5db-88d237d63d70/kube-rbac-proxy/0.log" Jul 29 15:56:35.980933 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:35.980898 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c75994844-84vcx_c61d7238-7ce5-4ecd-b5db-88d237d63d70/prom-label-proxy/0.log" Jul 29 15:56:36.009639 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:36.008884 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c75994844-84vcx_c61d7238-7ce5-4ecd-b5db-88d237d63d70/kube-rbac-proxy-rules/0.log" Jul 29 15:56:36.040728 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:36.039466 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c75994844-84vcx_c61d7238-7ce5-4ecd-b5db-88d237d63d70/kube-rbac-proxy-metrics/0.log" Jul 29 15:56:37.156933 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:37.156906 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-v96n8_d2d48012-4f48-46be-a087-92d97c98905a/networking-console-plugin/0.log" Jul 29 15:56:37.856791 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:37.856754 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vcsgn/perf-node-gather-daemonset-glkxj"] Jul 29 15:56:37.862932 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:37.862899 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-glkxj" Jul 29 15:56:37.868803 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:37.868777 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vcsgn/perf-node-gather-daemonset-glkxj"] Jul 29 15:56:37.966668 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:37.966629 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13913735-c5c6-4db4-9095-62ef38c7915e-lib-modules\") pod \"perf-node-gather-daemonset-glkxj\" (UID: \"13913735-c5c6-4db4-9095-62ef38c7915e\") " pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-glkxj" Jul 29 15:56:37.966848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:37.966677 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9c6k\" (UniqueName: \"kubernetes.io/projected/13913735-c5c6-4db4-9095-62ef38c7915e-kube-api-access-r9c6k\") pod \"perf-node-gather-daemonset-glkxj\" (UID: \"13913735-c5c6-4db4-9095-62ef38c7915e\") " pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-glkxj" Jul 29 15:56:37.966848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:37.966709 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/13913735-c5c6-4db4-9095-62ef38c7915e-proc\") pod \"perf-node-gather-daemonset-glkxj\" (UID: \"13913735-c5c6-4db4-9095-62ef38c7915e\") " pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-glkxj" Jul 29 15:56:37.966848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:37.966784 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13913735-c5c6-4db4-9095-62ef38c7915e-sys\") pod \"perf-node-gather-daemonset-glkxj\" (UID: \"13913735-c5c6-4db4-9095-62ef38c7915e\") " pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-glkxj" Jul 29 15:56:37.966848 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:37.966826 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/13913735-c5c6-4db4-9095-62ef38c7915e-podres\") pod \"perf-node-gather-daemonset-glkxj\" (UID: \"13913735-c5c6-4db4-9095-62ef38c7915e\") " pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-glkxj" Jul 29 15:56:38.029151 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:38.029123 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9885897b8-qf7cr_6766b040-117d-4858-bbcf-eecf03571986/console/0.log" Jul 29 15:56:38.059947 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:38.059920 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-9q4n4_d8900764-2321-4a76-bb67-e8b6fd8f0bd4/download-server/0.log" Jul 29 15:56:38.067782 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:38.067756 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13913735-c5c6-4db4-9095-62ef38c7915e-sys\") pod \"perf-node-gather-daemonset-glkxj\" (UID: \"13913735-c5c6-4db4-9095-62ef38c7915e\") " pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-glkxj" Jul 29 15:56:38.067921 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:38.067805 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/13913735-c5c6-4db4-9095-62ef38c7915e-podres\") pod \"perf-node-gather-daemonset-glkxj\" (UID: \"13913735-c5c6-4db4-9095-62ef38c7915e\") " pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-glkxj" Jul 29 15:56:38.067921 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:38.067842 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13913735-c5c6-4db4-9095-62ef38c7915e-lib-modules\") pod \"perf-node-gather-daemonset-glkxj\" (UID: \"13913735-c5c6-4db4-9095-62ef38c7915e\") " pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-glkxj" Jul 29 15:56:38.067921 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:38.067849 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13913735-c5c6-4db4-9095-62ef38c7915e-sys\") pod \"perf-node-gather-daemonset-glkxj\" (UID: \"13913735-c5c6-4db4-9095-62ef38c7915e\") " pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-glkxj" Jul 29 15:56:38.067921 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:38.067864 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9c6k\" (UniqueName: \"kubernetes.io/projected/13913735-c5c6-4db4-9095-62ef38c7915e-kube-api-access-r9c6k\") pod \"perf-node-gather-daemonset-glkxj\" (UID: \"13913735-c5c6-4db4-9095-62ef38c7915e\") " pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-glkxj" Jul 29 15:56:38.067921 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:38.067891 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/13913735-c5c6-4db4-9095-62ef38c7915e-proc\") pod \"perf-node-gather-daemonset-glkxj\" (UID: \"13913735-c5c6-4db4-9095-62ef38c7915e\") " pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-glkxj" Jul 29 15:56:38.068117 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:38.067975 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/13913735-c5c6-4db4-9095-62ef38c7915e-proc\") pod \"perf-node-gather-daemonset-glkxj\" (UID: \"13913735-c5c6-4db4-9095-62ef38c7915e\") " pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-glkxj" Jul 29 15:56:38.068117 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:38.067979 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13913735-c5c6-4db4-9095-62ef38c7915e-lib-modules\") pod \"perf-node-gather-daemonset-glkxj\" (UID: \"13913735-c5c6-4db4-9095-62ef38c7915e\") " pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-glkxj" Jul 29 15:56:38.068117 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:38.067975 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/13913735-c5c6-4db4-9095-62ef38c7915e-podres\") pod \"perf-node-gather-daemonset-glkxj\" (UID: \"13913735-c5c6-4db4-9095-62ef38c7915e\") " pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-glkxj" Jul 29 15:56:38.076418 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:38.076386 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9c6k\" (UniqueName: \"kubernetes.io/projected/13913735-c5c6-4db4-9095-62ef38c7915e-kube-api-access-r9c6k\") pod \"perf-node-gather-daemonset-glkxj\" (UID: \"13913735-c5c6-4db4-9095-62ef38c7915e\") " pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-glkxj" Jul 29 15:56:38.178320 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:38.178291 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-glkxj" Jul 29 15:56:38.346638 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:38.346598 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vcsgn/perf-node-gather-daemonset-glkxj"] Jul 29 15:56:38.350237 ip-10-0-141-213 kubenswrapper[2584]: W0729 15:56:38.350205 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod13913735_c5c6_4db4_9095_62ef38c7915e.slice/crio-fc3ad71556c609a0119d9a33482d4a73135a2e6eadbbdf80dbb2bbe31893b34a WatchSource:0}: Error finding container fc3ad71556c609a0119d9a33482d4a73135a2e6eadbbdf80dbb2bbe31893b34a: Status 404 returned error can't find the container with id fc3ad71556c609a0119d9a33482d4a73135a2e6eadbbdf80dbb2bbe31893b34a Jul 29 15:56:39.209482 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:39.209433 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-glkxj" event={"ID":"13913735-c5c6-4db4-9095-62ef38c7915e","Type":"ContainerStarted","Data":"75c246722cb5ab23ac299a0e2ab0acf9e9f60ac3a021ec51df39c5aee7d0f0dc"} Jul 29 15:56:39.209879 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:39.209501 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-glkxj" event={"ID":"13913735-c5c6-4db4-9095-62ef38c7915e","Type":"ContainerStarted","Data":"fc3ad71556c609a0119d9a33482d4a73135a2e6eadbbdf80dbb2bbe31893b34a"} Jul 29 15:56:39.209879 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:39.209555 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-glkxj" Jul 29 15:56:39.227870 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:39.227820 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-glkxj" podStartSLOduration=2.227804956 podStartE2EDuration="2.227804956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:56:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:56:39.227096112 +0000 UTC m=+601.071393591" watchObservedRunningTime="2026-07-29 15:56:39.227804956 +0000 UTC m=+601.072102434" Jul 29 15:56:39.401346 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:39.401315 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6b4dc_bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d/dns/0.log" Jul 29 15:56:39.451522 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:39.451497 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6b4dc_bb99fa2c-e1b5-41ab-8e74-1dd4ed8a4b6d/kube-rbac-proxy/0.log" Jul 29 15:56:39.569223 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:39.569151 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7w9zd_4f782ba3-b2ac-46c7-ad06-db9aa6721614/dns-node-resolver/0.log" Jul 29 15:56:40.021031 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:40.021000 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7cb5498d56-cr7sg_bba31de0-388f-4f77-8eed-0c6acb4d5737/registry/0.log" Jul 29 15:56:40.045924 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:40.045895 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-254br_f9640ca5-c93f-49dc-9216-d3ea149abb4f/node-ca/0.log" Jul 29 15:56:41.202858 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:41.202830 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r22bj_66ca9e27-70cd-4be5-ab36-0ea5a7027c56/serve-healthcheck-canary/0.log" Jul 29 15:56:41.590042 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:41.589962 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6tnpm_47b0d5da-0f97-4139-a01a-cd41ed81f6f0/kube-rbac-proxy/0.log" Jul 29 15:56:41.612155 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:41.612121 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6tnpm_47b0d5da-0f97-4139-a01a-cd41ed81f6f0/exporter/0.log" Jul 29 15:56:41.634980 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:41.634958 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6tnpm_47b0d5da-0f97-4139-a01a-cd41ed81f6f0/extractor/0.log" Jul 29 15:56:45.222105 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:45.222079 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-glkxj" Jul 29 15:56:46.659200 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:46.659172 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-7htgr_3b1b8735-5160-40d9-8939-722146220f9f/migrator/0.log" Jul 29 15:56:46.696664 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:46.696641 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-7htgr_3b1b8735-5160-40d9-8939-722146220f9f/graceful-termination/0.log" Jul 29 15:56:48.123711 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:48.123637 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-48lc4_7192759b-4ce8-4271-a907-7d4c227599b1/kube-multus/0.log" Jul 29 15:56:48.146042 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:48.146020 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6nm7c_7e8b3213-5f73-40dc-8357-d1ae21efd3d9/kube-multus-additional-cni-plugins/0.log" Jul 29 15:56:48.170664 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:48.170644 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6nm7c_7e8b3213-5f73-40dc-8357-d1ae21efd3d9/egress-router-binary-copy/0.log" Jul 29 15:56:48.192638 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:48.192612 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6nm7c_7e8b3213-5f73-40dc-8357-d1ae21efd3d9/cni-plugins/0.log" Jul 29 15:56:48.214597 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:48.214571 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6nm7c_7e8b3213-5f73-40dc-8357-d1ae21efd3d9/bond-cni-plugin/0.log" Jul 29 15:56:48.236107 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:48.236085 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6nm7c_7e8b3213-5f73-40dc-8357-d1ae21efd3d9/routeoverride-cni/0.log" Jul 29 15:56:48.260175 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:48.260152 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6nm7c_7e8b3213-5f73-40dc-8357-d1ae21efd3d9/whereabouts-cni-bincopy/0.log" Jul 29 15:56:48.280294 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:48.280273 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6nm7c_7e8b3213-5f73-40dc-8357-d1ae21efd3d9/whereabouts-cni/0.log" Jul 29 15:56:48.714139 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:48.714109 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-64nqz_7377e78e-3c71-4fcb-918c-eb6c54e2d562/network-metrics-daemon/0.log" Jul 29 15:56:48.732940 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:48.732910 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-64nqz_7377e78e-3c71-4fcb-918c-eb6c54e2d562/kube-rbac-proxy/0.log" Jul 29 15:56:49.898093 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:49.898058 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5rxf_dd61573c-d06b-46e4-afea-887f283a1e1a/ovn-controller/0.log" Jul 29 15:56:49.914456 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:49.914398 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5rxf_dd61573c-d06b-46e4-afea-887f283a1e1a/ovn-acl-logging/0.log" Jul 29 15:56:49.936374 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:49.936346 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5rxf_dd61573c-d06b-46e4-afea-887f283a1e1a/kube-rbac-proxy-node/0.log" Jul 29 15:56:49.961325 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:49.961296 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5rxf_dd61573c-d06b-46e4-afea-887f283a1e1a/kube-rbac-proxy-ovn-metrics/0.log" Jul 29 15:56:49.981917 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:49.981897 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5rxf_dd61573c-d06b-46e4-afea-887f283a1e1a/northd/0.log" Jul 29 15:56:50.002553 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:50.002535 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5rxf_dd61573c-d06b-46e4-afea-887f283a1e1a/nbdb/0.log" Jul 29 15:56:50.025203 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:50.025184 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5rxf_dd61573c-d06b-46e4-afea-887f283a1e1a/sbdb/0.log" Jul 29 15:56:50.081167 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:50.081132 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5rxf_dd61573c-d06b-46e4-afea-887f283a1e1a/ovnkube-controller/0.log" Jul 29 15:56:51.083726 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:51.083699 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-rwvpj_e7e55e83-cfda-4e11-8182-e93e305e78bb/network-check-target-container/0.log" Jul 29 15:56:52.013313 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:52.013291 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-wx6jd_ea5db5cf-d8ce-4fac-b6e7-13e03e05f535/iptables-alerter/0.log" Jul 29 15:56:52.587324 ip-10-0-141-213 kubenswrapper[2584]: I0729 15:56:52.587295 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-qqxjg_0008c431-6fb6-4973-a20c-c3f28caa264c/tuned/0.log"