Jul 29 22:44:32.567346 ip-10-0-138-44 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 29 22:44:32.567354 ip-10-0-138-44 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 29 22:44:32.567362 ip-10-0-138-44 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 29 22:44:32.567566 ip-10-0-138-44 systemd[1]: Failed to start Kubernetes Kubelet. Jul 29 22:44:41.731717 ip-10-0-138-44 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jul 29 22:44:41.731730 ip-10-0-138-44 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 6b8d2c2ad4644da0be34aa3b310ea393 -- Jul 29 22:46:29.941958 ip-10-0-138-44 systemd[1]: Starting Kubernetes Kubelet... Jul 29 22:46:30.288021 ip-10-0-138-44 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 22:46:30.288021 ip-10-0-138-44 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 29 22:46:30.288021 ip-10-0-138-44 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 22:46:30.288021 ip-10-0-138-44 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 29 22:46:30.288021 ip-10-0-138-44 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 22:46:30.288998 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.288909 2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 29 22:46:30.293370 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293352 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 22:46:30.293370 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293370 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 22:46:30.293441 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293374 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 22:46:30.293441 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293378 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 22:46:30.293441 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293381 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 22:46:30.293441 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293385 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 22:46:30.293441 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293388 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 22:46:30.293441 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293391 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 22:46:30.293441 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293394 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 22:46:30.293441 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293396 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 22:46:30.293441 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293399 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 22:46:30.293441 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293402 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 22:46:30.293441 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293404 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 22:46:30.293441 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293418 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 22:46:30.293441 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293421 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 22:46:30.293441 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293424 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 22:46:30.293441 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293427 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 22:46:30.293441 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293429 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 22:46:30.293441 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293432 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 22:46:30.293441 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293434 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 22:46:30.293441 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293437 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 22:46:30.293441 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293439 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 22:46:30.294021 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293442 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 22:46:30.294021 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293445 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 22:46:30.294021 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293448 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 22:46:30.294021 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293450 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 22:46:30.294021 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293453 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 22:46:30.294021 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293456 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 22:46:30.294021 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293459 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 22:46:30.294021 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293462 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 22:46:30.294021 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293465 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 22:46:30.294021 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293467 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 22:46:30.294021 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293470 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 22:46:30.294021 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293472 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 22:46:30.294021 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293475 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 22:46:30.294021 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293477 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 22:46:30.294021 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293480 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 22:46:30.294021 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293482 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 22:46:30.294021 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293485 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 22:46:30.294021 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293488 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 22:46:30.294021 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293492 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 22:46:30.294021 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293495 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 22:46:30.294521 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293498 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 22:46:30.294521 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293501 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 22:46:30.294521 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293504 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 29 22:46:30.294521 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293507 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 22:46:30.294521 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293520 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 22:46:30.294521 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293523 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 22:46:30.294521 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293526 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 22:46:30.294521 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293528 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 22:46:30.294521 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293531 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 22:46:30.294521 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293534 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 22:46:30.294521 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293537 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 22:46:30.294521 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293540 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 22:46:30.294521 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293543 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 22:46:30.294521 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293545 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 22:46:30.294521 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293548 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 22:46:30.294521 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293550 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 22:46:30.294521 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293553 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 22:46:30.294521 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293556 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 22:46:30.294521 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293558 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 22:46:30.294521 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293560 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 22:46:30.295041 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293563 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 22:46:30.295041 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293568 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 22:46:30.295041 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293572 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 22:46:30.295041 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293575 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 22:46:30.295041 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293578 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 22:46:30.295041 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293581 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 22:46:30.295041 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293584 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 22:46:30.295041 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293586 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 22:46:30.295041 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293589 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 22:46:30.295041 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293592 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 22:46:30.295041 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293594 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 22:46:30.295041 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293597 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 22:46:30.295041 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293599 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 22:46:30.295041 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293602 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 22:46:30.295041 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293605 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 22:46:30.295041 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293608 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 22:46:30.295041 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293610 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 22:46:30.295041 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293618 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 22:46:30.295041 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293621 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 22:46:30.295499 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293624 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 22:46:30.295499 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293626 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 22:46:30.295499 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293641 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 22:46:30.295499 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293644 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 22:46:30.295499 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293646 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 22:46:30.295499 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293650 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 22:46:30.295499 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293652 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 22:46:30.295499 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293655 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 22:46:30.295499 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293657 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 22:46:30.295499 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293660 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 22:46:30.295499 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293663 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 22:46:30.295499 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293665 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 22:46:30.295499 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293668 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 22:46:30.295499 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293670 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 22:46:30.295499 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293673 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 22:46:30.295499 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293675 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 22:46:30.295499 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293678 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 22:46:30.295499 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.293681 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 22:46:30.295499 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294427 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 22:46:30.295499 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294433 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 22:46:30.296007 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294436 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 22:46:30.296007 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294439 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 22:46:30.296007 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294442 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 22:46:30.296007 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294445 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 22:46:30.296007 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294448 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 22:46:30.296007 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294451 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 22:46:30.296007 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294453 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 22:46:30.296007 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294456 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 22:46:30.296007 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294458 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 22:46:30.296007 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294462 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 22:46:30.296007 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294465 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 22:46:30.296007 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294469 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 22:46:30.296007 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294471 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 22:46:30.296007 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294474 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 22:46:30.296007 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294477 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 22:46:30.296007 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294479 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 22:46:30.296007 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294482 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 22:46:30.296007 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294485 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 22:46:30.296007 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294488 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 22:46:30.296007 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294490 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 22:46:30.296724 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294493 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 22:46:30.296724 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294497 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 22:46:30.296724 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294501 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 22:46:30.296724 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294504 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 22:46:30.296724 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294507 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 22:46:30.296724 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294510 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 22:46:30.296724 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294513 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 22:46:30.296724 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294515 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 22:46:30.296724 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294518 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 22:46:30.296724 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294520 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 22:46:30.296724 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294523 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 22:46:30.296724 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294526 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 22:46:30.296724 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294528 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 22:46:30.296724 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294533 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 22:46:30.296724 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294537 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 22:46:30.296724 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294541 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 22:46:30.296724 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294544 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 22:46:30.296724 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294548 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 22:46:30.296724 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294551 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 22:46:30.297437 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294554 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 22:46:30.297437 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294557 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 22:46:30.297437 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294560 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 22:46:30.297437 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294562 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 22:46:30.297437 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294565 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 22:46:30.297437 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294568 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 22:46:30.297437 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294571 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 22:46:30.297437 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294583 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 22:46:30.297437 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294587 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 22:46:30.297437 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294590 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 22:46:30.297437 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294593 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 22:46:30.297437 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294597 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 22:46:30.297437 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294599 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 22:46:30.297437 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294602 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 22:46:30.297437 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294604 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 22:46:30.297437 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294607 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 22:46:30.297437 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294609 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 22:46:30.297437 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294612 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 22:46:30.297437 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294615 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 22:46:30.297437 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294617 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 29 22:46:30.297973 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294620 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 22:46:30.297973 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294623 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 22:46:30.297973 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294625 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 22:46:30.297973 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294641 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 22:46:30.297973 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294644 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 22:46:30.297973 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294647 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 22:46:30.297973 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294650 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 22:46:30.297973 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294653 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 22:46:30.297973 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294659 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 22:46:30.297973 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294661 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 22:46:30.297973 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294664 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 22:46:30.297973 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294666 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 22:46:30.297973 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294669 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 22:46:30.297973 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294672 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 22:46:30.297973 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294675 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 22:46:30.297973 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294677 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 22:46:30.297973 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294680 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 22:46:30.297973 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294682 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 22:46:30.297973 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294686 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 22:46:30.297973 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294688 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 22:46:30.298483 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294691 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 22:46:30.298483 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294693 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 22:46:30.298483 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294696 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 22:46:30.298483 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294699 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 22:46:30.298483 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294701 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 22:46:30.298483 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294704 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 22:46:30.298483 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294706 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 22:46:30.298483 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294710 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 22:46:30.298483 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294713 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 22:46:30.298483 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294716 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 22:46:30.298483 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294718 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 22:46:30.298483 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294721 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 22:46:30.298483 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294723 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 22:46:30.298483 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294726 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 22:46:30.298483 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294729 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 22:46:30.298483 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294731 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 22:46:30.298483 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294734 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 22:46:30.298483 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.294737 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 22:46:30.298483 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295110 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 22:46:30.298483 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295115 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 22:46:30.298998 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295120 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 22:46:30.298998 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295123 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 22:46:30.298998 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295126 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 22:46:30.298998 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295129 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 22:46:30.298998 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295131 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 22:46:30.298998 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295134 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 22:46:30.298998 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295137 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 22:46:30.298998 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295142 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 22:46:30.298998 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295146 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 22:46:30.298998 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295148 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 22:46:30.298998 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295152 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 22:46:30.298998 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295154 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 22:46:30.298998 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295157 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 22:46:30.298998 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295160 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 22:46:30.298998 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295162 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 22:46:30.298998 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295165 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 22:46:30.298998 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295168 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 22:46:30.298998 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295170 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 22:46:30.298998 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295173 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 22:46:30.298998 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295175 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 22:46:30.299519 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295178 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 22:46:30.299519 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295181 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 22:46:30.299519 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295185 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 22:46:30.299519 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295189 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 22:46:30.299519 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295192 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 29 22:46:30.299519 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295195 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 22:46:30.299519 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295198 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 22:46:30.299519 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295201 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 22:46:30.299519 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295203 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 22:46:30.299519 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295206 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 22:46:30.299519 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295209 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 22:46:30.299519 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295212 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 22:46:30.299519 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295216 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 22:46:30.299519 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295218 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 22:46:30.299519 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295221 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 22:46:30.299519 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295223 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 22:46:30.299519 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295227 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 22:46:30.299519 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295230 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 22:46:30.299519 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295232 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 22:46:30.299519 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295236 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 22:46:30.300015 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295239 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 22:46:30.300015 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295242 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 22:46:30.300015 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295244 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 22:46:30.300015 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295247 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 22:46:30.300015 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295249 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 22:46:30.300015 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295252 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 22:46:30.300015 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295255 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 22:46:30.300015 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295259 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 22:46:30.300015 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295262 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 22:46:30.300015 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295265 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 22:46:30.300015 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295267 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 22:46:30.300015 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295270 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 22:46:30.300015 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295273 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 22:46:30.300015 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295275 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 22:46:30.300015 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295278 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 22:46:30.300015 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295280 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 22:46:30.300015 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295283 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 22:46:30.300015 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295286 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 22:46:30.300015 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295288 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 22:46:30.300502 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295291 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 22:46:30.300502 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295293 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 22:46:30.300502 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295296 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 22:46:30.300502 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295298 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 22:46:30.300502 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295301 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 22:46:30.300502 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295304 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 22:46:30.300502 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295307 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 22:46:30.300502 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295309 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 22:46:30.300502 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295312 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 22:46:30.300502 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295315 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 22:46:30.300502 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295317 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 22:46:30.300502 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295320 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 22:46:30.300502 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295324 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 22:46:30.300502 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295326 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 22:46:30.300502 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295329 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 22:46:30.300502 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295331 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 22:46:30.300502 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295334 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 22:46:30.300502 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295337 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 22:46:30.300502 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295339 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 22:46:30.300502 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295342 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 22:46:30.301045 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295346 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 22:46:30.301045 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295349 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 22:46:30.301045 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295352 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 22:46:30.301045 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295356 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 22:46:30.301045 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295358 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 22:46:30.301045 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295362 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 22:46:30.301045 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295364 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 22:46:30.301045 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295367 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 22:46:30.301045 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295369 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 22:46:30.301045 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295372 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 22:46:30.301045 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295374 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 22:46:30.301045 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295377 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 22:46:30.301045 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295380 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 22:46:30.301045 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295382 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 22:46:30.301045 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295385 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 22:46:30.301045 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295388 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 22:46:30.301045 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295390 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 22:46:30.301045 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.295394 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 22:46:30.301045 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295459 2570 flags.go:64] FLAG: --address="0.0.0.0" Jul 29 22:46:30.301045 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295466 2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 29 22:46:30.301524 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295472 2570 flags.go:64] FLAG: --anonymous-auth="true" Jul 29 22:46:30.301524 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295477 2570 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 29 22:46:30.301524 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295481 2570 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 29 22:46:30.301524 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295484 2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 29 22:46:30.301524 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295490 2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 29 22:46:30.301524 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295494 2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 29 22:46:30.301524 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295497 2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 29 22:46:30.301524 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295501 2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 29 22:46:30.301524 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295504 2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 29 22:46:30.301524 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295508 2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 29 22:46:30.301524 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295511 2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 29 22:46:30.301524 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295515 2570 flags.go:64] FLAG: --cgroup-root="" Jul 29 22:46:30.301524 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295518 2570 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 29 22:46:30.301524 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295520 2570 flags.go:64] FLAG: --client-ca-file="" Jul 29 22:46:30.301524 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295523 2570 flags.go:64] FLAG: --cloud-provider="external" Jul 29 22:46:30.301524 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295526 2570 flags.go:64] FLAG: --cluster-dns="[]" Jul 29 22:46:30.301524 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295530 2570 flags.go:64] FLAG: --cluster-domain="" Jul 29 22:46:30.301524 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295533 2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 29 22:46:30.301524 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295536 2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 29 22:46:30.301524 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295539 2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 29 22:46:30.301524 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295543 2570 flags.go:64] FLAG: --container-log-max-files="5" Jul 29 22:46:30.301524 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295547 2570 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 29 22:46:30.301524 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295549 2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 29 22:46:30.302104 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295553 2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 29 22:46:30.302104 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295556 2570 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 29 22:46:30.302104 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295559 2570 flags.go:64] FLAG: --contention-profiling="false" Jul 29 22:46:30.302104 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295562 2570 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 29 22:46:30.302104 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295565 2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 29 22:46:30.302104 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295568 2570 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 29 22:46:30.302104 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295573 2570 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 29 22:46:30.302104 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295577 2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 29 22:46:30.302104 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295580 2570 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 29 22:46:30.302104 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295583 2570 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 29 22:46:30.302104 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295586 2570 flags.go:64] FLAG: --enable-load-reader="false" Jul 29 22:46:30.302104 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295589 2570 flags.go:64] FLAG: --enable-server="true" Jul 29 22:46:30.302104 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295592 2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 29 22:46:30.302104 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295598 2570 flags.go:64] FLAG: --event-burst="100" Jul 29 22:46:30.302104 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295601 2570 flags.go:64] FLAG: --event-qps="50" Jul 29 22:46:30.302104 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295604 2570 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 29 22:46:30.302104 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295607 2570 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 29 22:46:30.302104 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295610 2570 flags.go:64] FLAG: --eviction-hard="" Jul 29 22:46:30.302104 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295614 2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 29 22:46:30.302104 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295617 2570 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 29 22:46:30.302104 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295623 2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 29 22:46:30.302104 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295639 2570 flags.go:64] FLAG: --eviction-soft="" Jul 29 22:46:30.302104 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295643 2570 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 29 22:46:30.302104 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295646 2570 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 29 22:46:30.302104 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295649 2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 29 22:46:30.302766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295652 2570 flags.go:64] FLAG: --experimental-mounter-path="" Jul 29 22:46:30.302766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295655 2570 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 29 22:46:30.302766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295658 2570 flags.go:64] FLAG: --fail-swap-on="true" Jul 29 22:46:30.302766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295661 2570 flags.go:64] FLAG: --feature-gates="" Jul 29 22:46:30.302766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295665 2570 flags.go:64] FLAG: --file-check-frequency="20s" Jul 29 22:46:30.302766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295668 2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 29 22:46:30.302766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295671 2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 29 22:46:30.302766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295674 2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 29 22:46:30.302766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295677 2570 flags.go:64] FLAG: --healthz-port="10248" Jul 29 22:46:30.302766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295680 2570 flags.go:64] FLAG: --help="false" Jul 29 22:46:30.302766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295683 2570 flags.go:64] FLAG: --hostname-override="ip-10-0-138-44.ec2.internal" Jul 29 22:46:30.302766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295686 2570 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 29 22:46:30.302766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295689 2570 flags.go:64] FLAG: --http-check-frequency="20s" Jul 29 22:46:30.302766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295694 2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 29 22:46:30.302766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295697 2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 29 22:46:30.302766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295700 2570 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 29 22:46:30.302766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295703 2570 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 29 22:46:30.302766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295707 2570 flags.go:64] FLAG: --image-service-endpoint="" Jul 29 22:46:30.302766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295709 2570 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 29 22:46:30.302766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295712 2570 flags.go:64] FLAG: --kube-api-burst="100" Jul 29 22:46:30.302766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295717 2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 29 22:46:30.302766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295720 2570 flags.go:64] FLAG: --kube-api-qps="50" Jul 29 22:46:30.302766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295723 2570 flags.go:64] FLAG: --kube-reserved="" Jul 29 22:46:30.302766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295726 2570 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 29 22:46:30.303375 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295729 2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 29 22:46:30.303375 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295732 2570 flags.go:64] FLAG: --kubelet-cgroups="" Jul 29 22:46:30.303375 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295734 2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 29 22:46:30.303375 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295737 2570 flags.go:64] FLAG: --lock-file="" Jul 29 22:46:30.303375 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295741 2570 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 29 22:46:30.303375 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295745 2570 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 29 22:46:30.303375 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295747 2570 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 29 22:46:30.303375 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295753 2570 flags.go:64] FLAG: --log-json-split-stream="false" Jul 29 22:46:30.303375 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295756 2570 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 29 22:46:30.303375 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295758 2570 flags.go:64] FLAG: --log-text-split-stream="false" Jul 29 22:46:30.303375 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295761 2570 flags.go:64] FLAG: --logging-format="text" Jul 29 22:46:30.303375 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295769 2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 29 22:46:30.303375 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295772 2570 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 29 22:46:30.303375 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295775 2570 flags.go:64] FLAG: --manifest-url="" Jul 29 22:46:30.303375 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295778 2570 flags.go:64] FLAG: --manifest-url-header="" Jul 29 22:46:30.303375 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295782 2570 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 29 22:46:30.303375 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295785 2570 flags.go:64] FLAG: --max-open-files="1000000" Jul 29 22:46:30.303375 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295789 2570 flags.go:64] FLAG: --max-pods="110" Jul 29 22:46:30.303375 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295793 2570 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 29 22:46:30.303375 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295796 2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 29 22:46:30.303375 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295798 2570 flags.go:64] FLAG: --memory-manager-policy="None" Jul 29 22:46:30.303375 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295803 2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 29 22:46:30.303375 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295807 2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 29 22:46:30.303375 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295809 2570 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 29 22:46:30.303375 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295812 2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 29 22:46:30.303989 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295819 2570 flags.go:64] FLAG: --node-status-max-images="50" Jul 29 22:46:30.303989 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295822 2570 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 29 22:46:30.303989 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295825 2570 flags.go:64] FLAG: --oom-score-adj="-999" Jul 29 22:46:30.303989 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295830 2570 flags.go:64] FLAG: --pod-cidr="" Jul 29 22:46:30.303989 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295833 2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 29 22:46:30.303989 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295838 2570 flags.go:64] FLAG: --pod-manifest-path="" Jul 29 22:46:30.303989 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295841 2570 flags.go:64] FLAG: --pod-max-pids="-1" Jul 29 22:46:30.303989 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295844 2570 flags.go:64] FLAG: --pods-per-core="0" Jul 29 22:46:30.303989 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295847 2570 flags.go:64] FLAG: --port="10250" Jul 29 22:46:30.303989 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295851 2570 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 29 22:46:30.303989 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295854 2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09a544e2bd60acb2c" Jul 29 22:46:30.303989 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295857 2570 flags.go:64] FLAG: --qos-reserved="" Jul 29 22:46:30.303989 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295860 2570 flags.go:64] FLAG: --read-only-port="10255" Jul 29 22:46:30.303989 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295863 2570 flags.go:64] FLAG: --register-node="true" Jul 29 22:46:30.303989 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295866 2570 flags.go:64] FLAG: --register-with-taints="" Jul 29 22:46:30.303989 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295870 2570 flags.go:64] FLAG: --registry-burst="10" Jul 29 22:46:30.303989 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295873 2570 flags.go:64] FLAG: --registry-qps="5" Jul 29 22:46:30.303989 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295876 2570 flags.go:64] FLAG: --reserved-cpus="" Jul 29 22:46:30.303989 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295879 2570 flags.go:64] FLAG: --reserved-memory="" Jul 29 22:46:30.303989 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295883 2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 29 22:46:30.303989 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295886 2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 29 22:46:30.303989 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295889 2570 flags.go:64] FLAG: --rotate-certificates="false" Jul 29 22:46:30.303989 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295892 2570 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 29 22:46:30.303989 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295895 2570 flags.go:64] FLAG: --runonce="false" Jul 29 22:46:30.303989 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295898 2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 29 22:46:30.304617 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295901 2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 29 22:46:30.304617 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295904 2570 flags.go:64] FLAG: --seccomp-default="false" Jul 29 22:46:30.304617 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295907 2570 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 29 22:46:30.304617 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295910 2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 29 22:46:30.304617 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295914 2570 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 29 22:46:30.304617 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295917 2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 29 22:46:30.304617 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295921 2570 flags.go:64] FLAG: --storage-driver-password="root" Jul 29 22:46:30.304617 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295924 2570 flags.go:64] FLAG: --storage-driver-secure="false" Jul 29 22:46:30.304617 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295927 2570 flags.go:64] FLAG: --storage-driver-table="stats" Jul 29 22:46:30.304617 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295930 2570 flags.go:64] FLAG: --storage-driver-user="root" Jul 29 22:46:30.304617 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295934 2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 29 22:46:30.304617 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295937 2570 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 29 22:46:30.304617 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295940 2570 flags.go:64] FLAG: --system-cgroups="" Jul 29 22:46:30.304617 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295943 2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 29 22:46:30.304617 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295948 2570 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 29 22:46:30.304617 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295951 2570 flags.go:64] FLAG: --tls-cert-file="" Jul 29 22:46:30.304617 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295954 2570 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 29 22:46:30.304617 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295958 2570 flags.go:64] FLAG: --tls-min-version="" Jul 29 22:46:30.304617 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295961 2570 flags.go:64] FLAG: --tls-private-key-file="" Jul 29 22:46:30.304617 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295964 2570 flags.go:64] FLAG: --topology-manager-policy="none" Jul 29 22:46:30.304617 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295967 2570 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 29 22:46:30.304617 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295970 2570 flags.go:64] FLAG: --topology-manager-scope="container" Jul 29 22:46:30.304617 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295973 2570 flags.go:64] FLAG: --v="2" Jul 29 22:46:30.304617 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295977 2570 flags.go:64] FLAG: --version="false" Jul 29 22:46:30.304617 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295981 2570 flags.go:64] FLAG: --vmodule="" Jul 29 22:46:30.305237 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295987 2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 29 22:46:30.305237 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.295991 2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 29 22:46:30.305237 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296397 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 22:46:30.305237 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296410 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 22:46:30.305237 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296416 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 22:46:30.305237 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296420 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 22:46:30.305237 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296425 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 22:46:30.305237 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296431 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 22:46:30.305237 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296435 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 22:46:30.305237 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296440 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 22:46:30.305237 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296445 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 22:46:30.305237 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296456 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 22:46:30.305237 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296460 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 22:46:30.305237 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296465 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 22:46:30.305237 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296469 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 22:46:30.305237 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296473 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 29 22:46:30.305237 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296477 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 22:46:30.305237 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296482 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 22:46:30.305237 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296487 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 22:46:30.305237 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296491 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 22:46:30.305780 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296495 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 22:46:30.305780 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296499 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 22:46:30.305780 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296503 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 22:46:30.305780 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296507 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 22:46:30.305780 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296516 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 22:46:30.305780 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296520 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 22:46:30.305780 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296525 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 22:46:30.305780 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296529 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 22:46:30.305780 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296534 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 22:46:30.305780 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296538 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 22:46:30.305780 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296542 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 22:46:30.305780 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296546 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 22:46:30.305780 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296551 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 22:46:30.305780 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296555 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 22:46:30.305780 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296559 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 22:46:30.305780 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296564 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 22:46:30.305780 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296568 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 22:46:30.305780 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296577 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 22:46:30.305780 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296581 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 22:46:30.305780 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296586 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 22:46:30.306258 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296590 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 22:46:30.306258 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296595 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 22:46:30.306258 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296600 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 22:46:30.306258 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296605 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 22:46:30.306258 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296609 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 22:46:30.306258 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296613 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 22:46:30.306258 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296618 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 22:46:30.306258 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296622 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 22:46:30.306258 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296626 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 22:46:30.306258 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296649 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 22:46:30.306258 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296654 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 22:46:30.306258 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296659 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 22:46:30.306258 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296663 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 22:46:30.306258 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296668 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 22:46:30.306258 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296672 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 22:46:30.306258 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296677 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 22:46:30.306258 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296682 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 22:46:30.306258 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296687 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 22:46:30.306258 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296691 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 22:46:30.306258 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296696 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 22:46:30.306773 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296700 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 22:46:30.306773 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296705 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 22:46:30.306773 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296714 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 22:46:30.306773 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296718 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 22:46:30.306773 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296722 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 22:46:30.306773 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296727 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 22:46:30.306773 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296731 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 22:46:30.306773 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296736 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 22:46:30.306773 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296740 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 22:46:30.306773 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296744 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 22:46:30.306773 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296749 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 22:46:30.306773 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296753 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 22:46:30.306773 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296757 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 22:46:30.306773 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296762 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 22:46:30.306773 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296766 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 22:46:30.306773 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296776 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 22:46:30.306773 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296781 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 22:46:30.306773 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296785 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 22:46:30.306773 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296789 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 22:46:30.306773 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296793 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 22:46:30.307250 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296798 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 22:46:30.307250 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296803 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 22:46:30.307250 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296809 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 22:46:30.307250 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296815 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 22:46:30.307250 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296819 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 22:46:30.307250 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296823 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 22:46:30.307250 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296832 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 22:46:30.307250 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296836 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 22:46:30.307250 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296841 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 22:46:30.307250 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296845 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 22:46:30.307250 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296849 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 22:46:30.307250 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296854 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 22:46:30.307250 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296858 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 22:46:30.307250 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296862 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 22:46:30.307250 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296867 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 22:46:30.307250 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296872 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 22:46:30.307250 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296879 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 22:46:30.307250 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296886 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 22:46:30.307690 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296896 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 22:46:30.307690 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296902 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 22:46:30.307690 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.296906 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 22:46:30.307690 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.296915 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 22:46:30.307690 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.304068 2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 29 22:46:30.307690 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.304083 2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 29 22:46:30.307690 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.304834 2570 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 29 22:46:30.307690 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.304843 2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 29 22:46:30.307690 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304906 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 22:46:30.307690 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304911 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 22:46:30.307690 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304915 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 22:46:30.307690 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304919 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 22:46:30.307690 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304922 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 22:46:30.307690 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304925 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 22:46:30.307690 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304928 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 22:46:30.308059 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304931 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 22:46:30.308059 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304934 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 22:46:30.308059 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304937 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 22:46:30.308059 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304940 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 22:46:30.308059 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304942 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 22:46:30.308059 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304945 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 22:46:30.308059 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304948 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 22:46:30.308059 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304950 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 22:46:30.308059 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304953 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 22:46:30.308059 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304956 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 22:46:30.308059 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304959 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 22:46:30.308059 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304961 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 22:46:30.308059 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304964 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 22:46:30.308059 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304967 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 22:46:30.308059 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304969 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 22:46:30.308059 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304972 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 22:46:30.308059 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304975 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 22:46:30.308059 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304977 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 22:46:30.308059 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304980 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 22:46:30.308059 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304983 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 22:46:30.308529 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304985 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 22:46:30.308529 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304988 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 22:46:30.308529 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304991 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 22:46:30.308529 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304994 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 22:46:30.308529 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.304997 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 22:46:30.308529 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305000 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 22:46:30.308529 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305003 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 22:46:30.308529 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305006 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 22:46:30.308529 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305009 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 22:46:30.308529 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305012 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 22:46:30.308529 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305014 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 29 22:46:30.308529 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305017 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 22:46:30.308529 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305019 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 22:46:30.308529 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305022 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 22:46:30.308529 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305026 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 22:46:30.308529 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305030 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 22:46:30.308529 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305033 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 22:46:30.308529 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305036 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 22:46:30.308529 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305039 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 22:46:30.308529 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305042 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 22:46:30.309030 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305045 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 22:46:30.309030 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305047 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 22:46:30.309030 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305051 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 22:46:30.309030 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305055 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 22:46:30.309030 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305059 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 22:46:30.309030 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305061 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 22:46:30.309030 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305065 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 22:46:30.309030 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305068 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 22:46:30.309030 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305070 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 22:46:30.309030 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305073 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 22:46:30.309030 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305076 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 22:46:30.309030 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305079 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 22:46:30.309030 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305081 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 22:46:30.309030 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305084 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 22:46:30.309030 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305088 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 22:46:30.309030 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305091 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 22:46:30.309030 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305093 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 22:46:30.309030 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305096 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 22:46:30.309030 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305099 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 22:46:30.309492 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305101 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 22:46:30.309492 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305106 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 22:46:30.309492 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305109 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 22:46:30.309492 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305112 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 22:46:30.309492 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305115 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 22:46:30.309492 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305118 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 22:46:30.309492 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305120 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 22:46:30.309492 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305123 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 22:46:30.309492 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305126 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 22:46:30.309492 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305128 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 22:46:30.309492 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305131 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 22:46:30.309492 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305133 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 22:46:30.309492 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305136 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 22:46:30.309492 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305138 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 22:46:30.309492 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305141 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 22:46:30.309492 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305143 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 22:46:30.309492 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305146 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 22:46:30.309492 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305148 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 22:46:30.309492 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305151 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 22:46:30.309492 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305153 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 22:46:30.310078 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305156 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 22:46:30.310078 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305158 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 22:46:30.310078 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305161 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 22:46:30.310078 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305164 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 22:46:30.310078 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305166 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 22:46:30.310078 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305169 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 22:46:30.310078 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305172 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 22:46:30.310078 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305175 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 22:46:30.310078 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305178 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 22:46:30.310078 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305180 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 22:46:30.310078 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305183 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 22:46:30.310078 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305186 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 22:46:30.310078 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305188 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 22:46:30.310078 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.305193 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 22:46:30.310418 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305324 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 22:46:30.310418 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305330 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 22:46:30.310418 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305334 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 22:46:30.310418 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305338 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 22:46:30.310418 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305341 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 22:46:30.310418 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305344 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 22:46:30.310418 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305347 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 22:46:30.310418 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305350 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 22:46:30.310418 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305353 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 22:46:30.310418 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305355 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 22:46:30.310418 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305359 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 22:46:30.310418 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305362 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 22:46:30.310418 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305365 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 22:46:30.310418 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305367 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 22:46:30.310418 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305370 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 22:46:30.310418 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305373 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 22:46:30.310418 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305376 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 22:46:30.310418 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305378 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 22:46:30.310418 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305381 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 22:46:30.310909 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305384 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 22:46:30.310909 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305386 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 22:46:30.310909 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305389 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 22:46:30.310909 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305392 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 22:46:30.310909 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305395 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 22:46:30.310909 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305397 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 22:46:30.310909 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305400 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 22:46:30.310909 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305403 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 22:46:30.310909 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305406 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 22:46:30.310909 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305409 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 22:46:30.310909 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305411 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 22:46:30.310909 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305414 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 22:46:30.310909 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305416 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 22:46:30.310909 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305419 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 22:46:30.310909 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305422 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 22:46:30.310909 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305424 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 22:46:30.310909 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305427 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 22:46:30.310909 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305429 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 22:46:30.310909 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305432 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 22:46:30.310909 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305435 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 22:46:30.311383 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305437 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 22:46:30.311383 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305440 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 22:46:30.311383 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305443 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 22:46:30.311383 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305446 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 22:46:30.311383 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305450 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 22:46:30.311383 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305454 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 29 22:46:30.311383 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305458 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 22:46:30.311383 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305461 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 22:46:30.311383 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305464 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 22:46:30.311383 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305467 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 22:46:30.311383 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305469 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 22:46:30.311383 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305472 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 22:46:30.311383 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305476 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 22:46:30.311383 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305479 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 22:46:30.311383 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305482 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 22:46:30.311383 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305485 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 22:46:30.311383 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305488 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 22:46:30.311383 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305491 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 22:46:30.311383 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305494 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 22:46:30.311884 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305497 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 22:46:30.311884 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305500 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 22:46:30.311884 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305503 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 22:46:30.311884 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305506 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 22:46:30.311884 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305509 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 22:46:30.311884 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305511 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 22:46:30.311884 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305514 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 22:46:30.311884 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305516 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 22:46:30.311884 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305519 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 22:46:30.311884 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305521 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 22:46:30.311884 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305524 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 22:46:30.311884 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305527 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 22:46:30.311884 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305530 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 22:46:30.311884 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305532 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 22:46:30.311884 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305535 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 22:46:30.311884 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305538 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 22:46:30.311884 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305540 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 22:46:30.311884 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305543 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 22:46:30.311884 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305546 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 22:46:30.311884 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305548 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 22:46:30.312367 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305551 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 22:46:30.312367 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305553 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 22:46:30.312367 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305556 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 22:46:30.312367 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305558 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 22:46:30.312367 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305561 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 22:46:30.312367 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305563 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 22:46:30.312367 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305566 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 22:46:30.312367 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305568 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 22:46:30.312367 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305571 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 22:46:30.312367 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305574 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 22:46:30.312367 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305576 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 22:46:30.312367 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305579 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 22:46:30.312367 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305581 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 22:46:30.312367 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305584 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 22:46:30.312367 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305587 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 22:46:30.312367 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305589 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 22:46:30.312367 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305592 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 22:46:30.312367 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305594 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 22:46:30.312367 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305597 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 22:46:30.312367 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305600 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 22:46:30.312869 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:30.305602 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 22:46:30.312869 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.305607 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 22:46:30.312869 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.305731 2570 server.go:962] "Client rotation is on, will bootstrap in background" Jul 29 22:46:30.312869 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.307864 2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 29 22:46:30.312869 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.309160 2570 server.go:1019] "Starting client certificate rotation" Jul 29 22:46:30.312869 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.309262 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 22:46:30.312869 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.309296 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 22:46:30.312869 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.311558 2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 22:46:30.313075 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.313060 2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 22:46:30.321192 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.321172 2570 log.go:25] "Validated CRI v1 runtime API" Jul 29 22:46:30.323905 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.323889 2570 log.go:25] "Validated CRI v1 image API" Jul 29 22:46:30.324691 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.324676 2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 29 22:46:30.326922 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.326899 2570 fs.go:135] Filesystem UUIDs: map[23bb5762-fbcf-4f1b-a267-a3e4051e7d8a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 7cc79995-7714-4b47-9f2f-7593fae8769f:/dev/nvme0n1p3] Jul 29 22:46:30.326993 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.326920 2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 29 22:46:30.332981 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.332865 2570 manager.go:216] Machine: {Timestamp:2026-07-29 22:46:30.331795429 +0000 UTC m=+0.287891273 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105873 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec294c1bd6ba9509ac3cce97f5e9a91c SystemUUID:ec294c1b-d6ba-9509-ac3c-ce97f5e9a91c BootID:6b8d2c2a-d464-4da0-be34-aa3b310ea393 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d9:35:7f:5c:b3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d9:35:7f:5c:b3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:db:71:b0:eb:4a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 29 22:46:30.332981 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.332973 2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 29 22:46:30.333095 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.333079 2570 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 29 22:46:30.334078 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.334049 2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 29 22:46:30.334208 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.334078 2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-44.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 29 22:46:30.334775 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.334765 2570 topology_manager.go:138] "Creating topology manager with none policy" Jul 29 22:46:30.334808 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.334778 2570 container_manager_linux.go:309] "Creating device plugin manager" Jul 29 22:46:30.334808 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.334786 2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 22:46:30.335403 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.335389 2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 22:46:30.335513 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.335494 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 22:46:30.336265 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.336254 2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 29 22:46:30.339092 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.339080 2570 state_mem.go:36] "Initialized new in-memory state store" Jul 29 22:46:30.339208 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.339198 2570 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 29 22:46:30.339249 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.339227 2570 kubelet.go:486] "Attempting to sync node with API server" Jul 29 22:46:30.339249 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.339237 2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 29 22:46:30.339311 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.339251 2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 29 22:46:30.339311 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.339259 2570 kubelet.go:398] "Adding apiserver pod source" Jul 29 22:46:30.339311 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.339267 2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 29 22:46:30.339751 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.339739 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 22:46:30.339839 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.339764 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 22:46:30.341677 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.341660 2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 29 22:46:30.343678 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.343662 2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 29 22:46:30.343772 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.343700 2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 29 22:46:30.345298 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.345284 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 29 22:46:30.345383 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.345305 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 29 22:46:30.345383 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.345315 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 29 22:46:30.345383 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.345323 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 29 22:46:30.345383 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.345335 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 29 22:46:30.345383 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.345343 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 29 22:46:30.345383 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.345355 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 29 22:46:30.345383 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.345363 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 29 22:46:30.345383 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.345373 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 29 22:46:30.345619 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.345391 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 29 22:46:30.345619 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.345404 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 29 22:46:30.345619 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.345412 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 29 22:46:30.346678 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.346666 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 29 22:46:30.346733 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.346684 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 29 22:46:30.349393 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:30.349372 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-44.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 29 22:46:30.349535 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.349517 2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-44.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 29 22:46:30.349595 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:30.349577 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 29 22:46:30.349834 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.349822 2570 server.go:1268] "Started kubelet" Jul 29 22:46:30.349902 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.349879 2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 29 22:46:30.350044 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.349984 2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 29 22:46:30.350126 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.350056 2570 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 29 22:46:30.351594 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.351578 2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 29 22:46:30.351585 ip-10-0-138-44 systemd[1]: Started Kubernetes Kubelet. Jul 29 22:46:30.353276 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.353260 2570 server.go:310] "Adding debug handlers to kubelet server" Jul 29 22:46:30.355715 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:30.355698 2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 29 22:46:30.356242 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:30.355397 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-44.ec2.internal.18c6e42e6d25b9f9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-44.ec2.internal,UID:ip-10-0-138-44.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-44.ec2.internal,},FirstTimestamp:2026-07-29 22:46:30.349797881 +0000 UTC m=+0.305893726,LastTimestamp:2026-07-29 22:46:30.349797881 +0000 UTC m=+0.305893726,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-44.ec2.internal,}" Jul 29 22:46:30.358892 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.358874 2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 29 22:46:30.358978 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.358962 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 29 22:46:30.359049 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.358990 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nw95w" Jul 29 22:46:30.359121 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:30.359099 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-44.ec2.internal\" not found" Jul 29 22:46:30.359831 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.359812 2570 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 29 22:46:30.359831 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.359817 2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 29 22:46:30.359831 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.359834 2570 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 29 22:46:30.360007 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.359821 2570 factory.go:55] Registering systemd factory Jul 29 22:46:30.360007 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.359907 2570 factory.go:223] Registration of the systemd container factory successfully Jul 29 22:46:30.360007 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.359959 2570 reconstruct.go:97] "Volume reconstruction finished" Jul 29 22:46:30.360007 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.359968 2570 reconciler.go:29] "Reconciler: start to sync state" Jul 29 22:46:30.360209 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.360197 2570 factory.go:153] Registering CRI-O factory Jul 29 22:46:30.360266 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.360214 2570 factory.go:223] Registration of the crio container factory successfully Jul 29 22:46:30.360329 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.360319 2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 29 22:46:30.360383 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.360351 2570 factory.go:103] Registering Raw factory Jul 29 22:46:30.360383 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.360369 2570 manager.go:1196] Started watching for new ooms in manager Jul 29 22:46:30.361054 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.360869 2570 manager.go:349] Starting recovery of all containers Jul 29 22:46:30.361534 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:30.361501 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 29 22:46:30.361755 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:30.361730 2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-44.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 29 22:46:30.366225 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.366190 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nw95w" Jul 29 22:46:30.373671 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.373654 2570 manager.go:354] Recovery completed Jul 29 22:46:30.377954 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.377942 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 22:46:30.384126 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.384106 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-44.ec2.internal" event="NodeHasSufficientMemory" Jul 29 22:46:30.384202 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.384136 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-44.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 22:46:30.384202 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.384147 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-44.ec2.internal" event="NodeHasSufficientPID" Jul 29 22:46:30.384823 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.384808 2570 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 29 22:46:30.384823 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.384821 2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 29 22:46:30.384928 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.384839 2570 state_mem.go:36] "Initialized new in-memory state store" Jul 29 22:46:30.384928 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.384857 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 22:46:30.386188 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.386173 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-44.ec2.internal" event="NodeHasSufficientMemory" Jul 29 22:46:30.386254 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.386198 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-44.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 22:46:30.386254 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.386209 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-44.ec2.internal" event="NodeHasSufficientPID" Jul 29 22:46:30.387900 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.387883 2570 policy_none.go:49] "None policy: Start" Jul 29 22:46:30.387987 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.387907 2570 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 29 22:46:30.387987 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.387923 2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 29 22:46:30.390155 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.390144 2570 policy_none.go:47] "Start" Jul 29 22:46:30.426462 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.426301 2570 manager.go:337] "Starting Device Plugin manager" Jul 29 22:46:30.426558 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:30.426494 2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 29 22:46:30.426558 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.426510 2570 server.go:87] "Starting device plugin registration server" Jul 29 22:46:30.426846 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.426830 2570 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 29 22:46:30.426884 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.426860 2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 29 22:46:30.427132 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.427107 2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 29 22:46:30.427246 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.427205 2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 29 22:46:30.427246 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.427217 2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 29 22:46:30.427692 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:30.427672 2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 29 22:46:30.427753 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:30.427721 2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-44.ec2.internal\" not found" Jul 29 22:46:30.499584 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.499535 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 29 22:46:30.501888 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.500851 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 29 22:46:30.501888 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.500884 2570 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 29 22:46:30.501888 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.500907 2570 kubelet.go:2448] "Starting kubelet main sync loop" Jul 29 22:46:30.501888 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:30.500950 2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 29 22:46:30.503830 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.503811 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 22:46:30.527705 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.527683 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 22:46:30.528630 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.528612 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-44.ec2.internal" event="NodeHasSufficientMemory" Jul 29 22:46:30.528739 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.528660 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-44.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 22:46:30.528739 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.528671 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-44.ec2.internal" event="NodeHasSufficientPID" Jul 29 22:46:30.528739 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.528720 2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-44.ec2.internal" Jul 29 22:46:30.535266 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.535249 2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-44.ec2.internal" Jul 29 22:46:30.535327 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:30.535274 2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-44.ec2.internal\": node \"ip-10-0-138-44.ec2.internal\" not found" Jul 29 22:46:30.552093 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:30.552032 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-44.ec2.internal\" not found" Jul 29 22:46:30.602100 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.602034 2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-44.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-44.ec2.internal"] Jul 29 22:46:30.602307 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.602142 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 22:46:30.603271 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.603247 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-44.ec2.internal" event="NodeHasSufficientMemory" Jul 29 22:46:30.603340 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.603290 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-44.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 22:46:30.603340 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.603302 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-44.ec2.internal" event="NodeHasSufficientPID" Jul 29 22:46:30.605882 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.605868 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 22:46:30.606053 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.606033 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-44.ec2.internal" Jul 29 22:46:30.606173 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.606070 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 22:46:30.607572 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.607555 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-44.ec2.internal" event="NodeHasSufficientMemory" Jul 29 22:46:30.607707 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.607588 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-44.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 22:46:30.607707 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.607610 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-44.ec2.internal" event="NodeHasSufficientPID" Jul 29 22:46:30.608247 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.608229 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-44.ec2.internal" event="NodeHasSufficientMemory" Jul 29 22:46:30.608328 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.608263 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-44.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 22:46:30.608328 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.608278 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-44.ec2.internal" event="NodeHasSufficientPID" Jul 29 22:46:30.610744 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.610727 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-44.ec2.internal" Jul 29 22:46:30.610842 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.610754 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 22:46:30.612420 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.612396 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-44.ec2.internal" event="NodeHasSufficientMemory" Jul 29 22:46:30.612527 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.612424 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-44.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 22:46:30.612527 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.612434 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-44.ec2.internal" event="NodeHasSufficientPID" Jul 29 22:46:30.631401 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:30.631378 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-44.ec2.internal\" not found" node="ip-10-0-138-44.ec2.internal" Jul 29 22:46:30.636985 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:30.636956 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-44.ec2.internal\" not found" node="ip-10-0-138-44.ec2.internal" Jul 29 22:46:30.652770 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:30.652740 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-44.ec2.internal\" not found" Jul 29 22:46:30.662257 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.662234 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1b1f25fc1428d45d3789fd496fdfa89c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-44.ec2.internal\" (UID: \"1b1f25fc1428d45d3789fd496fdfa89c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-44.ec2.internal" Jul 29 22:46:30.662363 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.662265 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b1f25fc1428d45d3789fd496fdfa89c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-44.ec2.internal\" (UID: \"1b1f25fc1428d45d3789fd496fdfa89c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-44.ec2.internal" Jul 29 22:46:30.662363 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.662284 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/28ee2cd84792d9409e5acf4090158792-config\") pod \"kube-apiserver-proxy-ip-10-0-138-44.ec2.internal\" (UID: \"28ee2cd84792d9409e5acf4090158792\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-44.ec2.internal" Jul 29 22:46:30.753917 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:30.753875 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-44.ec2.internal\" not found" Jul 29 22:46:30.762910 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.762885 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1b1f25fc1428d45d3789fd496fdfa89c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-44.ec2.internal\" (UID: \"1b1f25fc1428d45d3789fd496fdfa89c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-44.ec2.internal" Jul 29 22:46:30.762975 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.762916 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b1f25fc1428d45d3789fd496fdfa89c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-44.ec2.internal\" (UID: \"1b1f25fc1428d45d3789fd496fdfa89c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-44.ec2.internal" Jul 29 22:46:30.762975 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.762935 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/28ee2cd84792d9409e5acf4090158792-config\") pod \"kube-apiserver-proxy-ip-10-0-138-44.ec2.internal\" (UID: \"28ee2cd84792d9409e5acf4090158792\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-44.ec2.internal" Jul 29 22:46:30.763042 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.762993 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/28ee2cd84792d9409e5acf4090158792-config\") pod \"kube-apiserver-proxy-ip-10-0-138-44.ec2.internal\" (UID: \"28ee2cd84792d9409e5acf4090158792\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-44.ec2.internal" Jul 29 22:46:30.763042 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.762993 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1b1f25fc1428d45d3789fd496fdfa89c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-44.ec2.internal\" (UID: \"1b1f25fc1428d45d3789fd496fdfa89c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-44.ec2.internal" Jul 29 22:46:30.763042 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.763017 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b1f25fc1428d45d3789fd496fdfa89c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-44.ec2.internal\" (UID: \"1b1f25fc1428d45d3789fd496fdfa89c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-44.ec2.internal" Jul 29 22:46:30.854185 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:30.854104 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-44.ec2.internal\" not found" Jul 29 22:46:30.939028 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.938992 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-44.ec2.internal" Jul 29 22:46:30.941325 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:30.941304 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-44.ec2.internal" Jul 29 22:46:30.955152 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:30.955124 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-44.ec2.internal\" not found" Jul 29 22:46:31.060841 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:31.060797 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-44.ec2.internal\" not found" Jul 29 22:46:31.166345 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:31.166267 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-44.ec2.internal\" not found" Jul 29 22:46:31.267283 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:31.267253 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-44.ec2.internal\" not found" Jul 29 22:46:31.300853 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:31.300829 2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 22:46:31.308852 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:31.308831 2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 29 22:46:31.308981 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:31.308959 2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 22:46:31.309021 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:31.308999 2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 22:46:31.368234 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:31.368204 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-44.ec2.internal\" not found" Jul 29 22:46:31.373307 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:31.373270 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 22:41:30 +0000 UTC" deadline="2028-05-07 12:37:43.280679796 +0000 UTC" Jul 29 22:46:31.373388 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:31.373310 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15541h51m11.907374604s" Jul 29 22:46:31.468976 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:31.468900 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-44.ec2.internal\" not found" Jul 29 22:46:31.549121 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:31.549088 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28ee2cd84792d9409e5acf4090158792.slice/crio-11c66fc0310b8be98c686a857641e0cdd0374b882217ed004105f844aaf26f2b WatchSource:0}: Error finding container 11c66fc0310b8be98c686a857641e0cdd0374b882217ed004105f844aaf26f2b: Status 404 returned error can't find the container with id 11c66fc0310b8be98c686a857641e0cdd0374b882217ed004105f844aaf26f2b Jul 29 22:46:31.549286 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:31.549265 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b1f25fc1428d45d3789fd496fdfa89c.slice/crio-5a96d40d5f3b1a87cf5b7cdd2699193b44de38f70816b8015e0e2e3559d82ee4 WatchSource:0}: Error finding container 5a96d40d5f3b1a87cf5b7cdd2699193b44de38f70816b8015e0e2e3559d82ee4: Status 404 returned error can't find the container with id 5a96d40d5f3b1a87cf5b7cdd2699193b44de38f70816b8015e0e2e3559d82ee4 Jul 29 22:46:31.554245 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:31.554220 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 22:46:31.569469 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:31.569445 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-44.ec2.internal\" not found" Jul 29 22:46:31.670392 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:31.670360 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-44.ec2.internal\" not found" Jul 29 22:46:31.705994 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:31.705974 2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 22:46:31.760535 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:31.760435 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-44.ec2.internal" Jul 29 22:46:31.772580 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:31.772560 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 22:46:31.773659 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:31.773646 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-44.ec2.internal" Jul 29 22:46:31.783285 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:31.783262 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 22:46:31.819643 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:31.819624 2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 22:46:32.275749 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.275560 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 22:46:32.341003 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.340970 2570 apiserver.go:52] "Watching apiserver" Jul 29 22:46:32.351494 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.351287 2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 29 22:46:32.351800 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.351774 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpgtl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-44.ec2.internal","openshift-multus/network-metrics-daemon-wfdzg","openshift-network-diagnostics/network-check-target-xs48r","openshift-network-operator/iptables-alerter-d8gxw","openshift-ovn-kubernetes/ovnkube-node-65k6t","kube-system/global-pull-secret-syncer-xlxhw","kube-system/konnectivity-agent-kxxx9","kube-system/kube-apiserver-proxy-ip-10-0-138-44.ec2.internal","openshift-cluster-node-tuning-operator/tuned-4pd24","openshift-dns/node-resolver-8pmwl","openshift-image-registry/node-ca-nqd4j","openshift-multus/multus-2zd5p","openshift-multus/multus-additional-cni-plugins-4jxr2"] Jul 29 22:46:32.354735 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.354707 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:46:32.354866 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:32.354807 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xlxhw" podUID="19b4fc0c-1b07-4c57-88df-5d40a7a07cfa" Jul 29 22:46:32.357302 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.357279 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.359370 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.359352 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 29 22:46:32.360228 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.360024 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:46:32.360228 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:32.360089 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfdzg" podUID="6f61a04d-54f8-42b5-978f-0298dd8ac438" Jul 29 22:46:32.360379 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.360270 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 29 22:46:32.360471 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.360408 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vmtsk\"" Jul 29 22:46:32.360471 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.360261 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 29 22:46:32.362661 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.362494 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 29 22:46:32.362661 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.362534 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 29 22:46:32.364150 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.364129 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:46:32.364259 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:32.364203 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs48r" podUID="29dab441-c8b5-45e4-b586-5c52a843833d" Jul 29 22:46:32.367234 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.367215 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d8gxw" Jul 29 22:46:32.369782 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.369763 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.370638 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.370596 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 29 22:46:32.371600 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.371130 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 29 22:46:32.371600 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.371454 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-txbb4\"" Jul 29 22:46:32.374576 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.372485 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 29 22:46:32.374576 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.373156 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bdm6x\"" Jul 29 22:46:32.374576 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.373624 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 29 22:46:32.374576 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.373654 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4jxr2" Jul 29 22:46:32.374576 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.374094 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 29 22:46:32.374887 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.374736 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 29 22:46:32.378269 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.374975 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 29 22:46:32.378269 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.375407 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 29 22:46:32.378269 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.376034 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19b4fc0c-1b07-4c57-88df-5d40a7a07cfa-original-pull-secret\") pod \"global-pull-secret-syncer-xlxhw\" (UID: \"19b4fc0c-1b07-4c57-88df-5d40a7a07cfa\") " pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:46:32.378269 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.376094 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-multus-socket-dir-parent\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.378269 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.376132 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-host-run-k8s-cni-cncf-io\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.378269 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.376166 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-host-var-lib-cni-bin\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.378269 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.376245 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/198acb98-b9c5-4b6e-b231-074ba237ecd5-multus-daemon-config\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.378269 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.376278 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phrrg\" (UniqueName: \"kubernetes.io/projected/198acb98-b9c5-4b6e-b231-074ba237ecd5-kube-api-access-phrrg\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.378269 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.376358 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f61a04d-54f8-42b5-978f-0298dd8ac438-metrics-certs\") pod \"network-metrics-daemon-wfdzg\" (UID: \"6f61a04d-54f8-42b5-978f-0298dd8ac438\") " pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:46:32.378269 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.376396 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/19b4fc0c-1b07-4c57-88df-5d40a7a07cfa-kubelet-config\") pod \"global-pull-secret-syncer-xlxhw\" (UID: \"19b4fc0c-1b07-4c57-88df-5d40a7a07cfa\") " pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:46:32.378269 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.376441 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/19b4fc0c-1b07-4c57-88df-5d40a7a07cfa-dbus\") pod \"global-pull-secret-syncer-xlxhw\" (UID: \"19b4fc0c-1b07-4c57-88df-5d40a7a07cfa\") " pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:46:32.378269 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.376479 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-system-cni-dir\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.378269 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.376522 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-os-release\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.378269 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.376549 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/198acb98-b9c5-4b6e-b231-074ba237ecd5-cni-binary-copy\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.378269 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.376588 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-host-run-netns\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.378269 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.376625 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmffm\" (UniqueName: \"kubernetes.io/projected/6f61a04d-54f8-42b5-978f-0298dd8ac438-kube-api-access-gmffm\") pod \"network-metrics-daemon-wfdzg\" (UID: \"6f61a04d-54f8-42b5-978f-0298dd8ac438\") " pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:46:32.378269 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.376678 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-multus-cni-dir\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.378269 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.376719 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-cnibin\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.379368 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.376759 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-host-var-lib-cni-multus\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.379368 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.376795 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-multus-conf-dir\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.379368 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.376826 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-etc-kubernetes\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.379368 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.376832 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 29 22:46:32.379368 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.376860 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-host-var-lib-kubelet\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.379368 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.376892 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-hostroot\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.379368 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.376916 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-host-run-multus-certs\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.379368 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.378019 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 29 22:46:32.379368 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.378083 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 29 22:46:32.379368 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.378106 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpgtl" Jul 29 22:46:32.384935 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.380755 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 22:46:32.384935 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.380960 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7p96z\"" Jul 29 22:46:32.384935 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.382741 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kxxx9" Jul 29 22:46:32.384935 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.383916 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 29 22:46:32.384935 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.384502 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 29 22:46:32.384935 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.384555 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 29 22:46:32.386080 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.385517 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4tcc7\"" Jul 29 22:46:32.386080 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.385560 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 29 22:46:32.386080 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.385857 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 29 22:46:32.386080 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.385926 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hjj64\"" Jul 29 22:46:32.388767 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.388541 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.390377 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.390361 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8pmwl" Jul 29 22:46:32.391174 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.391153 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 29 22:46:32.391282 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.391261 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 29 22:46:32.391421 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.391405 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pnqj8\"" Jul 29 22:46:32.392862 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.392842 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 29 22:46:32.392959 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.392888 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nqd4j" Jul 29 22:46:32.393368 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.393174 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9hnns\"" Jul 29 22:46:32.393576 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.393524 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 29 22:46:32.395232 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.395197 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 29 22:46:32.396097 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.395838 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2kdtk\"" Jul 29 22:46:32.396097 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.395854 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 29 22:46:32.396097 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.396031 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 29 22:46:32.400526 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.400504 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tr7sk" Jul 29 22:46:32.411826 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.411803 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tr7sk" Jul 29 22:46:32.461973 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.461951 2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 29 22:46:32.477166 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.477135 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-host\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.477294 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.477191 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-host-run-multus-certs\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.477294 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.477222 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smk6r\" (UniqueName: \"kubernetes.io/projected/e599bc76-5e9e-4b68-aae3-7fde40da6e7e-kube-api-access-smk6r\") pod \"aws-ebs-csi-driver-node-rpgtl\" (UID: \"e599bc76-5e9e-4b68-aae3-7fde40da6e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpgtl" Jul 29 22:46:32.477294 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.477247 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-etc-sysctl-conf\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.477294 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.477267 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-host-run-multus-certs\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.477294 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.477270 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-host-kubelet\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.477581 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.477339 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-run-ovn\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.477581 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.477367 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-log-socket\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.477581 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.477396 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-host-cni-bin\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.477581 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.477422 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a674054c-c6ca-4f41-9d96-9253b99152d4-ovnkube-script-lib\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.477581 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.477449 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3100527d-fac5-4ee7-90fa-1171a661b55d-tmp-dir\") pod \"node-resolver-8pmwl\" (UID: \"3100527d-fac5-4ee7-90fa-1171a661b55d\") " pod="openshift-dns/node-resolver-8pmwl" Jul 29 22:46:32.477581 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.477475 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/509e6d64-9d9b-4979-8554-f915cde622f0-iptables-alerter-script\") pod \"iptables-alerter-d8gxw\" (UID: \"509e6d64-9d9b-4979-8554-f915cde622f0\") " pod="openshift-network-operator/iptables-alerter-d8gxw" Jul 29 22:46:32.477581 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.477501 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6817a1b0-e9d5-44a1-9e72-400f0911f52b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4jxr2\" (UID: \"6817a1b0-e9d5-44a1-9e72-400f0911f52b\") " pod="openshift-multus/multus-additional-cni-plugins-4jxr2" Jul 29 22:46:32.477581 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.477569 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-os-release\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.477955 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.477615 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-host-run-netns\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.477955 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.477684 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-host-run-netns\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.477955 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.477692 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8b701f00-dc19-4258-a99d-86f2d493108e-konnectivity-ca\") pod \"konnectivity-agent-kxxx9\" (UID: \"8b701f00-dc19-4258-a99d-86f2d493108e\") " pod="kube-system/konnectivity-agent-kxxx9" Jul 29 22:46:32.477955 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.477708 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-os-release\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.477955 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.477734 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-host-cni-netd\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.477955 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.477775 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a674054c-c6ca-4f41-9d96-9253b99152d4-env-overrides\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.477955 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.477800 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6817a1b0-e9d5-44a1-9e72-400f0911f52b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4jxr2\" (UID: \"6817a1b0-e9d5-44a1-9e72-400f0911f52b\") " pod="openshift-multus/multus-additional-cni-plugins-4jxr2" Jul 29 22:46:32.477955 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.477827 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-multus-cni-dir\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.477955 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.477852 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-host-var-lib-cni-multus\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.477955 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.477876 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-multus-conf-dir\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.477955 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.477898 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0485ba10-803b-4f61-8efd-2c9434e67584-etc-tuned\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.477955 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.477923 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk6kc\" (UniqueName: \"kubernetes.io/projected/c7d70a2c-8566-4797-914d-58c194ab083c-kube-api-access-zk6kc\") pod \"node-ca-nqd4j\" (UID: \"c7d70a2c-8566-4797-914d-58c194ab083c\") " pod="openshift-image-registry/node-ca-nqd4j" Jul 29 22:46:32.477955 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.477944 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-host-run-netns\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.478541 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.477982 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-run-openvswitch\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.478541 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.477980 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-multus-conf-dir\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.478541 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478002 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-host-var-lib-cni-multus\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.478541 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478019 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-host-slash\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.478541 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478098 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-multus-cni-dir\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.478541 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478113 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a674054c-c6ca-4f41-9d96-9253b99152d4-ovn-node-metrics-cert\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.478541 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478144 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phrrg\" (UniqueName: \"kubernetes.io/projected/198acb98-b9c5-4b6e-b231-074ba237ecd5-kube-api-access-phrrg\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.478541 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478201 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f61a04d-54f8-42b5-978f-0298dd8ac438-metrics-certs\") pod \"network-metrics-daemon-wfdzg\" (UID: \"6f61a04d-54f8-42b5-978f-0298dd8ac438\") " pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:46:32.478541 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:32.478326 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:46:32.478541 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478329 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjghq\" (UniqueName: \"kubernetes.io/projected/0485ba10-803b-4f61-8efd-2c9434e67584-kube-api-access-wjghq\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.478541 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478355 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/19b4fc0c-1b07-4c57-88df-5d40a7a07cfa-kubelet-config\") pod \"global-pull-secret-syncer-xlxhw\" (UID: \"19b4fc0c-1b07-4c57-88df-5d40a7a07cfa\") " pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:46:32.478541 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478375 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e599bc76-5e9e-4b68-aae3-7fde40da6e7e-device-dir\") pod \"aws-ebs-csi-driver-node-rpgtl\" (UID: \"e599bc76-5e9e-4b68-aae3-7fde40da6e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpgtl" Jul 29 22:46:32.478541 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:32.478408 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f61a04d-54f8-42b5-978f-0298dd8ac438-metrics-certs podName:6f61a04d-54f8-42b5-978f-0298dd8ac438 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:32.978371228 +0000 UTC m=+2.934467065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f61a04d-54f8-42b5-978f-0298dd8ac438-metrics-certs") pod "network-metrics-daemon-wfdzg" (UID: "6f61a04d-54f8-42b5-978f-0298dd8ac438") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:46:32.478541 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478433 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/19b4fc0c-1b07-4c57-88df-5d40a7a07cfa-kubelet-config\") pod \"global-pull-secret-syncer-xlxhw\" (UID: \"19b4fc0c-1b07-4c57-88df-5d40a7a07cfa\") " pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:46:32.478541 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478442 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e599bc76-5e9e-4b68-aae3-7fde40da6e7e-etc-selinux\") pod \"aws-ebs-csi-driver-node-rpgtl\" (UID: \"e599bc76-5e9e-4b68-aae3-7fde40da6e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpgtl" Jul 29 22:46:32.478541 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478470 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e599bc76-5e9e-4b68-aae3-7fde40da6e7e-sys-fs\") pod \"aws-ebs-csi-driver-node-rpgtl\" (UID: \"e599bc76-5e9e-4b68-aae3-7fde40da6e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpgtl" Jul 29 22:46:32.478541 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478494 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8b701f00-dc19-4258-a99d-86f2d493108e-agent-certs\") pod \"konnectivity-agent-kxxx9\" (UID: \"8b701f00-dc19-4258-a99d-86f2d493108e\") " pod="kube-system/konnectivity-agent-kxxx9" Jul 29 22:46:32.479158 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478520 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7d70a2c-8566-4797-914d-58c194ab083c-host\") pod \"node-ca-nqd4j\" (UID: \"c7d70a2c-8566-4797-914d-58c194ab083c\") " pod="openshift-image-registry/node-ca-nqd4j" Jul 29 22:46:32.479158 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478558 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-run-systemd\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.479158 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478586 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-var-lib-openvswitch\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.479158 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478615 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-cnibin\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.479158 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478655 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-etc-kubernetes\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.479158 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478681 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-etc-sysctl-d\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.479158 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478704 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-etc-systemd\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.479158 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478730 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6817a1b0-e9d5-44a1-9e72-400f0911f52b-cnibin\") pod \"multus-additional-cni-plugins-4jxr2\" (UID: \"6817a1b0-e9d5-44a1-9e72-400f0911f52b\") " pod="openshift-multus/multus-additional-cni-plugins-4jxr2" Jul 29 22:46:32.479158 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478735 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-etc-kubernetes\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.479158 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478755 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6817a1b0-e9d5-44a1-9e72-400f0911f52b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4jxr2\" (UID: \"6817a1b0-e9d5-44a1-9e72-400f0911f52b\") " pod="openshift-multus/multus-additional-cni-plugins-4jxr2" Jul 29 22:46:32.479158 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478731 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-cnibin\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.479158 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478788 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9wht\" (UniqueName: \"kubernetes.io/projected/6817a1b0-e9d5-44a1-9e72-400f0911f52b-kube-api-access-p9wht\") pod \"multus-additional-cni-plugins-4jxr2\" (UID: \"6817a1b0-e9d5-44a1-9e72-400f0911f52b\") " pod="openshift-multus/multus-additional-cni-plugins-4jxr2" Jul 29 22:46:32.479158 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478813 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-host-var-lib-kubelet\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.479158 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478829 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-hostroot\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.479158 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478847 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-etc-sysconfig\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.479158 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478871 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c7d70a2c-8566-4797-914d-58c194ab083c-serviceca\") pod \"node-ca-nqd4j\" (UID: \"c7d70a2c-8566-4797-914d-58c194ab083c\") " pod="openshift-image-registry/node-ca-nqd4j" Jul 29 22:46:32.479158 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478888 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-host-var-lib-kubelet\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.479836 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478898 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6x8f\" (UniqueName: \"kubernetes.io/projected/29dab441-c8b5-45e4-b586-5c52a843833d-kube-api-access-p6x8f\") pod \"network-check-target-xs48r\" (UID: \"29dab441-c8b5-45e4-b586-5c52a843833d\") " pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:46:32.479836 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478904 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-hostroot\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.479836 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478922 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e599bc76-5e9e-4b68-aae3-7fde40da6e7e-registration-dir\") pod \"aws-ebs-csi-driver-node-rpgtl\" (UID: \"e599bc76-5e9e-4b68-aae3-7fde40da6e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpgtl" Jul 29 22:46:32.479836 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478966 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19b4fc0c-1b07-4c57-88df-5d40a7a07cfa-original-pull-secret\") pod \"global-pull-secret-syncer-xlxhw\" (UID: \"19b4fc0c-1b07-4c57-88df-5d40a7a07cfa\") " pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:46:32.479836 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.478983 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-host-var-lib-cni-bin\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.479836 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.479000 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/198acb98-b9c5-4b6e-b231-074ba237ecd5-multus-daemon-config\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.479836 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.479025 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-etc-openvswitch\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.479836 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.479056 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/19b4fc0c-1b07-4c57-88df-5d40a7a07cfa-dbus\") pod \"global-pull-secret-syncer-xlxhw\" (UID: \"19b4fc0c-1b07-4c57-88df-5d40a7a07cfa\") " pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:46:32.479836 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:32.479074 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 22:46:32.479836 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.479081 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-system-cni-dir\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.479836 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.479075 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-host-var-lib-cni-bin\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.479836 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.479181 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-system-cni-dir\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.479836 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.479247 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/19b4fc0c-1b07-4c57-88df-5d40a7a07cfa-dbus\") pod \"global-pull-secret-syncer-xlxhw\" (UID: \"19b4fc0c-1b07-4c57-88df-5d40a7a07cfa\") " pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:46:32.479836 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:32.479415 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19b4fc0c-1b07-4c57-88df-5d40a7a07cfa-original-pull-secret podName:19b4fc0c-1b07-4c57-88df-5d40a7a07cfa nodeName:}" failed. No retries permitted until 2026-07-29 22:46:32.979388587 +0000 UTC m=+2.935484426 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19b4fc0c-1b07-4c57-88df-5d40a7a07cfa-original-pull-secret") pod "global-pull-secret-syncer-xlxhw" (UID: "19b4fc0c-1b07-4c57-88df-5d40a7a07cfa") : object "kube-system"/"original-pull-secret" not registered Jul 29 22:46:32.479836 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.479122 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e599bc76-5e9e-4b68-aae3-7fde40da6e7e-socket-dir\") pod \"aws-ebs-csi-driver-node-rpgtl\" (UID: \"e599bc76-5e9e-4b68-aae3-7fde40da6e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpgtl" Jul 29 22:46:32.479836 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.479630 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-etc-modprobe-d\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.479836 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.479655 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-etc-kubernetes\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.480616 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.479692 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-node-log\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.480616 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.479718 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a674054c-c6ca-4f41-9d96-9253b99152d4-ovnkube-config\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.480616 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.479760 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-lib-modules\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.480616 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.479773 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/198acb98-b9c5-4b6e-b231-074ba237ecd5-multus-daemon-config\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.480616 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.479788 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dm2l\" (UniqueName: \"kubernetes.io/projected/509e6d64-9d9b-4979-8554-f915cde622f0-kube-api-access-7dm2l\") pod \"iptables-alerter-d8gxw\" (UID: \"509e6d64-9d9b-4979-8554-f915cde622f0\") " pod="openshift-network-operator/iptables-alerter-d8gxw" Jul 29 22:46:32.480616 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.479816 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.480616 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.479844 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pstj4\" (UniqueName: \"kubernetes.io/projected/a674054c-c6ca-4f41-9d96-9253b99152d4-kube-api-access-pstj4\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.480616 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.479880 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e599bc76-5e9e-4b68-aae3-7fde40da6e7e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rpgtl\" (UID: \"e599bc76-5e9e-4b68-aae3-7fde40da6e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpgtl" Jul 29 22:46:32.480616 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.479901 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-sys\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.480616 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.479923 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0485ba10-803b-4f61-8efd-2c9434e67584-tmp\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.480616 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.479948 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-systemd-units\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.480616 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.479977 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-host-run-ovn-kubernetes\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.480616 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.480005 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sfp7\" (UniqueName: \"kubernetes.io/projected/3100527d-fac5-4ee7-90fa-1171a661b55d-kube-api-access-9sfp7\") pod \"node-resolver-8pmwl\" (UID: \"3100527d-fac5-4ee7-90fa-1171a661b55d\") " pod="openshift-dns/node-resolver-8pmwl" Jul 29 22:46:32.480616 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.480034 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-multus-socket-dir-parent\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.480616 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.480058 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-host-run-k8s-cni-cncf-io\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.480616 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.480104 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-var-lib-kubelet\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.481396 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.480128 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3100527d-fac5-4ee7-90fa-1171a661b55d-hosts-file\") pod \"node-resolver-8pmwl\" (UID: \"3100527d-fac5-4ee7-90fa-1171a661b55d\") " pod="openshift-dns/node-resolver-8pmwl" Jul 29 22:46:32.481396 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.480152 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/198acb98-b9c5-4b6e-b231-074ba237ecd5-cni-binary-copy\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.481396 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.480169 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-multus-socket-dir-parent\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.481396 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.480187 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmffm\" (UniqueName: \"kubernetes.io/projected/6f61a04d-54f8-42b5-978f-0298dd8ac438-kube-api-access-gmffm\") pod \"network-metrics-daemon-wfdzg\" (UID: \"6f61a04d-54f8-42b5-978f-0298dd8ac438\") " pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:46:32.481396 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.480210 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-run\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.481396 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.480256 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/198acb98-b9c5-4b6e-b231-074ba237ecd5-host-run-k8s-cni-cncf-io\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.481396 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.480466 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/509e6d64-9d9b-4979-8554-f915cde622f0-host-slash\") pod \"iptables-alerter-d8gxw\" (UID: \"509e6d64-9d9b-4979-8554-f915cde622f0\") " pod="openshift-network-operator/iptables-alerter-d8gxw" Jul 29 22:46:32.481396 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.480495 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6817a1b0-e9d5-44a1-9e72-400f0911f52b-system-cni-dir\") pod \"multus-additional-cni-plugins-4jxr2\" (UID: \"6817a1b0-e9d5-44a1-9e72-400f0911f52b\") " pod="openshift-multus/multus-additional-cni-plugins-4jxr2" Jul 29 22:46:32.481396 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.480549 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6817a1b0-e9d5-44a1-9e72-400f0911f52b-os-release\") pod \"multus-additional-cni-plugins-4jxr2\" (UID: \"6817a1b0-e9d5-44a1-9e72-400f0911f52b\") " pod="openshift-multus/multus-additional-cni-plugins-4jxr2" Jul 29 22:46:32.481396 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.480586 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6817a1b0-e9d5-44a1-9e72-400f0911f52b-cni-binary-copy\") pod \"multus-additional-cni-plugins-4jxr2\" (UID: \"6817a1b0-e9d5-44a1-9e72-400f0911f52b\") " pod="openshift-multus/multus-additional-cni-plugins-4jxr2" Jul 29 22:46:32.481396 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.480744 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/198acb98-b9c5-4b6e-b231-074ba237ecd5-cni-binary-copy\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.490871 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.490826 2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 29 22:46:32.497248 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.495603 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phrrg\" (UniqueName: \"kubernetes.io/projected/198acb98-b9c5-4b6e-b231-074ba237ecd5-kube-api-access-phrrg\") pod \"multus-2zd5p\" (UID: \"198acb98-b9c5-4b6e-b231-074ba237ecd5\") " pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.499196 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.499168 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmffm\" (UniqueName: \"kubernetes.io/projected/6f61a04d-54f8-42b5-978f-0298dd8ac438-kube-api-access-gmffm\") pod \"network-metrics-daemon-wfdzg\" (UID: \"6f61a04d-54f8-42b5-978f-0298dd8ac438\") " pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:46:32.507161 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.507093 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-44.ec2.internal" event={"ID":"1b1f25fc1428d45d3789fd496fdfa89c","Type":"ContainerStarted","Data":"5a96d40d5f3b1a87cf5b7cdd2699193b44de38f70816b8015e0e2e3559d82ee4"} Jul 29 22:46:32.508854 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.508816 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-44.ec2.internal" event={"ID":"28ee2cd84792d9409e5acf4090158792","Type":"ContainerStarted","Data":"11c66fc0310b8be98c686a857641e0cdd0374b882217ed004105f844aaf26f2b"} Jul 29 22:46:32.580948 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.580864 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0485ba10-803b-4f61-8efd-2c9434e67584-etc-tuned\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.580948 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.580909 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk6kc\" (UniqueName: \"kubernetes.io/projected/c7d70a2c-8566-4797-914d-58c194ab083c-kube-api-access-zk6kc\") pod \"node-ca-nqd4j\" (UID: \"c7d70a2c-8566-4797-914d-58c194ab083c\") " pod="openshift-image-registry/node-ca-nqd4j" Jul 29 22:46:32.580948 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.580937 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-host-run-netns\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.581211 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.580961 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-run-openvswitch\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.581211 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.580984 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-host-slash\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.581211 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.581006 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a674054c-c6ca-4f41-9d96-9253b99152d4-ovn-node-metrics-cert\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.581211 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.581045 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjghq\" (UniqueName: \"kubernetes.io/projected/0485ba10-803b-4f61-8efd-2c9434e67584-kube-api-access-wjghq\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.581211 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.581067 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e599bc76-5e9e-4b68-aae3-7fde40da6e7e-device-dir\") pod \"aws-ebs-csi-driver-node-rpgtl\" (UID: \"e599bc76-5e9e-4b68-aae3-7fde40da6e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpgtl" Jul 29 22:46:32.581211 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.581090 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e599bc76-5e9e-4b68-aae3-7fde40da6e7e-etc-selinux\") pod \"aws-ebs-csi-driver-node-rpgtl\" (UID: \"e599bc76-5e9e-4b68-aae3-7fde40da6e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpgtl" Jul 29 22:46:32.581211 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.581111 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e599bc76-5e9e-4b68-aae3-7fde40da6e7e-sys-fs\") pod \"aws-ebs-csi-driver-node-rpgtl\" (UID: \"e599bc76-5e9e-4b68-aae3-7fde40da6e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpgtl" Jul 29 22:46:32.581211 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.581135 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8b701f00-dc19-4258-a99d-86f2d493108e-agent-certs\") pod \"konnectivity-agent-kxxx9\" (UID: \"8b701f00-dc19-4258-a99d-86f2d493108e\") " pod="kube-system/konnectivity-agent-kxxx9" Jul 29 22:46:32.581211 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.581160 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7d70a2c-8566-4797-914d-58c194ab083c-host\") pod \"node-ca-nqd4j\" (UID: \"c7d70a2c-8566-4797-914d-58c194ab083c\") " pod="openshift-image-registry/node-ca-nqd4j" Jul 29 22:46:32.581211 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.581184 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-run-systemd\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.581733 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.581208 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-var-lib-openvswitch\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.581733 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.581246 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-etc-sysctl-d\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.581733 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.581273 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-etc-systemd\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.581733 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.581308 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6817a1b0-e9d5-44a1-9e72-400f0911f52b-cnibin\") pod \"multus-additional-cni-plugins-4jxr2\" (UID: \"6817a1b0-e9d5-44a1-9e72-400f0911f52b\") " pod="openshift-multus/multus-additional-cni-plugins-4jxr2" Jul 29 22:46:32.581733 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.581328 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-run-openvswitch\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.581733 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.581337 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6817a1b0-e9d5-44a1-9e72-400f0911f52b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4jxr2\" (UID: \"6817a1b0-e9d5-44a1-9e72-400f0911f52b\") " pod="openshift-multus/multus-additional-cni-plugins-4jxr2" Jul 29 22:46:32.581733 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.581401 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9wht\" (UniqueName: \"kubernetes.io/projected/6817a1b0-e9d5-44a1-9e72-400f0911f52b-kube-api-access-p9wht\") pod \"multus-additional-cni-plugins-4jxr2\" (UID: \"6817a1b0-e9d5-44a1-9e72-400f0911f52b\") " pod="openshift-multus/multus-additional-cni-plugins-4jxr2" Jul 29 22:46:32.581733 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.581405 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e599bc76-5e9e-4b68-aae3-7fde40da6e7e-device-dir\") pod \"aws-ebs-csi-driver-node-rpgtl\" (UID: \"e599bc76-5e9e-4b68-aae3-7fde40da6e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpgtl" Jul 29 22:46:32.581733 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.581469 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-host-slash\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.581733 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.581487 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e599bc76-5e9e-4b68-aae3-7fde40da6e7e-etc-selinux\") pod \"aws-ebs-csi-driver-node-rpgtl\" (UID: \"e599bc76-5e9e-4b68-aae3-7fde40da6e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpgtl" Jul 29 22:46:32.581733 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.581501 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e599bc76-5e9e-4b68-aae3-7fde40da6e7e-sys-fs\") pod \"aws-ebs-csi-driver-node-rpgtl\" (UID: \"e599bc76-5e9e-4b68-aae3-7fde40da6e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpgtl" Jul 29 22:46:32.581733 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.581506 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-host-run-netns\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.581733 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.581534 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-var-lib-openvswitch\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.581733 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.581582 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6817a1b0-e9d5-44a1-9e72-400f0911f52b-cnibin\") pod \"multus-additional-cni-plugins-4jxr2\" (UID: \"6817a1b0-e9d5-44a1-9e72-400f0911f52b\") " pod="openshift-multus/multus-additional-cni-plugins-4jxr2" Jul 29 22:46:32.581733 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.581594 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-run-systemd\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.581733 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.581718 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6817a1b0-e9d5-44a1-9e72-400f0911f52b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4jxr2\" (UID: \"6817a1b0-e9d5-44a1-9e72-400f0911f52b\") " pod="openshift-multus/multus-additional-cni-plugins-4jxr2" Jul 29 22:46:32.582630 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.581764 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-etc-sysctl-d\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.582630 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.581827 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-etc-systemd\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.582630 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.581859 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-etc-sysconfig\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.582630 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.581888 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c7d70a2c-8566-4797-914d-58c194ab083c-serviceca\") pod \"node-ca-nqd4j\" (UID: \"c7d70a2c-8566-4797-914d-58c194ab083c\") " pod="openshift-image-registry/node-ca-nqd4j" Jul 29 22:46:32.582630 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.581927 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6x8f\" (UniqueName: \"kubernetes.io/projected/29dab441-c8b5-45e4-b586-5c52a843833d-kube-api-access-p6x8f\") pod \"network-check-target-xs48r\" (UID: \"29dab441-c8b5-45e4-b586-5c52a843833d\") " pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:46:32.582630 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.581954 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e599bc76-5e9e-4b68-aae3-7fde40da6e7e-registration-dir\") pod \"aws-ebs-csi-driver-node-rpgtl\" (UID: \"e599bc76-5e9e-4b68-aae3-7fde40da6e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpgtl" Jul 29 22:46:32.582630 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.581968 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-etc-sysconfig\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.582630 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582013 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-etc-openvswitch\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.582630 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582033 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e599bc76-5e9e-4b68-aae3-7fde40da6e7e-registration-dir\") pod \"aws-ebs-csi-driver-node-rpgtl\" (UID: \"e599bc76-5e9e-4b68-aae3-7fde40da6e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpgtl" Jul 29 22:46:32.582630 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582051 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e599bc76-5e9e-4b68-aae3-7fde40da6e7e-socket-dir\") pod \"aws-ebs-csi-driver-node-rpgtl\" (UID: \"e599bc76-5e9e-4b68-aae3-7fde40da6e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpgtl" Jul 29 22:46:32.582630 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582077 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-etc-modprobe-d\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.582630 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582101 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-etc-kubernetes\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.582630 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582126 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-node-log\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.582630 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582150 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a674054c-c6ca-4f41-9d96-9253b99152d4-ovnkube-config\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.582630 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582173 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-lib-modules\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.582630 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582198 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dm2l\" (UniqueName: \"kubernetes.io/projected/509e6d64-9d9b-4979-8554-f915cde622f0-kube-api-access-7dm2l\") pod \"iptables-alerter-d8gxw\" (UID: \"509e6d64-9d9b-4979-8554-f915cde622f0\") " pod="openshift-network-operator/iptables-alerter-d8gxw" Jul 29 22:46:32.582630 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582227 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.583533 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582255 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pstj4\" (UniqueName: \"kubernetes.io/projected/a674054c-c6ca-4f41-9d96-9253b99152d4-kube-api-access-pstj4\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.583533 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582265 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-etc-kubernetes\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.583533 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582283 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e599bc76-5e9e-4b68-aae3-7fde40da6e7e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rpgtl\" (UID: \"e599bc76-5e9e-4b68-aae3-7fde40da6e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpgtl" Jul 29 22:46:32.583533 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582312 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-sys\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.583533 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582336 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0485ba10-803b-4f61-8efd-2c9434e67584-tmp\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.583533 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582350 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e599bc76-5e9e-4b68-aae3-7fde40da6e7e-socket-dir\") pod \"aws-ebs-csi-driver-node-rpgtl\" (UID: \"e599bc76-5e9e-4b68-aae3-7fde40da6e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpgtl" Jul 29 22:46:32.583533 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582361 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-systemd-units\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.583533 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582373 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c7d70a2c-8566-4797-914d-58c194ab083c-serviceca\") pod \"node-ca-nqd4j\" (UID: \"c7d70a2c-8566-4797-914d-58c194ab083c\") " pod="openshift-image-registry/node-ca-nqd4j" Jul 29 22:46:32.583533 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582381 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-etc-modprobe-d\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.583533 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582389 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-host-run-ovn-kubernetes\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.583533 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582403 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-etc-openvswitch\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.583533 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582442 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sfp7\" (UniqueName: \"kubernetes.io/projected/3100527d-fac5-4ee7-90fa-1171a661b55d-kube-api-access-9sfp7\") pod \"node-resolver-8pmwl\" (UID: \"3100527d-fac5-4ee7-90fa-1171a661b55d\") " pod="openshift-dns/node-resolver-8pmwl" Jul 29 22:46:32.583533 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582455 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.583533 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582477 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-var-lib-kubelet\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.583533 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582487 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-systemd-units\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.583533 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582507 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3100527d-fac5-4ee7-90fa-1171a661b55d-hosts-file\") pod \"node-resolver-8pmwl\" (UID: \"3100527d-fac5-4ee7-90fa-1171a661b55d\") " pod="openshift-dns/node-resolver-8pmwl" Jul 29 22:46:32.583533 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582534 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-run\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.584529 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582559 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/509e6d64-9d9b-4979-8554-f915cde622f0-host-slash\") pod \"iptables-alerter-d8gxw\" (UID: \"509e6d64-9d9b-4979-8554-f915cde622f0\") " pod="openshift-network-operator/iptables-alerter-d8gxw" Jul 29 22:46:32.584529 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582587 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6817a1b0-e9d5-44a1-9e72-400f0911f52b-system-cni-dir\") pod \"multus-additional-cni-plugins-4jxr2\" (UID: \"6817a1b0-e9d5-44a1-9e72-400f0911f52b\") " pod="openshift-multus/multus-additional-cni-plugins-4jxr2" Jul 29 22:46:32.584529 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582617 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6817a1b0-e9d5-44a1-9e72-400f0911f52b-os-release\") pod \"multus-additional-cni-plugins-4jxr2\" (UID: \"6817a1b0-e9d5-44a1-9e72-400f0911f52b\") " pod="openshift-multus/multus-additional-cni-plugins-4jxr2" Jul 29 22:46:32.584529 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582641 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6817a1b0-e9d5-44a1-9e72-400f0911f52b-cni-binary-copy\") pod \"multus-additional-cni-plugins-4jxr2\" (UID: \"6817a1b0-e9d5-44a1-9e72-400f0911f52b\") " pod="openshift-multus/multus-additional-cni-plugins-4jxr2" Jul 29 22:46:32.584529 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582669 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-host\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.584529 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582712 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smk6r\" (UniqueName: \"kubernetes.io/projected/e599bc76-5e9e-4b68-aae3-7fde40da6e7e-kube-api-access-smk6r\") pod \"aws-ebs-csi-driver-node-rpgtl\" (UID: \"e599bc76-5e9e-4b68-aae3-7fde40da6e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpgtl" Jul 29 22:46:32.584529 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582723 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-node-log\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.584529 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582740 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-etc-sysctl-conf\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.584529 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582765 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-host-kubelet\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.584529 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582772 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-host-run-ovn-kubernetes\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.584529 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582790 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-run-ovn\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.584529 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582816 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-log-socket\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.584529 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582842 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-host-cni-bin\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.584529 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582869 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a674054c-c6ca-4f41-9d96-9253b99152d4-ovnkube-script-lib\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.584529 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582894 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3100527d-fac5-4ee7-90fa-1171a661b55d-tmp-dir\") pod \"node-resolver-8pmwl\" (UID: \"3100527d-fac5-4ee7-90fa-1171a661b55d\") " pod="openshift-dns/node-resolver-8pmwl" Jul 29 22:46:32.584529 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582905 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-lib-modules\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.584529 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582670 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e599bc76-5e9e-4b68-aae3-7fde40da6e7e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rpgtl\" (UID: \"e599bc76-5e9e-4b68-aae3-7fde40da6e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpgtl" Jul 29 22:46:32.585468 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582927 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/509e6d64-9d9b-4979-8554-f915cde622f0-iptables-alerter-script\") pod \"iptables-alerter-d8gxw\" (UID: \"509e6d64-9d9b-4979-8554-f915cde622f0\") " pod="openshift-network-operator/iptables-alerter-d8gxw" Jul 29 22:46:32.585468 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582956 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6817a1b0-e9d5-44a1-9e72-400f0911f52b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4jxr2\" (UID: \"6817a1b0-e9d5-44a1-9e72-400f0911f52b\") " pod="openshift-multus/multus-additional-cni-plugins-4jxr2" Jul 29 22:46:32.585468 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582973 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-var-lib-kubelet\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.585468 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.582987 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8b701f00-dc19-4258-a99d-86f2d493108e-konnectivity-ca\") pod \"konnectivity-agent-kxxx9\" (UID: \"8b701f00-dc19-4258-a99d-86f2d493108e\") " pod="kube-system/konnectivity-agent-kxxx9" Jul 29 22:46:32.585468 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.583014 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-host-cni-netd\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.585468 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.583022 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3100527d-fac5-4ee7-90fa-1171a661b55d-hosts-file\") pod \"node-resolver-8pmwl\" (UID: \"3100527d-fac5-4ee7-90fa-1171a661b55d\") " pod="openshift-dns/node-resolver-8pmwl" Jul 29 22:46:32.585468 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.583040 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a674054c-c6ca-4f41-9d96-9253b99152d4-env-overrides\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.585468 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.583069 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-run\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.585468 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.583070 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6817a1b0-e9d5-44a1-9e72-400f0911f52b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4jxr2\" (UID: \"6817a1b0-e9d5-44a1-9e72-400f0911f52b\") " pod="openshift-multus/multus-additional-cni-plugins-4jxr2" Jul 29 22:46:32.585468 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.583067 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a674054c-c6ca-4f41-9d96-9253b99152d4-ovnkube-config\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.585468 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.583117 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6817a1b0-e9d5-44a1-9e72-400f0911f52b-system-cni-dir\") pod \"multus-additional-cni-plugins-4jxr2\" (UID: \"6817a1b0-e9d5-44a1-9e72-400f0911f52b\") " pod="openshift-multus/multus-additional-cni-plugins-4jxr2" Jul 29 22:46:32.585468 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.583126 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-sys\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.585468 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.583175 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/509e6d64-9d9b-4979-8554-f915cde622f0-host-slash\") pod \"iptables-alerter-d8gxw\" (UID: \"509e6d64-9d9b-4979-8554-f915cde622f0\") " pod="openshift-network-operator/iptables-alerter-d8gxw" Jul 29 22:46:32.585468 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.583199 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6817a1b0-e9d5-44a1-9e72-400f0911f52b-os-release\") pod \"multus-additional-cni-plugins-4jxr2\" (UID: \"6817a1b0-e9d5-44a1-9e72-400f0911f52b\") " pod="openshift-multus/multus-additional-cni-plugins-4jxr2" Jul 29 22:46:32.585468 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.583461 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-etc-sysctl-conf\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.585468 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.583723 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3100527d-fac5-4ee7-90fa-1171a661b55d-tmp-dir\") pod \"node-resolver-8pmwl\" (UID: \"3100527d-fac5-4ee7-90fa-1171a661b55d\") " pod="openshift-dns/node-resolver-8pmwl" Jul 29 22:46:32.585468 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.583804 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-host-kubelet\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.586451 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.583823 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6817a1b0-e9d5-44a1-9e72-400f0911f52b-cni-binary-copy\") pod \"multus-additional-cni-plugins-4jxr2\" (UID: \"6817a1b0-e9d5-44a1-9e72-400f0911f52b\") " pod="openshift-multus/multus-additional-cni-plugins-4jxr2" Jul 29 22:46:32.586451 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.583850 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-run-ovn\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.586451 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.583896 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-log-socket\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.586451 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.583904 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0485ba10-803b-4f61-8efd-2c9434e67584-host\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.586451 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.583932 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-host-cni-bin\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.586451 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.583978 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a674054c-c6ca-4f41-9d96-9253b99152d4-host-cni-netd\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.586451 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.584055 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/509e6d64-9d9b-4979-8554-f915cde622f0-iptables-alerter-script\") pod \"iptables-alerter-d8gxw\" (UID: \"509e6d64-9d9b-4979-8554-f915cde622f0\") " pod="openshift-network-operator/iptables-alerter-d8gxw" Jul 29 22:46:32.586451 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.584458 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a674054c-c6ca-4f41-9d96-9253b99152d4-ovnkube-script-lib\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.586451 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.584426 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a674054c-c6ca-4f41-9d96-9253b99152d4-ovn-node-metrics-cert\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.586451 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.584490 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6817a1b0-e9d5-44a1-9e72-400f0911f52b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4jxr2\" (UID: \"6817a1b0-e9d5-44a1-9e72-400f0911f52b\") " pod="openshift-multus/multus-additional-cni-plugins-4jxr2" Jul 29 22:46:32.586451 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.584511 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a674054c-c6ca-4f41-9d96-9253b99152d4-env-overrides\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.586451 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.584548 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7d70a2c-8566-4797-914d-58c194ab083c-host\") pod \"node-ca-nqd4j\" (UID: \"c7d70a2c-8566-4797-914d-58c194ab083c\") " pod="openshift-image-registry/node-ca-nqd4j" Jul 29 22:46:32.586451 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.584993 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6817a1b0-e9d5-44a1-9e72-400f0911f52b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4jxr2\" (UID: \"6817a1b0-e9d5-44a1-9e72-400f0911f52b\") " pod="openshift-multus/multus-additional-cni-plugins-4jxr2" Jul 29 22:46:32.586451 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.585494 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0485ba10-803b-4f61-8efd-2c9434e67584-tmp\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.586451 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.585647 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8b701f00-dc19-4258-a99d-86f2d493108e-konnectivity-ca\") pod \"konnectivity-agent-kxxx9\" (UID: \"8b701f00-dc19-4258-a99d-86f2d493108e\") " pod="kube-system/konnectivity-agent-kxxx9" Jul 29 22:46:32.587370 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.586482 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0485ba10-803b-4f61-8efd-2c9434e67584-etc-tuned\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.587370 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.586965 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8b701f00-dc19-4258-a99d-86f2d493108e-agent-certs\") pod \"konnectivity-agent-kxxx9\" (UID: \"8b701f00-dc19-4258-a99d-86f2d493108e\") " pod="kube-system/konnectivity-agent-kxxx9" Jul 29 22:46:32.588507 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:32.588484 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 22:46:32.588605 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:32.588516 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 22:46:32.588605 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:32.588532 2570 projected.go:196] Error preparing data for projected volume kube-api-access-p6x8f for pod openshift-network-diagnostics/network-check-target-xs48r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:46:32.588605 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:32.588602 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29dab441-c8b5-45e4-b586-5c52a843833d-kube-api-access-p6x8f podName:29dab441-c8b5-45e4-b586-5c52a843833d nodeName:}" failed. No retries permitted until 2026-07-29 22:46:33.088581772 +0000 UTC m=+3.044677627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-p6x8f" (UniqueName: "kubernetes.io/projected/29dab441-c8b5-45e4-b586-5c52a843833d-kube-api-access-p6x8f") pod "network-check-target-xs48r" (UID: "29dab441-c8b5-45e4-b586-5c52a843833d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:46:32.592645 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.592167 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjghq\" (UniqueName: \"kubernetes.io/projected/0485ba10-803b-4f61-8efd-2c9434e67584-kube-api-access-wjghq\") pod \"tuned-4pd24\" (UID: \"0485ba10-803b-4f61-8efd-2c9434e67584\") " pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.592645 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.592198 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9wht\" (UniqueName: \"kubernetes.io/projected/6817a1b0-e9d5-44a1-9e72-400f0911f52b-kube-api-access-p9wht\") pod \"multus-additional-cni-plugins-4jxr2\" (UID: \"6817a1b0-e9d5-44a1-9e72-400f0911f52b\") " pod="openshift-multus/multus-additional-cni-plugins-4jxr2" Jul 29 22:46:32.592645 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.592209 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk6kc\" (UniqueName: \"kubernetes.io/projected/c7d70a2c-8566-4797-914d-58c194ab083c-kube-api-access-zk6kc\") pod \"node-ca-nqd4j\" (UID: \"c7d70a2c-8566-4797-914d-58c194ab083c\") " pod="openshift-image-registry/node-ca-nqd4j" Jul 29 22:46:32.595624 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.595016 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pstj4\" (UniqueName: \"kubernetes.io/projected/a674054c-c6ca-4f41-9d96-9253b99152d4-kube-api-access-pstj4\") pod \"ovnkube-node-65k6t\" (UID: \"a674054c-c6ca-4f41-9d96-9253b99152d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.595624 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.595581 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smk6r\" (UniqueName: \"kubernetes.io/projected/e599bc76-5e9e-4b68-aae3-7fde40da6e7e-kube-api-access-smk6r\") pod \"aws-ebs-csi-driver-node-rpgtl\" (UID: \"e599bc76-5e9e-4b68-aae3-7fde40da6e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpgtl" Jul 29 22:46:32.596121 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.596098 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dm2l\" (UniqueName: \"kubernetes.io/projected/509e6d64-9d9b-4979-8554-f915cde622f0-kube-api-access-7dm2l\") pod \"iptables-alerter-d8gxw\" (UID: \"509e6d64-9d9b-4979-8554-f915cde622f0\") " pod="openshift-network-operator/iptables-alerter-d8gxw" Jul 29 22:46:32.596211 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.596146 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sfp7\" (UniqueName: \"kubernetes.io/projected/3100527d-fac5-4ee7-90fa-1171a661b55d-kube-api-access-9sfp7\") pod \"node-resolver-8pmwl\" (UID: \"3100527d-fac5-4ee7-90fa-1171a661b55d\") " pod="openshift-dns/node-resolver-8pmwl" Jul 29 22:46:32.684358 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.684322 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2zd5p" Jul 29 22:46:32.699000 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.698970 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d8gxw" Jul 29 22:46:32.707049 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.707021 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:32.714889 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.714860 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4jxr2" Jul 29 22:46:32.722772 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.722753 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpgtl" Jul 29 22:46:32.730621 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.730596 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kxxx9" Jul 29 22:46:32.738552 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.738528 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4pd24" Jul 29 22:46:32.745405 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.745381 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8pmwl" Jul 29 22:46:32.752139 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.752120 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nqd4j" Jul 29 22:46:32.986382 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.986287 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19b4fc0c-1b07-4c57-88df-5d40a7a07cfa-original-pull-secret\") pod \"global-pull-secret-syncer-xlxhw\" (UID: \"19b4fc0c-1b07-4c57-88df-5d40a7a07cfa\") " pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:46:32.986382 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:32.986366 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f61a04d-54f8-42b5-978f-0298dd8ac438-metrics-certs\") pod \"network-metrics-daemon-wfdzg\" (UID: \"6f61a04d-54f8-42b5-978f-0298dd8ac438\") " pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:46:32.986622 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:32.986460 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 22:46:32.986622 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:32.986480 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:46:32.986622 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:32.986536 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f61a04d-54f8-42b5-978f-0298dd8ac438-metrics-certs podName:6f61a04d-54f8-42b5-978f-0298dd8ac438 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:33.986517418 +0000 UTC m=+3.942613269 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f61a04d-54f8-42b5-978f-0298dd8ac438-metrics-certs") pod "network-metrics-daemon-wfdzg" (UID: "6f61a04d-54f8-42b5-978f-0298dd8ac438") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:46:32.986622 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:32.986554 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19b4fc0c-1b07-4c57-88df-5d40a7a07cfa-original-pull-secret podName:19b4fc0c-1b07-4c57-88df-5d40a7a07cfa nodeName:}" failed. No retries permitted until 2026-07-29 22:46:33.986544759 +0000 UTC m=+3.942640594 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19b4fc0c-1b07-4c57-88df-5d40a7a07cfa-original-pull-secret") pod "global-pull-secret-syncer-xlxhw" (UID: "19b4fc0c-1b07-4c57-88df-5d40a7a07cfa") : object "kube-system"/"original-pull-secret" not registered Jul 29 22:46:33.187368 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:33.187324 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6x8f\" (UniqueName: \"kubernetes.io/projected/29dab441-c8b5-45e4-b586-5c52a843833d-kube-api-access-p6x8f\") pod \"network-check-target-xs48r\" (UID: \"29dab441-c8b5-45e4-b586-5c52a843833d\") " pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:46:33.187550 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:33.187526 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 22:46:33.187620 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:33.187555 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 22:46:33.187620 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:33.187573 2570 projected.go:196] Error preparing data for projected volume kube-api-access-p6x8f for pod openshift-network-diagnostics/network-check-target-xs48r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:46:33.187741 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:33.187636 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29dab441-c8b5-45e4-b586-5c52a843833d-kube-api-access-p6x8f podName:29dab441-c8b5-45e4-b586-5c52a843833d nodeName:}" failed. No retries permitted until 2026-07-29 22:46:34.187618932 +0000 UTC m=+4.143714790 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6x8f" (UniqueName: "kubernetes.io/projected/29dab441-c8b5-45e4-b586-5c52a843833d-kube-api-access-p6x8f") pod "network-check-target-xs48r" (UID: "29dab441-c8b5-45e4-b586-5c52a843833d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:46:33.415874 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:33.415795 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 22:41:32 +0000 UTC" deadline="2028-04-01 11:00:05.893328932 +0000 UTC" Jul 29 22:46:33.415874 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:33.415828 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14676h13m32.477505179s" Jul 29 22:46:33.501937 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:33.501900 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:46:33.502130 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:33.502039 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs48r" podUID="29dab441-c8b5-45e4-b586-5c52a843833d" Jul 29 22:46:33.667599 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:33.667547 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode599bc76_5e9e_4b68_aae3_7fde40da6e7e.slice/crio-26982855d9f07717ebd887611aa09de0695e8a5abcba57f9928e197eb4c128ec WatchSource:0}: Error finding container 26982855d9f07717ebd887611aa09de0695e8a5abcba57f9928e197eb4c128ec: Status 404 returned error can't find the container with id 26982855d9f07717ebd887611aa09de0695e8a5abcba57f9928e197eb4c128ec Jul 29 22:46:33.668111 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:33.668088 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda674054c_c6ca_4f41_9d96_9253b99152d4.slice/crio-2aeab0290cc4f00b69aa5a321ab5348d4e25fcbf62a8f1ca2c64d4c49703c840 WatchSource:0}: Error finding container 2aeab0290cc4f00b69aa5a321ab5348d4e25fcbf62a8f1ca2c64d4c49703c840: Status 404 returned error can't find the container with id 2aeab0290cc4f00b69aa5a321ab5348d4e25fcbf62a8f1ca2c64d4c49703c840 Jul 29 22:46:33.671066 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:33.671033 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3100527d_fac5_4ee7_90fa_1171a661b55d.slice/crio-803a9560d1179044a3f5432fcfd0c1517deaebc918949efe912bf2446911660b WatchSource:0}: Error finding container 803a9560d1179044a3f5432fcfd0c1517deaebc918949efe912bf2446911660b: Status 404 returned error can't find the container with id 803a9560d1179044a3f5432fcfd0c1517deaebc918949efe912bf2446911660b Jul 29 22:46:33.675659 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:33.675530 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7d70a2c_8566_4797_914d_58c194ab083c.slice/crio-7a76973c0042517fc0d23b329c1ad5e814e90992e2f891b8126acaa5311f662d WatchSource:0}: Error finding container 7a76973c0042517fc0d23b329c1ad5e814e90992e2f891b8126acaa5311f662d: Status 404 returned error can't find the container with id 7a76973c0042517fc0d23b329c1ad5e814e90992e2f891b8126acaa5311f662d Jul 29 22:46:33.676173 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:33.676153 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod198acb98_b9c5_4b6e_b231_074ba237ecd5.slice/crio-deb128c71bc64ae0eef8069e43462d8980b25705ccb34622c1f928f2b355aa9e WatchSource:0}: Error finding container deb128c71bc64ae0eef8069e43462d8980b25705ccb34622c1f928f2b355aa9e: Status 404 returned error can't find the container with id deb128c71bc64ae0eef8069e43462d8980b25705ccb34622c1f928f2b355aa9e Jul 29 22:46:33.677871 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:46:33.677847 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod509e6d64_9d9b_4979_8554_f915cde622f0.slice/crio-61e41dd5dd6794162accc344807cf215743881c2eeb3114eff75186a4b3bf078 WatchSource:0}: Error finding container 61e41dd5dd6794162accc344807cf215743881c2eeb3114eff75186a4b3bf078: Status 404 returned error can't find the container with id 61e41dd5dd6794162accc344807cf215743881c2eeb3114eff75186a4b3bf078 Jul 29 22:46:33.995871 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:33.995648 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f61a04d-54f8-42b5-978f-0298dd8ac438-metrics-certs\") pod \"network-metrics-daemon-wfdzg\" (UID: \"6f61a04d-54f8-42b5-978f-0298dd8ac438\") " pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:46:33.996018 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:33.995909 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19b4fc0c-1b07-4c57-88df-5d40a7a07cfa-original-pull-secret\") pod \"global-pull-secret-syncer-xlxhw\" (UID: \"19b4fc0c-1b07-4c57-88df-5d40a7a07cfa\") " pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:46:33.996018 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:33.995809 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:46:33.996018 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:33.996002 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f61a04d-54f8-42b5-978f-0298dd8ac438-metrics-certs podName:6f61a04d-54f8-42b5-978f-0298dd8ac438 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:35.995983426 +0000 UTC m=+5.952079265 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f61a04d-54f8-42b5-978f-0298dd8ac438-metrics-certs") pod "network-metrics-daemon-wfdzg" (UID: "6f61a04d-54f8-42b5-978f-0298dd8ac438") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:46:33.996139 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:33.996024 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 22:46:33.996139 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:33.996066 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19b4fc0c-1b07-4c57-88df-5d40a7a07cfa-original-pull-secret podName:19b4fc0c-1b07-4c57-88df-5d40a7a07cfa nodeName:}" failed. No retries permitted until 2026-07-29 22:46:35.996053558 +0000 UTC m=+5.952149400 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19b4fc0c-1b07-4c57-88df-5d40a7a07cfa-original-pull-secret") pod "global-pull-secret-syncer-xlxhw" (UID: "19b4fc0c-1b07-4c57-88df-5d40a7a07cfa") : object "kube-system"/"original-pull-secret" not registered Jul 29 22:46:34.198135 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:34.198069 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6x8f\" (UniqueName: \"kubernetes.io/projected/29dab441-c8b5-45e4-b586-5c52a843833d-kube-api-access-p6x8f\") pod \"network-check-target-xs48r\" (UID: \"29dab441-c8b5-45e4-b586-5c52a843833d\") " pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:46:34.198314 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:34.198300 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 22:46:34.198381 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:34.198321 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 22:46:34.198381 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:34.198335 2570 projected.go:196] Error preparing data for projected volume kube-api-access-p6x8f for pod openshift-network-diagnostics/network-check-target-xs48r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:46:34.198475 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:34.198400 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29dab441-c8b5-45e4-b586-5c52a843833d-kube-api-access-p6x8f podName:29dab441-c8b5-45e4-b586-5c52a843833d nodeName:}" failed. No retries permitted until 2026-07-29 22:46:36.198381526 +0000 UTC m=+6.154477359 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6x8f" (UniqueName: "kubernetes.io/projected/29dab441-c8b5-45e4-b586-5c52a843833d-kube-api-access-p6x8f") pod "network-check-target-xs48r" (UID: "29dab441-c8b5-45e4-b586-5c52a843833d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:46:34.330741 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:34.330352 2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 22:46:34.416552 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:34.416408 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 22:41:32 +0000 UTC" deadline="2028-03-14 11:34:26.951276063 +0000 UTC" Jul 29 22:46:34.416552 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:34.416515 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14244h47m52.53476673s" Jul 29 22:46:34.505014 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:34.504318 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:46:34.505014 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:34.504447 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xlxhw" podUID="19b4fc0c-1b07-4c57-88df-5d40a7a07cfa" Jul 29 22:46:34.505014 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:34.504542 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:46:34.505014 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:34.504647 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfdzg" podUID="6f61a04d-54f8-42b5-978f-0298dd8ac438" Jul 29 22:46:34.522625 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:34.522589 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nqd4j" event={"ID":"c7d70a2c-8566-4797-914d-58c194ab083c","Type":"ContainerStarted","Data":"7a76973c0042517fc0d23b329c1ad5e814e90992e2f891b8126acaa5311f662d"} Jul 29 22:46:34.525608 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:34.525577 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" event={"ID":"a674054c-c6ca-4f41-9d96-9253b99152d4","Type":"ContainerStarted","Data":"2aeab0290cc4f00b69aa5a321ab5348d4e25fcbf62a8f1ca2c64d4c49703c840"} Jul 29 22:46:34.528899 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:34.528814 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpgtl" event={"ID":"e599bc76-5e9e-4b68-aae3-7fde40da6e7e","Type":"ContainerStarted","Data":"26982855d9f07717ebd887611aa09de0695e8a5abcba57f9928e197eb4c128ec"} Jul 29 22:46:34.538608 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:34.538552 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-44.ec2.internal" event={"ID":"28ee2cd84792d9409e5acf4090158792","Type":"ContainerStarted","Data":"625b460a81b332edf18aba12f8bf27307cb450d89e0ee1c8f01cbf7acd6cbec3"} Jul 29 22:46:34.543445 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:34.543401 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4jxr2" event={"ID":"6817a1b0-e9d5-44a1-9e72-400f0911f52b","Type":"ContainerStarted","Data":"7d383c4947ed16d9f5373c15295dd438db3f4b08e5521df50288e3b405766581"} Jul 29 22:46:34.554798 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:34.554654 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8pmwl" event={"ID":"3100527d-fac5-4ee7-90fa-1171a661b55d","Type":"ContainerStarted","Data":"803a9560d1179044a3f5432fcfd0c1517deaebc918949efe912bf2446911660b"} Jul 29 22:46:34.558660 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:34.558432 2570 generic.go:356] "Generic (PLEG): container finished" podID="1b1f25fc1428d45d3789fd496fdfa89c" containerID="1736f3defa9ecaf6c4928a75c082e70a75bfaf577a37bef112281d3e92c22b65" exitCode=0 Jul 29 22:46:34.558660 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:34.558505 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-44.ec2.internal" event={"ID":"1b1f25fc1428d45d3789fd496fdfa89c","Type":"ContainerDied","Data":"1736f3defa9ecaf6c4928a75c082e70a75bfaf577a37bef112281d3e92c22b65"} Jul 29 22:46:34.570155 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:34.570131 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kxxx9" event={"ID":"8b701f00-dc19-4258-a99d-86f2d493108e","Type":"ContainerStarted","Data":"caa8725c4bff5f7fc5a35a44acc79f77305d0c6e4244a9efafdcddfdea4ae6ec"} Jul 29 22:46:34.575952 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:34.575793 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-44.ec2.internal" podStartSLOduration=3.575776199 podStartE2EDuration="3.575776199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:46:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:34.55331265 +0000 UTC m=+4.509408509" watchObservedRunningTime="2026-07-29 22:46:34.575776199 +0000 UTC m=+4.531872055" Jul 29 22:46:34.583231 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:34.583172 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4pd24" event={"ID":"0485ba10-803b-4f61-8efd-2c9434e67584","Type":"ContainerStarted","Data":"5ee2dc3114a3b46f079931cacc6178f3ed291c29d55d1d743557d1111b031653"} Jul 29 22:46:34.607333 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:34.607302 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d8gxw" event={"ID":"509e6d64-9d9b-4979-8554-f915cde622f0","Type":"ContainerStarted","Data":"61e41dd5dd6794162accc344807cf215743881c2eeb3114eff75186a4b3bf078"} Jul 29 22:46:34.624886 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:34.624853 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2zd5p" event={"ID":"198acb98-b9c5-4b6e-b231-074ba237ecd5","Type":"ContainerStarted","Data":"deb128c71bc64ae0eef8069e43462d8980b25705ccb34622c1f928f2b355aa9e"} Jul 29 22:46:35.501750 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:35.501225 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:46:35.501750 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:35.501381 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs48r" podUID="29dab441-c8b5-45e4-b586-5c52a843833d" Jul 29 22:46:35.648200 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:35.648161 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-44.ec2.internal" event={"ID":"1b1f25fc1428d45d3789fd496fdfa89c","Type":"ContainerStarted","Data":"b33e606d1e750cc5a5f217b303b78f6152c4156871042c407d1e65b20ef63724"} Jul 29 22:46:35.664424 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:35.664368 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-44.ec2.internal" podStartSLOduration=4.664347713 podStartE2EDuration="4.664347713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:46:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:35.663642954 +0000 UTC m=+5.619738800" watchObservedRunningTime="2026-07-29 22:46:35.664347713 +0000 UTC m=+5.620443568" Jul 29 22:46:36.021991 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:36.021955 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19b4fc0c-1b07-4c57-88df-5d40a7a07cfa-original-pull-secret\") pod \"global-pull-secret-syncer-xlxhw\" (UID: \"19b4fc0c-1b07-4c57-88df-5d40a7a07cfa\") " pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:46:36.022154 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:36.022068 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f61a04d-54f8-42b5-978f-0298dd8ac438-metrics-certs\") pod \"network-metrics-daemon-wfdzg\" (UID: \"6f61a04d-54f8-42b5-978f-0298dd8ac438\") " pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:46:36.022224 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:36.022186 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:46:36.022284 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:36.022244 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f61a04d-54f8-42b5-978f-0298dd8ac438-metrics-certs podName:6f61a04d-54f8-42b5-978f-0298dd8ac438 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:40.022226349 +0000 UTC m=+9.978322199 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f61a04d-54f8-42b5-978f-0298dd8ac438-metrics-certs") pod "network-metrics-daemon-wfdzg" (UID: "6f61a04d-54f8-42b5-978f-0298dd8ac438") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:46:36.022445 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:36.022428 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 22:46:36.022521 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:36.022478 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19b4fc0c-1b07-4c57-88df-5d40a7a07cfa-original-pull-secret podName:19b4fc0c-1b07-4c57-88df-5d40a7a07cfa nodeName:}" failed. No retries permitted until 2026-07-29 22:46:40.022464413 +0000 UTC m=+9.978560249 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19b4fc0c-1b07-4c57-88df-5d40a7a07cfa-original-pull-secret") pod "global-pull-secret-syncer-xlxhw" (UID: "19b4fc0c-1b07-4c57-88df-5d40a7a07cfa") : object "kube-system"/"original-pull-secret" not registered Jul 29 22:46:36.229416 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:36.229376 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6x8f\" (UniqueName: \"kubernetes.io/projected/29dab441-c8b5-45e4-b586-5c52a843833d-kube-api-access-p6x8f\") pod \"network-check-target-xs48r\" (UID: \"29dab441-c8b5-45e4-b586-5c52a843833d\") " pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:46:36.229672 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:36.229572 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 22:46:36.229672 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:36.229599 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 22:46:36.229672 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:36.229611 2570 projected.go:196] Error preparing data for projected volume kube-api-access-p6x8f for pod openshift-network-diagnostics/network-check-target-xs48r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:46:36.229857 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:36.229757 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29dab441-c8b5-45e4-b586-5c52a843833d-kube-api-access-p6x8f podName:29dab441-c8b5-45e4-b586-5c52a843833d nodeName:}" failed. No retries permitted until 2026-07-29 22:46:40.229736418 +0000 UTC m=+10.185832252 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6x8f" (UniqueName: "kubernetes.io/projected/29dab441-c8b5-45e4-b586-5c52a843833d-kube-api-access-p6x8f") pod "network-check-target-xs48r" (UID: "29dab441-c8b5-45e4-b586-5c52a843833d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:46:36.501778 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:36.501189 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:46:36.501778 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:36.501331 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xlxhw" podUID="19b4fc0c-1b07-4c57-88df-5d40a7a07cfa" Jul 29 22:46:36.502265 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:36.502016 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:46:36.502265 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:36.502133 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfdzg" podUID="6f61a04d-54f8-42b5-978f-0298dd8ac438" Jul 29 22:46:37.501334 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:37.501297 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:46:37.501535 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:37.501436 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs48r" podUID="29dab441-c8b5-45e4-b586-5c52a843833d" Jul 29 22:46:38.502343 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:38.502161 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:46:38.502343 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:38.502300 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfdzg" podUID="6f61a04d-54f8-42b5-978f-0298dd8ac438" Jul 29 22:46:38.502343 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:38.502340 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:46:38.502846 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:38.502412 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xlxhw" podUID="19b4fc0c-1b07-4c57-88df-5d40a7a07cfa" Jul 29 22:46:39.502162 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:39.501653 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:46:39.502162 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:39.501798 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs48r" podUID="29dab441-c8b5-45e4-b586-5c52a843833d" Jul 29 22:46:40.062930 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:40.062886 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f61a04d-54f8-42b5-978f-0298dd8ac438-metrics-certs\") pod \"network-metrics-daemon-wfdzg\" (UID: \"6f61a04d-54f8-42b5-978f-0298dd8ac438\") " pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:46:40.063393 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:40.062952 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19b4fc0c-1b07-4c57-88df-5d40a7a07cfa-original-pull-secret\") pod \"global-pull-secret-syncer-xlxhw\" (UID: \"19b4fc0c-1b07-4c57-88df-5d40a7a07cfa\") " pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:46:40.063393 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:40.063079 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 22:46:40.063393 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:40.063142 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19b4fc0c-1b07-4c57-88df-5d40a7a07cfa-original-pull-secret podName:19b4fc0c-1b07-4c57-88df-5d40a7a07cfa nodeName:}" failed. No retries permitted until 2026-07-29 22:46:48.063124962 +0000 UTC m=+18.019220794 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19b4fc0c-1b07-4c57-88df-5d40a7a07cfa-original-pull-secret") pod "global-pull-secret-syncer-xlxhw" (UID: "19b4fc0c-1b07-4c57-88df-5d40a7a07cfa") : object "kube-system"/"original-pull-secret" not registered Jul 29 22:46:40.063561 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:40.063536 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:46:40.063608 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:40.063592 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f61a04d-54f8-42b5-978f-0298dd8ac438-metrics-certs podName:6f61a04d-54f8-42b5-978f-0298dd8ac438 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:48.06357524 +0000 UTC m=+18.019671093 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f61a04d-54f8-42b5-978f-0298dd8ac438-metrics-certs") pod "network-metrics-daemon-wfdzg" (UID: "6f61a04d-54f8-42b5-978f-0298dd8ac438") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:46:40.265059 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:40.265021 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6x8f\" (UniqueName: \"kubernetes.io/projected/29dab441-c8b5-45e4-b586-5c52a843833d-kube-api-access-p6x8f\") pod \"network-check-target-xs48r\" (UID: \"29dab441-c8b5-45e4-b586-5c52a843833d\") " pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:46:40.265342 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:40.265324 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 22:46:40.265418 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:40.265367 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 22:46:40.265418 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:40.265381 2570 projected.go:196] Error preparing data for projected volume kube-api-access-p6x8f for pod openshift-network-diagnostics/network-check-target-xs48r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:46:40.265518 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:40.265439 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29dab441-c8b5-45e4-b586-5c52a843833d-kube-api-access-p6x8f podName:29dab441-c8b5-45e4-b586-5c52a843833d nodeName:}" failed. No retries permitted until 2026-07-29 22:46:48.265422296 +0000 UTC m=+18.221518151 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6x8f" (UniqueName: "kubernetes.io/projected/29dab441-c8b5-45e4-b586-5c52a843833d-kube-api-access-p6x8f") pod "network-check-target-xs48r" (UID: "29dab441-c8b5-45e4-b586-5c52a843833d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:46:40.503368 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:40.502692 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:46:40.503368 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:40.502819 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfdzg" podUID="6f61a04d-54f8-42b5-978f-0298dd8ac438" Jul 29 22:46:40.503368 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:40.503181 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:46:40.503368 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:40.503275 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xlxhw" podUID="19b4fc0c-1b07-4c57-88df-5d40a7a07cfa" Jul 29 22:46:41.501356 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:41.501320 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:46:41.501874 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:41.501459 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs48r" podUID="29dab441-c8b5-45e4-b586-5c52a843833d" Jul 29 22:46:42.501487 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:42.501454 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:46:42.502001 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:42.501454 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:46:42.502001 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:42.501584 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfdzg" podUID="6f61a04d-54f8-42b5-978f-0298dd8ac438" Jul 29 22:46:42.502001 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:42.501645 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xlxhw" podUID="19b4fc0c-1b07-4c57-88df-5d40a7a07cfa" Jul 29 22:46:43.501624 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:43.501593 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:46:43.502096 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:43.501736 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs48r" podUID="29dab441-c8b5-45e4-b586-5c52a843833d" Jul 29 22:46:44.501368 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:44.501285 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:46:44.501524 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:44.501418 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xlxhw" podUID="19b4fc0c-1b07-4c57-88df-5d40a7a07cfa" Jul 29 22:46:44.501881 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:44.501859 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:46:44.502271 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:44.501979 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfdzg" podUID="6f61a04d-54f8-42b5-978f-0298dd8ac438" Jul 29 22:46:45.502015 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:45.501980 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:46:45.502412 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:45.502088 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs48r" podUID="29dab441-c8b5-45e4-b586-5c52a843833d" Jul 29 22:46:46.501380 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:46.501343 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:46:46.501544 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:46.501467 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfdzg" podUID="6f61a04d-54f8-42b5-978f-0298dd8ac438" Jul 29 22:46:46.501544 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:46.501520 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:46:46.501698 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:46.501618 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xlxhw" podUID="19b4fc0c-1b07-4c57-88df-5d40a7a07cfa" Jul 29 22:46:47.501909 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:47.501872 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:46:47.502399 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:47.501999 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs48r" podUID="29dab441-c8b5-45e4-b586-5c52a843833d" Jul 29 22:46:48.127673 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:48.127621 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19b4fc0c-1b07-4c57-88df-5d40a7a07cfa-original-pull-secret\") pod \"global-pull-secret-syncer-xlxhw\" (UID: \"19b4fc0c-1b07-4c57-88df-5d40a7a07cfa\") " pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:46:48.127831 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:48.127714 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f61a04d-54f8-42b5-978f-0298dd8ac438-metrics-certs\") pod \"network-metrics-daemon-wfdzg\" (UID: \"6f61a04d-54f8-42b5-978f-0298dd8ac438\") " pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:46:48.127831 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:48.127772 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 22:46:48.127831 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:48.127814 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:46:48.127969 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:48.127838 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19b4fc0c-1b07-4c57-88df-5d40a7a07cfa-original-pull-secret podName:19b4fc0c-1b07-4c57-88df-5d40a7a07cfa nodeName:}" failed. No retries permitted until 2026-07-29 22:47:04.127824027 +0000 UTC m=+34.083919859 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19b4fc0c-1b07-4c57-88df-5d40a7a07cfa-original-pull-secret") pod "global-pull-secret-syncer-xlxhw" (UID: "19b4fc0c-1b07-4c57-88df-5d40a7a07cfa") : object "kube-system"/"original-pull-secret" not registered Jul 29 22:46:48.127969 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:48.127865 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f61a04d-54f8-42b5-978f-0298dd8ac438-metrics-certs podName:6f61a04d-54f8-42b5-978f-0298dd8ac438 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:04.127849055 +0000 UTC m=+34.083944889 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f61a04d-54f8-42b5-978f-0298dd8ac438-metrics-certs") pod "network-metrics-daemon-wfdzg" (UID: "6f61a04d-54f8-42b5-978f-0298dd8ac438") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:46:48.329294 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:48.329201 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6x8f\" (UniqueName: \"kubernetes.io/projected/29dab441-c8b5-45e4-b586-5c52a843833d-kube-api-access-p6x8f\") pod \"network-check-target-xs48r\" (UID: \"29dab441-c8b5-45e4-b586-5c52a843833d\") " pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:46:48.329433 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:48.329392 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 22:46:48.329433 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:48.329417 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 22:46:48.329433 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:48.329428 2570 projected.go:196] Error preparing data for projected volume kube-api-access-p6x8f for pod openshift-network-diagnostics/network-check-target-xs48r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:46:48.329550 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:48.329477 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29dab441-c8b5-45e4-b586-5c52a843833d-kube-api-access-p6x8f podName:29dab441-c8b5-45e4-b586-5c52a843833d nodeName:}" failed. No retries permitted until 2026-07-29 22:47:04.329463749 +0000 UTC m=+34.285559581 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6x8f" (UniqueName: "kubernetes.io/projected/29dab441-c8b5-45e4-b586-5c52a843833d-kube-api-access-p6x8f") pod "network-check-target-xs48r" (UID: "29dab441-c8b5-45e4-b586-5c52a843833d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:46:48.501529 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:48.501492 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:46:48.501529 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:48.501519 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:46:48.501789 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:48.501649 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xlxhw" podUID="19b4fc0c-1b07-4c57-88df-5d40a7a07cfa" Jul 29 22:46:48.501847 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:48.501779 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfdzg" podUID="6f61a04d-54f8-42b5-978f-0298dd8ac438" Jul 29 22:46:49.501533 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:49.501499 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:46:49.501969 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:49.501611 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs48r" podUID="29dab441-c8b5-45e4-b586-5c52a843833d" Jul 29 22:46:50.502536 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:50.502501 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:46:50.503046 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:50.502642 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xlxhw" podUID="19b4fc0c-1b07-4c57-88df-5d40a7a07cfa" Jul 29 22:46:50.503046 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:50.502683 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:46:50.503046 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:50.502807 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfdzg" podUID="6f61a04d-54f8-42b5-978f-0298dd8ac438" Jul 29 22:46:51.501362 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:51.501334 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:46:51.501553 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:51.501449 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs48r" podUID="29dab441-c8b5-45e4-b586-5c52a843833d" Jul 29 22:46:52.503192 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:52.502943 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:46:52.503664 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:52.502982 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:46:52.504315 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:52.504270 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfdzg" podUID="6f61a04d-54f8-42b5-978f-0298dd8ac438" Jul 29 22:46:52.504398 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:52.504375 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xlxhw" podUID="19b4fc0c-1b07-4c57-88df-5d40a7a07cfa" Jul 29 22:46:52.682122 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:52.682095 2570 generic.go:356] "Generic (PLEG): container finished" podID="6817a1b0-e9d5-44a1-9e72-400f0911f52b" containerID="8c487fd940aca69a87cf0a2d6605bd28ae60ae13265a2973879a97b6a426c7e7" exitCode=0 Jul 29 22:46:52.682231 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:52.682172 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4jxr2" event={"ID":"6817a1b0-e9d5-44a1-9e72-400f0911f52b","Type":"ContainerDied","Data":"8c487fd940aca69a87cf0a2d6605bd28ae60ae13265a2973879a97b6a426c7e7"} Jul 29 22:46:52.683583 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:52.683561 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8pmwl" event={"ID":"3100527d-fac5-4ee7-90fa-1171a661b55d","Type":"ContainerStarted","Data":"83d40b208eda0b57be802331694b63d4c5297f83329f358f6dfa4aa1aa99d794"} Jul 29 22:46:52.685072 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:52.685045 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kxxx9" event={"ID":"8b701f00-dc19-4258-a99d-86f2d493108e","Type":"ContainerStarted","Data":"3d2f5bd1d3144e2fb278586e875e59b3d8dd73235b99f0f9c6c3270fb8a148ca"} Jul 29 22:46:52.686490 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:52.686473 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4pd24" event={"ID":"0485ba10-803b-4f61-8efd-2c9434e67584","Type":"ContainerStarted","Data":"65cb5dcc95fd5f9e433b5a9efc2e1da39136a257907be7e24e1bab25af58412e"} Jul 29 22:46:52.689781 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:52.689761 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2zd5p" event={"ID":"198acb98-b9c5-4b6e-b231-074ba237ecd5","Type":"ContainerStarted","Data":"5ca95b8144781a5d3f9cc50cbb746742ed41c3f57910384be78ba359322c8c51"} Jul 29 22:46:52.691076 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:52.691043 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nqd4j" event={"ID":"c7d70a2c-8566-4797-914d-58c194ab083c","Type":"ContainerStarted","Data":"aac8bd7d9422007ac3689917c38f38d1fd197671e94a6c46e16086b0bc66608d"} Jul 29 22:46:52.692919 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:52.692892 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" event={"ID":"a674054c-c6ca-4f41-9d96-9253b99152d4","Type":"ContainerStarted","Data":"eafd18256a1cf0b9865019829a4f30c5118d7f0d7f05130fe2910c8d23ad3982"} Jul 29 22:46:52.693020 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:52.692956 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" event={"ID":"a674054c-c6ca-4f41-9d96-9253b99152d4","Type":"ContainerStarted","Data":"a2262b642deda9b2493bdc9c25b20a05977279ec197dab3896c48c052c094d74"} Jul 29 22:46:52.694778 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:52.694760 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpgtl" event={"ID":"e599bc76-5e9e-4b68-aae3-7fde40da6e7e","Type":"ContainerStarted","Data":"b8c1ee140ab23a160577162106bce75dbddec7bac3327dd4454cab1e8c665a9a"} Jul 29 22:46:52.727890 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:52.727847 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4pd24" podStartSLOduration=4.26065517 podStartE2EDuration="22.727832148s" totalImagesPullingTime="18.467176978s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:52.727379669 +0000 UTC m=+22.683475523" watchObservedRunningTime="2026-07-29 22:46:52.727832148 +0000 UTC m=+22.683928002" Jul 29 22:46:52.769881 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:52.769841 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nqd4j" podStartSLOduration=4.327460471 podStartE2EDuration="22.769826334s" totalImagesPullingTime="18.442365863s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:52.743191618 +0000 UTC m=+22.699287475" watchObservedRunningTime="2026-07-29 22:46:52.769826334 +0000 UTC m=+22.725922188" Jul 29 22:46:52.769983 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:52.769906 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2zd5p" podStartSLOduration=4.278832914 podStartE2EDuration="22.769903128s" totalImagesPullingTime="18.491070214s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:52.769079854 +0000 UTC m=+22.725175707" watchObservedRunningTime="2026-07-29 22:46:52.769903128 +0000 UTC m=+22.725998983" Jul 29 22:46:52.801722 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:52.801678 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kxxx9" podStartSLOduration=4.36923438 podStartE2EDuration="22.801661867s" totalImagesPullingTime="18.432427487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:52.785890091 +0000 UTC m=+22.741985948" watchObservedRunningTime="2026-07-29 22:46:52.801661867 +0000 UTC m=+22.757757721" Jul 29 22:46:52.801831 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:52.801813 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8pmwl" podStartSLOduration=4.321924684 podStartE2EDuration="22.801809597s" totalImagesPullingTime="18.479884913s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:52.801446503 +0000 UTC m=+22.757542358" watchObservedRunningTime="2026-07-29 22:46:52.801809597 +0000 UTC m=+22.757905450" Jul 29 22:46:53.501550 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:53.501332 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:46:53.501762 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:53.501737 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs48r" podUID="29dab441-c8b5-45e4-b586-5c52a843833d" Jul 29 22:46:53.584976 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:53.584947 2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 29 22:46:53.699362 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:53.699324 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d8gxw" event={"ID":"509e6d64-9d9b-4979-8554-f915cde622f0","Type":"ContainerStarted","Data":"03905bc60b7e71c97368460ddecd02e8e7d7915f358ead03a9d7641baf7103e8"} Jul 29 22:46:53.702559 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:53.702491 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65k6t_a674054c-c6ca-4f41-9d96-9253b99152d4/ovn-acl-logging/0.log" Jul 29 22:46:53.702960 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:53.702936 2570 generic.go:356] "Generic (PLEG): container finished" podID="a674054c-c6ca-4f41-9d96-9253b99152d4" containerID="eafd18256a1cf0b9865019829a4f30c5118d7f0d7f05130fe2910c8d23ad3982" exitCode=1 Jul 29 22:46:53.703082 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:53.703009 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" event={"ID":"a674054c-c6ca-4f41-9d96-9253b99152d4","Type":"ContainerDied","Data":"eafd18256a1cf0b9865019829a4f30c5118d7f0d7f05130fe2910c8d23ad3982"} Jul 29 22:46:53.703153 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:53.703092 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" event={"ID":"a674054c-c6ca-4f41-9d96-9253b99152d4","Type":"ContainerStarted","Data":"1d66fa5bd371bd9302df8f51eec3b447ce16429d8654575a22fd56227862e035"} Jul 29 22:46:53.703153 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:53.703144 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" event={"ID":"a674054c-c6ca-4f41-9d96-9253b99152d4","Type":"ContainerStarted","Data":"366cb540e24e065ca3c7ecb7f48b9ba8447303135d0372d303634885de2a4996"} Jul 29 22:46:53.703257 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:53.703195 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" event={"ID":"a674054c-c6ca-4f41-9d96-9253b99152d4","Type":"ContainerStarted","Data":"7d204da97dad70d0d55a436e7f3e171e227ccde8943dab706171edf791a89d63"} Jul 29 22:46:53.703257 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:53.703246 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" event={"ID":"a674054c-c6ca-4f41-9d96-9253b99152d4","Type":"ContainerStarted","Data":"5dcc29aa0e471ad88a966e8b06f5fc95d97d5a3d4fb0088dea1b2f9bdfa85146"} Jul 29 22:46:53.704995 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:53.704966 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpgtl" event={"ID":"e599bc76-5e9e-4b68-aae3-7fde40da6e7e","Type":"ContainerStarted","Data":"ce7af74cd57564f60ad46526d1d0b17282fbc676545881b1d966b13448a88edd"} Jul 29 22:46:53.714541 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:53.714494 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-d8gxw" podStartSLOduration=5.260897534 podStartE2EDuration="23.714477276s" totalImagesPullingTime="18.453579742s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:53.713928263 +0000 UTC m=+23.670024114" watchObservedRunningTime="2026-07-29 22:46:53.714477276 +0000 UTC m=+23.670573134" Jul 29 22:46:54.440002 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:54.439897 2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T22:46:53.58497001Z","UUID":"881da9c3-8fd7-4d7a-be4a-0b08adbc9ab3","Handler":null,"Name":"","Endpoint":""} Jul 29 22:46:54.441753 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:54.441731 2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 29 22:46:54.441878 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:54.441773 2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 29 22:46:54.501936 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:54.501892 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:46:54.502115 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:54.501943 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:46:54.502115 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:54.502037 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfdzg" podUID="6f61a04d-54f8-42b5-978f-0298dd8ac438" Jul 29 22:46:54.502236 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:54.502157 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xlxhw" podUID="19b4fc0c-1b07-4c57-88df-5d40a7a07cfa" Jul 29 22:46:54.709941 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:54.709868 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpgtl" event={"ID":"e599bc76-5e9e-4b68-aae3-7fde40da6e7e","Type":"ContainerStarted","Data":"72696bd2b1452d34ea35ee4a92fc887232d6d7ac06d4f99bc89fc465cd8e6d35"} Jul 29 22:46:54.728905 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:54.728862 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpgtl" podStartSLOduration=4.216703689 podStartE2EDuration="24.72884549s" totalImagesPullingTime="20.512141801s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:46:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:54.728330716 +0000 UTC m=+24.684426571" watchObservedRunningTime="2026-07-29 22:46:54.72884549 +0000 UTC m=+24.684941344" Jul 29 22:46:55.179480 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:55.179437 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kxxx9" Jul 29 22:46:55.180195 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:55.180174 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kxxx9" Jul 29 22:46:55.502033 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:55.501955 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:46:55.502195 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:55.502070 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs48r" podUID="29dab441-c8b5-45e4-b586-5c52a843833d" Jul 29 22:46:55.715163 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:55.715128 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65k6t_a674054c-c6ca-4f41-9d96-9253b99152d4/ovn-acl-logging/0.log" Jul 29 22:46:55.715599 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:55.715550 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" event={"ID":"a674054c-c6ca-4f41-9d96-9253b99152d4","Type":"ContainerStarted","Data":"981a5f306cf895ade55e54192bc2e2fa66a8098c013ea9f7495f96ee9e60958b"} Jul 29 22:46:55.715695 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:55.715669 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kxxx9" Jul 29 22:46:55.716302 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:55.716283 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kxxx9" Jul 29 22:46:56.501133 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:56.501098 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:46:56.501308 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:56.501233 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfdzg" podUID="6f61a04d-54f8-42b5-978f-0298dd8ac438" Jul 29 22:46:56.501308 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:56.501284 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:46:56.501420 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:56.501342 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xlxhw" podUID="19b4fc0c-1b07-4c57-88df-5d40a7a07cfa" Jul 29 22:46:57.501828 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:57.501539 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:46:57.502434 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:57.501938 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs48r" podUID="29dab441-c8b5-45e4-b586-5c52a843833d" Jul 29 22:46:57.723004 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:57.722935 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65k6t_a674054c-c6ca-4f41-9d96-9253b99152d4/ovn-acl-logging/0.log" Jul 29 22:46:57.723302 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:57.723279 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" event={"ID":"a674054c-c6ca-4f41-9d96-9253b99152d4","Type":"ContainerStarted","Data":"918071aabd45d113e21ba5dafa90b38fc314f280133254d4a919f686581a08fe"} Jul 29 22:46:57.723548 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:57.723527 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:57.723708 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:57.723615 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:57.723771 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:57.723720 2570 scope.go:117] "RemoveContainer" containerID="eafd18256a1cf0b9865019829a4f30c5118d7f0d7f05130fe2910c8d23ad3982" Jul 29 22:46:57.725287 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:57.725259 2570 generic.go:356] "Generic (PLEG): container finished" podID="6817a1b0-e9d5-44a1-9e72-400f0911f52b" containerID="bd571133743039aeb537cc842af0bbb02d0c4d82c672c8efe2fd235808bbf03f" exitCode=0 Jul 29 22:46:57.725385 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:57.725354 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4jxr2" event={"ID":"6817a1b0-e9d5-44a1-9e72-400f0911f52b","Type":"ContainerDied","Data":"bd571133743039aeb537cc842af0bbb02d0c4d82c672c8efe2fd235808bbf03f"} Jul 29 22:46:57.741031 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:57.741010 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:58.502819 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:58.502063 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:46:58.502819 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:58.502097 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:46:58.502819 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:58.502433 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xlxhw" podUID="19b4fc0c-1b07-4c57-88df-5d40a7a07cfa" Jul 29 22:46:58.502819 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:58.502511 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfdzg" podUID="6f61a04d-54f8-42b5-978f-0298dd8ac438" Jul 29 22:46:58.730975 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:58.730907 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65k6t_a674054c-c6ca-4f41-9d96-9253b99152d4/ovn-acl-logging/0.log" Jul 29 22:46:58.731307 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:58.731281 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" event={"ID":"a674054c-c6ca-4f41-9d96-9253b99152d4","Type":"ContainerStarted","Data":"11c2b88aadda2ff484e9f79e258465f124258a8aef2d6bb342f4acfcbeb9ecff"} Jul 29 22:46:58.731494 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:58.731477 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:58.753597 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:58.753494 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:46:58.761671 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:58.761314 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" podStartSLOduration=9.969125446 podStartE2EDuration="28.761292483s" totalImagesPullingTime="18.792167037s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:58.759337146 +0000 UTC m=+28.715433002" watchObservedRunningTime="2026-07-29 22:46:58.761292483 +0000 UTC m=+28.717388338" Jul 29 22:46:59.317936 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:59.317852 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xlxhw"] Jul 29 22:46:59.318225 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:59.317968 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:46:59.318225 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:59.318075 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xlxhw" podUID="19b4fc0c-1b07-4c57-88df-5d40a7a07cfa" Jul 29 22:46:59.321821 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:59.321784 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xs48r"] Jul 29 22:46:59.321961 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:59.321914 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:46:59.322040 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:59.322018 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs48r" podUID="29dab441-c8b5-45e4-b586-5c52a843833d" Jul 29 22:46:59.322498 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:59.322475 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wfdzg"] Jul 29 22:46:59.322617 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:59.322576 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:46:59.322730 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:46:59.322696 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfdzg" podUID="6f61a04d-54f8-42b5-978f-0298dd8ac438" Jul 29 22:46:59.735332 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:59.735252 2570 generic.go:356] "Generic (PLEG): container finished" podID="6817a1b0-e9d5-44a1-9e72-400f0911f52b" containerID="1e71e379c1dc1a75eccd195702ab3e8d166a9b5171119fbef4a51b2f5b6c91cb" exitCode=0 Jul 29 22:46:59.735710 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:46:59.735333 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4jxr2" event={"ID":"6817a1b0-e9d5-44a1-9e72-400f0911f52b","Type":"ContainerDied","Data":"1e71e379c1dc1a75eccd195702ab3e8d166a9b5171119fbef4a51b2f5b6c91cb"} Jul 29 22:47:01.501755 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:01.501547 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:47:01.502149 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:01.501592 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:47:01.502149 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:01.501843 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfdzg" podUID="6f61a04d-54f8-42b5-978f-0298dd8ac438" Jul 29 22:47:01.502149 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:01.501894 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xlxhw" podUID="19b4fc0c-1b07-4c57-88df-5d40a7a07cfa" Jul 29 22:47:01.502149 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:01.501618 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:47:01.502149 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:01.501991 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs48r" podUID="29dab441-c8b5-45e4-b586-5c52a843833d" Jul 29 22:47:01.743671 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:01.743572 2570 generic.go:356] "Generic (PLEG): container finished" podID="6817a1b0-e9d5-44a1-9e72-400f0911f52b" containerID="0232a2a85fcca2d8c96411a7265d49f957148cc1abe8a3f6e9f92a6f3e18b9b9" exitCode=0 Jul 29 22:47:01.743671 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:01.743626 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4jxr2" event={"ID":"6817a1b0-e9d5-44a1-9e72-400f0911f52b","Type":"ContainerDied","Data":"0232a2a85fcca2d8c96411a7265d49f957148cc1abe8a3f6e9f92a6f3e18b9b9"} Jul 29 22:47:03.501519 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:03.501483 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:47:03.501519 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:03.501506 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:47:03.502114 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:03.501516 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:47:03.502114 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:03.501609 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs48r" podUID="29dab441-c8b5-45e4-b586-5c52a843833d" Jul 29 22:47:03.502114 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:03.501693 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xlxhw" podUID="19b4fc0c-1b07-4c57-88df-5d40a7a07cfa" Jul 29 22:47:03.502114 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:03.501788 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfdzg" podUID="6f61a04d-54f8-42b5-978f-0298dd8ac438" Jul 29 22:47:04.150884 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:04.150801 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19b4fc0c-1b07-4c57-88df-5d40a7a07cfa-original-pull-secret\") pod \"global-pull-secret-syncer-xlxhw\" (UID: \"19b4fc0c-1b07-4c57-88df-5d40a7a07cfa\") " pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:47:04.150884 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:04.150858 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f61a04d-54f8-42b5-978f-0298dd8ac438-metrics-certs\") pod \"network-metrics-daemon-wfdzg\" (UID: \"6f61a04d-54f8-42b5-978f-0298dd8ac438\") " pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:47:04.151075 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:04.150947 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 22:47:04.151075 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:04.151019 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19b4fc0c-1b07-4c57-88df-5d40a7a07cfa-original-pull-secret podName:19b4fc0c-1b07-4c57-88df-5d40a7a07cfa nodeName:}" failed. No retries permitted until 2026-07-29 22:47:36.151003297 +0000 UTC m=+66.107099129 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19b4fc0c-1b07-4c57-88df-5d40a7a07cfa-original-pull-secret") pod "global-pull-secret-syncer-xlxhw" (UID: "19b4fc0c-1b07-4c57-88df-5d40a7a07cfa") : object "kube-system"/"original-pull-secret" not registered Jul 29 22:47:04.151075 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:04.150953 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:47:04.151172 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:04.151095 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f61a04d-54f8-42b5-978f-0298dd8ac438-metrics-certs podName:6f61a04d-54f8-42b5-978f-0298dd8ac438 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:36.151080709 +0000 UTC m=+66.107176550 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f61a04d-54f8-42b5-978f-0298dd8ac438-metrics-certs") pod "network-metrics-daemon-wfdzg" (UID: "6f61a04d-54f8-42b5-978f-0298dd8ac438") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:47:04.352708 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:04.352672 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6x8f\" (UniqueName: \"kubernetes.io/projected/29dab441-c8b5-45e4-b586-5c52a843833d-kube-api-access-p6x8f\") pod \"network-check-target-xs48r\" (UID: \"29dab441-c8b5-45e4-b586-5c52a843833d\") " pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:47:04.352911 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:04.352825 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 22:47:04.352911 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:04.352846 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 22:47:04.352911 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:04.352860 2570 projected.go:196] Error preparing data for projected volume kube-api-access-p6x8f for pod openshift-network-diagnostics/network-check-target-xs48r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:47:04.353051 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:04.352924 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29dab441-c8b5-45e4-b586-5c52a843833d-kube-api-access-p6x8f podName:29dab441-c8b5-45e4-b586-5c52a843833d nodeName:}" failed. No retries permitted until 2026-07-29 22:47:36.352908715 +0000 UTC m=+66.309004546 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6x8f" (UniqueName: "kubernetes.io/projected/29dab441-c8b5-45e4-b586-5c52a843833d-kube-api-access-p6x8f") pod "network-check-target-xs48r" (UID: "29dab441-c8b5-45e4-b586-5c52a843833d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:47:05.501278 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:05.501243 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:47:05.501776 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:05.501262 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:47:05.501776 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:05.501370 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs48r" podUID="29dab441-c8b5-45e4-b586-5c52a843833d" Jul 29 22:47:05.501776 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:05.501383 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:47:05.501776 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:05.501465 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xlxhw" podUID="19b4fc0c-1b07-4c57-88df-5d40a7a07cfa" Jul 29 22:47:05.501776 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:05.501552 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfdzg" podUID="6f61a04d-54f8-42b5-978f-0298dd8ac438" Jul 29 22:47:05.936583 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:05.936562 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-44.ec2.internal" event="NodeReady" Jul 29 22:47:05.936756 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:05.936743 2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 29 22:47:05.980357 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:05.980322 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qzms6"] Jul 29 22:47:05.982543 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:05.982525 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qzms6" Jul 29 22:47:05.983720 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:05.983696 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-smhlc"] Jul 29 22:47:05.985580 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:05.985560 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-smhlc" Jul 29 22:47:05.985736 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:05.985557 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 29 22:47:05.985736 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:05.985660 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tpckt\"" Jul 29 22:47:05.986039 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:05.986020 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 29 22:47:05.988319 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:05.988267 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-f8hzf\"" Jul 29 22:47:05.988422 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:05.988353 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 29 22:47:05.988422 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:05.988392 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 29 22:47:05.988519 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:05.988356 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 29 22:47:05.995834 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:05.995812 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-smhlc"] Jul 29 22:47:05.997936 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:05.997916 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qzms6"] Jul 29 22:47:06.067400 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:06.067310 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl9zp\" (UniqueName: \"kubernetes.io/projected/7ede295e-e0e9-4a75-b7de-109a53d9fe57-kube-api-access-zl9zp\") pod \"ingress-canary-smhlc\" (UID: \"7ede295e-e0e9-4a75-b7de-109a53d9fe57\") " pod="openshift-ingress-canary/ingress-canary-smhlc" Jul 29 22:47:06.067400 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:06.067354 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f29f636-a8bd-4503-90bb-98290dccbb49-metrics-tls\") pod \"dns-default-qzms6\" (UID: \"5f29f636-a8bd-4503-90bb-98290dccbb49\") " pod="openshift-dns/dns-default-qzms6" Jul 29 22:47:06.067400 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:06.067374 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5f29f636-a8bd-4503-90bb-98290dccbb49-config-volume\") pod \"dns-default-qzms6\" (UID: \"5f29f636-a8bd-4503-90bb-98290dccbb49\") " pod="openshift-dns/dns-default-qzms6" Jul 29 22:47:06.067400 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:06.067395 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhbd2\" (UniqueName: \"kubernetes.io/projected/5f29f636-a8bd-4503-90bb-98290dccbb49-kube-api-access-vhbd2\") pod \"dns-default-qzms6\" (UID: \"5f29f636-a8bd-4503-90bb-98290dccbb49\") " pod="openshift-dns/dns-default-qzms6" Jul 29 22:47:06.067706 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:06.067411 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ede295e-e0e9-4a75-b7de-109a53d9fe57-cert\") pod \"ingress-canary-smhlc\" (UID: \"7ede295e-e0e9-4a75-b7de-109a53d9fe57\") " pod="openshift-ingress-canary/ingress-canary-smhlc" Jul 29 22:47:06.067706 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:06.067482 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f29f636-a8bd-4503-90bb-98290dccbb49-tmp-dir\") pod \"dns-default-qzms6\" (UID: \"5f29f636-a8bd-4503-90bb-98290dccbb49\") " pod="openshift-dns/dns-default-qzms6" Jul 29 22:47:06.168676 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:06.168622 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl9zp\" (UniqueName: \"kubernetes.io/projected/7ede295e-e0e9-4a75-b7de-109a53d9fe57-kube-api-access-zl9zp\") pod \"ingress-canary-smhlc\" (UID: \"7ede295e-e0e9-4a75-b7de-109a53d9fe57\") " pod="openshift-ingress-canary/ingress-canary-smhlc" Jul 29 22:47:06.168841 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:06.168683 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f29f636-a8bd-4503-90bb-98290dccbb49-metrics-tls\") pod \"dns-default-qzms6\" (UID: \"5f29f636-a8bd-4503-90bb-98290dccbb49\") " pod="openshift-dns/dns-default-qzms6" Jul 29 22:47:06.168841 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:06.168706 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5f29f636-a8bd-4503-90bb-98290dccbb49-config-volume\") pod \"dns-default-qzms6\" (UID: \"5f29f636-a8bd-4503-90bb-98290dccbb49\") " pod="openshift-dns/dns-default-qzms6" Jul 29 22:47:06.168841 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:06.168728 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhbd2\" (UniqueName: \"kubernetes.io/projected/5f29f636-a8bd-4503-90bb-98290dccbb49-kube-api-access-vhbd2\") pod \"dns-default-qzms6\" (UID: \"5f29f636-a8bd-4503-90bb-98290dccbb49\") " pod="openshift-dns/dns-default-qzms6" Jul 29 22:47:06.168841 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:06.168743 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ede295e-e0e9-4a75-b7de-109a53d9fe57-cert\") pod \"ingress-canary-smhlc\" (UID: \"7ede295e-e0e9-4a75-b7de-109a53d9fe57\") " pod="openshift-ingress-canary/ingress-canary-smhlc" Jul 29 22:47:06.168841 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:06.168761 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f29f636-a8bd-4503-90bb-98290dccbb49-tmp-dir\") pod \"dns-default-qzms6\" (UID: \"5f29f636-a8bd-4503-90bb-98290dccbb49\") " pod="openshift-dns/dns-default-qzms6" Jul 29 22:47:06.168841 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:06.168778 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 22:47:06.169064 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:06.168847 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f29f636-a8bd-4503-90bb-98290dccbb49-metrics-tls podName:5f29f636-a8bd-4503-90bb-98290dccbb49 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:06.668827108 +0000 UTC m=+36.624922942 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f29f636-a8bd-4503-90bb-98290dccbb49-metrics-tls") pod "dns-default-qzms6" (UID: "5f29f636-a8bd-4503-90bb-98290dccbb49") : secret "dns-default-metrics-tls" not found Jul 29 22:47:06.169152 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:06.169134 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f29f636-a8bd-4503-90bb-98290dccbb49-tmp-dir\") pod \"dns-default-qzms6\" (UID: \"5f29f636-a8bd-4503-90bb-98290dccbb49\") " pod="openshift-dns/dns-default-qzms6" Jul 29 22:47:06.169397 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:06.169380 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5f29f636-a8bd-4503-90bb-98290dccbb49-config-volume\") pod \"dns-default-qzms6\" (UID: \"5f29f636-a8bd-4503-90bb-98290dccbb49\") " pod="openshift-dns/dns-default-qzms6" Jul 29 22:47:06.172892 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:06.172871 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ede295e-e0e9-4a75-b7de-109a53d9fe57-cert\") pod \"ingress-canary-smhlc\" (UID: \"7ede295e-e0e9-4a75-b7de-109a53d9fe57\") " pod="openshift-ingress-canary/ingress-canary-smhlc" Jul 29 22:47:06.180005 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:06.179975 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhbd2\" (UniqueName: \"kubernetes.io/projected/5f29f636-a8bd-4503-90bb-98290dccbb49-kube-api-access-vhbd2\") pod \"dns-default-qzms6\" (UID: \"5f29f636-a8bd-4503-90bb-98290dccbb49\") " pod="openshift-dns/dns-default-qzms6" Jul 29 22:47:06.180658 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:06.180611 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl9zp\" (UniqueName: \"kubernetes.io/projected/7ede295e-e0e9-4a75-b7de-109a53d9fe57-kube-api-access-zl9zp\") pod \"ingress-canary-smhlc\" (UID: \"7ede295e-e0e9-4a75-b7de-109a53d9fe57\") " pod="openshift-ingress-canary/ingress-canary-smhlc" Jul 29 22:47:06.298737 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:06.298690 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-smhlc" Jul 29 22:47:06.430524 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:06.430295 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-smhlc"] Jul 29 22:47:06.433017 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:47:06.432992 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ede295e_e0e9_4a75_b7de_109a53d9fe57.slice/crio-b4edfb5efe0e785f7bf9b9931deb9a8eea56e96191cc396a1077b6cabe0d6b4d WatchSource:0}: Error finding container b4edfb5efe0e785f7bf9b9931deb9a8eea56e96191cc396a1077b6cabe0d6b4d: Status 404 returned error can't find the container with id b4edfb5efe0e785f7bf9b9931deb9a8eea56e96191cc396a1077b6cabe0d6b4d Jul 29 22:47:06.672478 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:06.672369 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f29f636-a8bd-4503-90bb-98290dccbb49-metrics-tls\") pod \"dns-default-qzms6\" (UID: \"5f29f636-a8bd-4503-90bb-98290dccbb49\") " pod="openshift-dns/dns-default-qzms6" Jul 29 22:47:06.673018 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:06.672541 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 22:47:06.673018 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:06.672604 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f29f636-a8bd-4503-90bb-98290dccbb49-metrics-tls podName:5f29f636-a8bd-4503-90bb-98290dccbb49 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:07.672589289 +0000 UTC m=+37.628685120 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f29f636-a8bd-4503-90bb-98290dccbb49-metrics-tls") pod "dns-default-qzms6" (UID: "5f29f636-a8bd-4503-90bb-98290dccbb49") : secret "dns-default-metrics-tls" not found Jul 29 22:47:06.756904 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:06.756865 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-smhlc" event={"ID":"7ede295e-e0e9-4a75-b7de-109a53d9fe57","Type":"ContainerStarted","Data":"b4edfb5efe0e785f7bf9b9931deb9a8eea56e96191cc396a1077b6cabe0d6b4d"} Jul 29 22:47:06.759353 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:06.759326 2570 generic.go:356] "Generic (PLEG): container finished" podID="6817a1b0-e9d5-44a1-9e72-400f0911f52b" containerID="1c40ef0212b23b990e6bd9bb7ab606e3f884f074c92b28124af2cb52d439c2d8" exitCode=0 Jul 29 22:47:06.759470 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:06.759360 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4jxr2" event={"ID":"6817a1b0-e9d5-44a1-9e72-400f0911f52b","Type":"ContainerDied","Data":"1c40ef0212b23b990e6bd9bb7ab606e3f884f074c92b28124af2cb52d439c2d8"} Jul 29 22:47:07.502183 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:07.502148 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:47:07.502183 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:07.502163 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:47:07.502183 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:07.502148 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:47:07.506112 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:07.506086 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s6c2g\"" Jul 29 22:47:07.506247 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:07.506137 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hgxlh\"" Jul 29 22:47:07.506247 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:07.506149 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 22:47:07.506247 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:07.506155 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 22:47:07.506247 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:07.506193 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 22:47:07.506247 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:07.506143 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 22:47:07.678583 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:07.678541 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f29f636-a8bd-4503-90bb-98290dccbb49-metrics-tls\") pod \"dns-default-qzms6\" (UID: \"5f29f636-a8bd-4503-90bb-98290dccbb49\") " pod="openshift-dns/dns-default-qzms6" Jul 29 22:47:07.678999 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:07.678684 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 22:47:07.678999 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:07.678740 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f29f636-a8bd-4503-90bb-98290dccbb49-metrics-tls podName:5f29f636-a8bd-4503-90bb-98290dccbb49 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:09.678723021 +0000 UTC m=+39.634818861 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f29f636-a8bd-4503-90bb-98290dccbb49-metrics-tls") pod "dns-default-qzms6" (UID: "5f29f636-a8bd-4503-90bb-98290dccbb49") : secret "dns-default-metrics-tls" not found Jul 29 22:47:07.765542 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:07.765456 2570 generic.go:356] "Generic (PLEG): container finished" podID="6817a1b0-e9d5-44a1-9e72-400f0911f52b" containerID="b6dcf2bf7be5d5d6976f3e0cac6028b5c570512875295a7fddecac26030c7c04" exitCode=0 Jul 29 22:47:07.765542 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:07.765533 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4jxr2" event={"ID":"6817a1b0-e9d5-44a1-9e72-400f0911f52b","Type":"ContainerDied","Data":"b6dcf2bf7be5d5d6976f3e0cac6028b5c570512875295a7fddecac26030c7c04"} Jul 29 22:47:08.771072 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:08.771032 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4jxr2" event={"ID":"6817a1b0-e9d5-44a1-9e72-400f0911f52b","Type":"ContainerStarted","Data":"f635a26c2be40bd7e90230b22d4e467459ee71dda6fb3893a232ce7f65c374db"} Jul 29 22:47:08.796235 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:08.796187 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4jxr2" podStartSLOduration=9.599385267 podStartE2EDuration="38.796172281s" totalImagesPullingTime="29.196787014s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:46:30 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:08.794643713 +0000 UTC m=+38.750739561" watchObservedRunningTime="2026-07-29 22:47:08.796172281 +0000 UTC m=+38.752268138" Jul 29 22:47:09.695189 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:09.694997 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f29f636-a8bd-4503-90bb-98290dccbb49-metrics-tls\") pod \"dns-default-qzms6\" (UID: \"5f29f636-a8bd-4503-90bb-98290dccbb49\") " pod="openshift-dns/dns-default-qzms6" Jul 29 22:47:09.695189 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:09.695143 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 22:47:09.695398 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:09.695247 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f29f636-a8bd-4503-90bb-98290dccbb49-metrics-tls podName:5f29f636-a8bd-4503-90bb-98290dccbb49 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:13.695231061 +0000 UTC m=+43.651326892 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f29f636-a8bd-4503-90bb-98290dccbb49-metrics-tls") pod "dns-default-qzms6" (UID: "5f29f636-a8bd-4503-90bb-98290dccbb49") : secret "dns-default-metrics-tls" not found Jul 29 22:47:09.775160 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:09.775125 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-smhlc" event={"ID":"7ede295e-e0e9-4a75-b7de-109a53d9fe57","Type":"ContainerStarted","Data":"efb68fdbc5b102b529b260a5763be3805548b65a0e2796f6c56d3f53eedfabb7"} Jul 29 22:47:09.791498 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:09.791439 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-smhlc" podStartSLOduration=2.388193405 podStartE2EDuration="4.791418631s" totalImagesPullingTime="2.403225226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:09.791370471 +0000 UTC m=+39.747466325" watchObservedRunningTime="2026-07-29 22:47:09.791418631 +0000 UTC m=+39.747514489" Jul 29 22:47:13.308063 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.308029 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-w7x54"] Jul 29 22:47:13.332816 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.332787 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w7x54" Jul 29 22:47:13.342056 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.342038 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 29 22:47:13.348264 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.348243 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 29 22:47:13.348592 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.348577 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m9mf7\"" Jul 29 22:47:13.351683 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.351668 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 29 22:47:13.351755 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.351668 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 29 22:47:13.362926 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.362901 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w7x54"] Jul 29 22:47:13.422930 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.422890 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b5a74cf5-440b-4152-8375-aca329c2b646-data-volume\") pod \"insights-runtime-extractor-w7x54\" (UID: \"b5a74cf5-440b-4152-8375-aca329c2b646\") " pod="openshift-insights/insights-runtime-extractor-w7x54" Jul 29 22:47:13.422930 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.422927 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b5a74cf5-440b-4152-8375-aca329c2b646-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7x54\" (UID: \"b5a74cf5-440b-4152-8375-aca329c2b646\") " pod="openshift-insights/insights-runtime-extractor-w7x54" Jul 29 22:47:13.423123 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.422968 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fwtq\" (UniqueName: \"kubernetes.io/projected/b5a74cf5-440b-4152-8375-aca329c2b646-kube-api-access-8fwtq\") pod \"insights-runtime-extractor-w7x54\" (UID: \"b5a74cf5-440b-4152-8375-aca329c2b646\") " pod="openshift-insights/insights-runtime-extractor-w7x54" Jul 29 22:47:13.423123 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.422996 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b5a74cf5-440b-4152-8375-aca329c2b646-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7x54\" (UID: \"b5a74cf5-440b-4152-8375-aca329c2b646\") " pod="openshift-insights/insights-runtime-extractor-w7x54" Jul 29 22:47:13.423123 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.423012 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b5a74cf5-440b-4152-8375-aca329c2b646-crio-socket\") pod \"insights-runtime-extractor-w7x54\" (UID: \"b5a74cf5-440b-4152-8375-aca329c2b646\") " pod="openshift-insights/insights-runtime-extractor-w7x54" Jul 29 22:47:13.473079 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.473048 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-42mhf"] Jul 29 22:47:13.496768 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.496738 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-42mhf"] Jul 29 22:47:13.496903 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.496857 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-42mhf" Jul 29 22:47:13.499601 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.499580 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 29 22:47:13.499893 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.499877 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-btlk9\"" Jul 29 22:47:13.499991 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.499929 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 29 22:47:13.523573 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.523546 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzjqv\" (UniqueName: \"kubernetes.io/projected/3d6c0871-b732-4f0f-9c25-b14d6cae35b8-kube-api-access-tzjqv\") pod \"migrator-6865c9967-42mhf\" (UID: \"3d6c0871-b732-4f0f-9c25-b14d6cae35b8\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-42mhf" Jul 29 22:47:13.523742 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.523590 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b5a74cf5-440b-4152-8375-aca329c2b646-data-volume\") pod \"insights-runtime-extractor-w7x54\" (UID: \"b5a74cf5-440b-4152-8375-aca329c2b646\") " pod="openshift-insights/insights-runtime-extractor-w7x54" Jul 29 22:47:13.523742 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.523611 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b5a74cf5-440b-4152-8375-aca329c2b646-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7x54\" (UID: \"b5a74cf5-440b-4152-8375-aca329c2b646\") " pod="openshift-insights/insights-runtime-extractor-w7x54" Jul 29 22:47:13.523742 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.523696 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fwtq\" (UniqueName: \"kubernetes.io/projected/b5a74cf5-440b-4152-8375-aca329c2b646-kube-api-access-8fwtq\") pod \"insights-runtime-extractor-w7x54\" (UID: \"b5a74cf5-440b-4152-8375-aca329c2b646\") " pod="openshift-insights/insights-runtime-extractor-w7x54" Jul 29 22:47:13.523742 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:13.523731 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 22:47:13.523914 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.523747 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b5a74cf5-440b-4152-8375-aca329c2b646-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7x54\" (UID: \"b5a74cf5-440b-4152-8375-aca329c2b646\") " pod="openshift-insights/insights-runtime-extractor-w7x54" Jul 29 22:47:13.523914 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:13.523787 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5a74cf5-440b-4152-8375-aca329c2b646-insights-runtime-extractor-tls podName:b5a74cf5-440b-4152-8375-aca329c2b646 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:14.023768626 +0000 UTC m=+43.979864477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b5a74cf5-440b-4152-8375-aca329c2b646-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w7x54" (UID: "b5a74cf5-440b-4152-8375-aca329c2b646") : secret "insights-runtime-extractor-tls" not found Jul 29 22:47:13.523914 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.523805 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b5a74cf5-440b-4152-8375-aca329c2b646-crio-socket\") pod \"insights-runtime-extractor-w7x54\" (UID: \"b5a74cf5-440b-4152-8375-aca329c2b646\") " pod="openshift-insights/insights-runtime-extractor-w7x54" Jul 29 22:47:13.523914 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:13.523828 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 22:47:13.523914 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:13.523894 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b5a74cf5-440b-4152-8375-aca329c2b646-kube-rbac-proxy-cm podName:b5a74cf5-440b-4152-8375-aca329c2b646 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:14.023878253 +0000 UTC m=+43.979974085 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b5a74cf5-440b-4152-8375-aca329c2b646-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w7x54" (UID: "b5a74cf5-440b-4152-8375-aca329c2b646") : configmap "kube-rbac-proxy" not found Jul 29 22:47:13.524080 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.523951 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b5a74cf5-440b-4152-8375-aca329c2b646-data-volume\") pod \"insights-runtime-extractor-w7x54\" (UID: \"b5a74cf5-440b-4152-8375-aca329c2b646\") " pod="openshift-insights/insights-runtime-extractor-w7x54" Jul 29 22:47:13.524080 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.524036 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b5a74cf5-440b-4152-8375-aca329c2b646-crio-socket\") pod \"insights-runtime-extractor-w7x54\" (UID: \"b5a74cf5-440b-4152-8375-aca329c2b646\") " pod="openshift-insights/insights-runtime-extractor-w7x54" Jul 29 22:47:13.538690 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.538655 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fwtq\" (UniqueName: \"kubernetes.io/projected/b5a74cf5-440b-4152-8375-aca329c2b646-kube-api-access-8fwtq\") pod \"insights-runtime-extractor-w7x54\" (UID: \"b5a74cf5-440b-4152-8375-aca329c2b646\") " pod="openshift-insights/insights-runtime-extractor-w7x54" Jul 29 22:47:13.625233 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.625150 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzjqv\" (UniqueName: \"kubernetes.io/projected/3d6c0871-b732-4f0f-9c25-b14d6cae35b8-kube-api-access-tzjqv\") pod \"migrator-6865c9967-42mhf\" (UID: \"3d6c0871-b732-4f0f-9c25-b14d6cae35b8\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-42mhf" Jul 29 22:47:13.634549 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.634524 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzjqv\" (UniqueName: \"kubernetes.io/projected/3d6c0871-b732-4f0f-9c25-b14d6cae35b8-kube-api-access-tzjqv\") pod \"migrator-6865c9967-42mhf\" (UID: \"3d6c0871-b732-4f0f-9c25-b14d6cae35b8\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-42mhf" Jul 29 22:47:13.726475 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.726433 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f29f636-a8bd-4503-90bb-98290dccbb49-metrics-tls\") pod \"dns-default-qzms6\" (UID: \"5f29f636-a8bd-4503-90bb-98290dccbb49\") " pod="openshift-dns/dns-default-qzms6" Jul 29 22:47:13.726673 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:13.726615 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 22:47:13.726721 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:13.726702 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f29f636-a8bd-4503-90bb-98290dccbb49-metrics-tls podName:5f29f636-a8bd-4503-90bb-98290dccbb49 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:21.726682801 +0000 UTC m=+51.682778633 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f29f636-a8bd-4503-90bb-98290dccbb49-metrics-tls") pod "dns-default-qzms6" (UID: "5f29f636-a8bd-4503-90bb-98290dccbb49") : secret "dns-default-metrics-tls" not found Jul 29 22:47:13.805467 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.805421 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-42mhf" Jul 29 22:47:13.947621 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:13.947587 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-42mhf"] Jul 29 22:47:13.950561 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:47:13.950527 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d6c0871_b732_4f0f_9c25_b14d6cae35b8.slice/crio-a2c33d2e6dc1b928b7b79b9cfd2ef2ed5ffd48a2fa3ca931f27c8d31c1a2e68e WatchSource:0}: Error finding container a2c33d2e6dc1b928b7b79b9cfd2ef2ed5ffd48a2fa3ca931f27c8d31c1a2e68e: Status 404 returned error can't find the container with id a2c33d2e6dc1b928b7b79b9cfd2ef2ed5ffd48a2fa3ca931f27c8d31c1a2e68e Jul 29 22:47:14.028806 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:14.028764 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b5a74cf5-440b-4152-8375-aca329c2b646-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7x54\" (UID: \"b5a74cf5-440b-4152-8375-aca329c2b646\") " pod="openshift-insights/insights-runtime-extractor-w7x54" Jul 29 22:47:14.028980 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:14.028830 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b5a74cf5-440b-4152-8375-aca329c2b646-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7x54\" (UID: \"b5a74cf5-440b-4152-8375-aca329c2b646\") " pod="openshift-insights/insights-runtime-extractor-w7x54" Jul 29 22:47:14.028980 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:14.028908 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 22:47:14.028980 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:14.028916 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 22:47:14.028980 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:14.028961 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b5a74cf5-440b-4152-8375-aca329c2b646-kube-rbac-proxy-cm podName:b5a74cf5-440b-4152-8375-aca329c2b646 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:15.028945856 +0000 UTC m=+44.985041688 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b5a74cf5-440b-4152-8375-aca329c2b646-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w7x54" (UID: "b5a74cf5-440b-4152-8375-aca329c2b646") : configmap "kube-rbac-proxy" not found Jul 29 22:47:14.028980 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:14.028974 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5a74cf5-440b-4152-8375-aca329c2b646-insights-runtime-extractor-tls podName:b5a74cf5-440b-4152-8375-aca329c2b646 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:15.028968048 +0000 UTC m=+44.985063880 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b5a74cf5-440b-4152-8375-aca329c2b646-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w7x54" (UID: "b5a74cf5-440b-4152-8375-aca329c2b646") : secret "insights-runtime-extractor-tls" not found Jul 29 22:47:14.787992 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:14.787954 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-42mhf" event={"ID":"3d6c0871-b732-4f0f-9c25-b14d6cae35b8","Type":"ContainerStarted","Data":"a2c33d2e6dc1b928b7b79b9cfd2ef2ed5ffd48a2fa3ca931f27c8d31c1a2e68e"} Jul 29 22:47:15.035882 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:15.035843 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b5a74cf5-440b-4152-8375-aca329c2b646-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7x54\" (UID: \"b5a74cf5-440b-4152-8375-aca329c2b646\") " pod="openshift-insights/insights-runtime-extractor-w7x54" Jul 29 22:47:15.036068 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:15.036019 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 22:47:15.036150 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:15.036018 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b5a74cf5-440b-4152-8375-aca329c2b646-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7x54\" (UID: \"b5a74cf5-440b-4152-8375-aca329c2b646\") " pod="openshift-insights/insights-runtime-extractor-w7x54" Jul 29 22:47:15.036150 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:15.036077 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 22:47:15.036150 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:15.036094 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5a74cf5-440b-4152-8375-aca329c2b646-insights-runtime-extractor-tls podName:b5a74cf5-440b-4152-8375-aca329c2b646 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:17.03607273 +0000 UTC m=+46.992168569 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b5a74cf5-440b-4152-8375-aca329c2b646-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w7x54" (UID: "b5a74cf5-440b-4152-8375-aca329c2b646") : secret "insights-runtime-extractor-tls" not found Jul 29 22:47:15.036301 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:15.036152 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b5a74cf5-440b-4152-8375-aca329c2b646-kube-rbac-proxy-cm podName:b5a74cf5-440b-4152-8375-aca329c2b646 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:17.036130754 +0000 UTC m=+46.992226605 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b5a74cf5-440b-4152-8375-aca329c2b646-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w7x54" (UID: "b5a74cf5-440b-4152-8375-aca329c2b646") : configmap "kube-rbac-proxy" not found Jul 29 22:47:15.066601 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:15.066515 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8pmwl_3100527d-fac5-4ee7-90fa-1171a661b55d/dns-node-resolver/0.log" Jul 29 22:47:15.791916 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:15.791825 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-42mhf" event={"ID":"3d6c0871-b732-4f0f-9c25-b14d6cae35b8","Type":"ContainerStarted","Data":"261a2aa8e9a2bf6bb7afde2b16978b65da618520616bde38a8ed07dacb5f3bd3"} Jul 29 22:47:15.791916 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:15.791881 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-42mhf" event={"ID":"3d6c0871-b732-4f0f-9c25-b14d6cae35b8","Type":"ContainerStarted","Data":"c795f89607df912f8806f60bbb05ff08c83b91145cc3e7bef5f566f6602b168f"} Jul 29 22:47:15.810356 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:15.810306 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-42mhf" podStartSLOduration=1.243741209 podStartE2EDuration="2.810289531s" totalImagesPullingTime="1.566548322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:15.809709381 +0000 UTC m=+45.765805237" watchObservedRunningTime="2026-07-29 22:47:15.810289531 +0000 UTC m=+45.766385430" Jul 29 22:47:16.021520 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:16.021487 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-9kjcg"] Jul 29 22:47:16.038994 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:16.038968 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-9kjcg"] Jul 29 22:47:16.039132 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:16.039072 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-9kjcg" Jul 29 22:47:16.042002 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:16.041933 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 29 22:47:16.042131 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:16.042044 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 29 22:47:16.042131 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:16.042051 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-shcbb\"" Jul 29 22:47:16.042131 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:16.042073 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 29 22:47:16.043098 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:16.043082 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 29 22:47:16.066700 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:16.066675 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nqd4j_c7d70a2c-8566-4797-914d-58c194ab083c/node-ca/0.log" Jul 29 22:47:16.145128 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:16.145093 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trmrx\" (UniqueName: \"kubernetes.io/projected/f894a561-db14-4e3d-ac5f-58636d014d96-kube-api-access-trmrx\") pod \"service-ca-658d7b7c78-9kjcg\" (UID: \"f894a561-db14-4e3d-ac5f-58636d014d96\") " pod="openshift-service-ca/service-ca-658d7b7c78-9kjcg" Jul 29 22:47:16.145307 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:16.145134 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f894a561-db14-4e3d-ac5f-58636d014d96-signing-key\") pod \"service-ca-658d7b7c78-9kjcg\" (UID: \"f894a561-db14-4e3d-ac5f-58636d014d96\") " pod="openshift-service-ca/service-ca-658d7b7c78-9kjcg" Jul 29 22:47:16.145307 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:16.145162 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f894a561-db14-4e3d-ac5f-58636d014d96-signing-cabundle\") pod \"service-ca-658d7b7c78-9kjcg\" (UID: \"f894a561-db14-4e3d-ac5f-58636d014d96\") " pod="openshift-service-ca/service-ca-658d7b7c78-9kjcg" Jul 29 22:47:16.245810 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:16.245774 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f894a561-db14-4e3d-ac5f-58636d014d96-signing-key\") pod \"service-ca-658d7b7c78-9kjcg\" (UID: \"f894a561-db14-4e3d-ac5f-58636d014d96\") " pod="openshift-service-ca/service-ca-658d7b7c78-9kjcg" Jul 29 22:47:16.245943 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:16.245814 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f894a561-db14-4e3d-ac5f-58636d014d96-signing-cabundle\") pod \"service-ca-658d7b7c78-9kjcg\" (UID: \"f894a561-db14-4e3d-ac5f-58636d014d96\") " pod="openshift-service-ca/service-ca-658d7b7c78-9kjcg" Jul 29 22:47:16.246155 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:16.246054 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trmrx\" (UniqueName: \"kubernetes.io/projected/f894a561-db14-4e3d-ac5f-58636d014d96-kube-api-access-trmrx\") pod \"service-ca-658d7b7c78-9kjcg\" (UID: \"f894a561-db14-4e3d-ac5f-58636d014d96\") " pod="openshift-service-ca/service-ca-658d7b7c78-9kjcg" Jul 29 22:47:16.246593 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:16.246571 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f894a561-db14-4e3d-ac5f-58636d014d96-signing-cabundle\") pod \"service-ca-658d7b7c78-9kjcg\" (UID: \"f894a561-db14-4e3d-ac5f-58636d014d96\") " pod="openshift-service-ca/service-ca-658d7b7c78-9kjcg" Jul 29 22:47:16.248254 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:16.248235 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f894a561-db14-4e3d-ac5f-58636d014d96-signing-key\") pod \"service-ca-658d7b7c78-9kjcg\" (UID: \"f894a561-db14-4e3d-ac5f-58636d014d96\") " pod="openshift-service-ca/service-ca-658d7b7c78-9kjcg" Jul 29 22:47:16.255520 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:16.255499 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trmrx\" (UniqueName: \"kubernetes.io/projected/f894a561-db14-4e3d-ac5f-58636d014d96-kube-api-access-trmrx\") pod \"service-ca-658d7b7c78-9kjcg\" (UID: \"f894a561-db14-4e3d-ac5f-58636d014d96\") " pod="openshift-service-ca/service-ca-658d7b7c78-9kjcg" Jul 29 22:47:16.347095 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:16.347016 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-9kjcg" Jul 29 22:47:16.494208 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:16.494177 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-9kjcg"] Jul 29 22:47:16.498461 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:47:16.498433 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf894a561_db14_4e3d_ac5f_58636d014d96.slice/crio-4c6bbe956fff3c79267cba6e7e1a025b970d4c8e6762324c7823eff0948c208e WatchSource:0}: Error finding container 4c6bbe956fff3c79267cba6e7e1a025b970d4c8e6762324c7823eff0948c208e: Status 404 returned error can't find the container with id 4c6bbe956fff3c79267cba6e7e1a025b970d4c8e6762324c7823eff0948c208e Jul 29 22:47:16.794990 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:16.794955 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-9kjcg" event={"ID":"f894a561-db14-4e3d-ac5f-58636d014d96","Type":"ContainerStarted","Data":"4c6bbe956fff3c79267cba6e7e1a025b970d4c8e6762324c7823eff0948c208e"} Jul 29 22:47:17.053058 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:17.052971 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b5a74cf5-440b-4152-8375-aca329c2b646-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7x54\" (UID: \"b5a74cf5-440b-4152-8375-aca329c2b646\") " pod="openshift-insights/insights-runtime-extractor-w7x54" Jul 29 22:47:17.053224 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:17.053074 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b5a74cf5-440b-4152-8375-aca329c2b646-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7x54\" (UID: \"b5a74cf5-440b-4152-8375-aca329c2b646\") " pod="openshift-insights/insights-runtime-extractor-w7x54" Jul 29 22:47:17.053224 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:17.053119 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 22:47:17.053224 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:17.053205 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b5a74cf5-440b-4152-8375-aca329c2b646-kube-rbac-proxy-cm podName:b5a74cf5-440b-4152-8375-aca329c2b646 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:21.053180738 +0000 UTC m=+51.009276572 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b5a74cf5-440b-4152-8375-aca329c2b646-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w7x54" (UID: "b5a74cf5-440b-4152-8375-aca329c2b646") : configmap "kube-rbac-proxy" not found Jul 29 22:47:17.053354 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:17.053285 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 22:47:17.053423 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:17.053411 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5a74cf5-440b-4152-8375-aca329c2b646-insights-runtime-extractor-tls podName:b5a74cf5-440b-4152-8375-aca329c2b646 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:21.053392322 +0000 UTC m=+51.009488168 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b5a74cf5-440b-4152-8375-aca329c2b646-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w7x54" (UID: "b5a74cf5-440b-4152-8375-aca329c2b646") : secret "insights-runtime-extractor-tls" not found Jul 29 22:47:17.266624 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:17.266583 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-smhlc_7ede295e-e0e9-4a75-b7de-109a53d9fe57/serve-healthcheck-canary/0.log" Jul 29 22:47:19.807204 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:19.807164 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-9kjcg" event={"ID":"f894a561-db14-4e3d-ac5f-58636d014d96","Type":"ContainerStarted","Data":"eea7ef86bed7646ba68a883ebcc4683a078ee576de87d9983f5722081f57f987"} Jul 29 22:47:19.825158 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:19.825105 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-9kjcg" podStartSLOduration=1.52321678 podStartE2EDuration="3.825090336s" totalImagesPullingTime="2.301873556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:19.823703852 +0000 UTC m=+49.779799703" watchObservedRunningTime="2026-07-29 22:47:19.825090336 +0000 UTC m=+49.781186189" Jul 29 22:47:21.089546 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:21.089504 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b5a74cf5-440b-4152-8375-aca329c2b646-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7x54\" (UID: \"b5a74cf5-440b-4152-8375-aca329c2b646\") " pod="openshift-insights/insights-runtime-extractor-w7x54" Jul 29 22:47:21.090063 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:21.089578 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b5a74cf5-440b-4152-8375-aca329c2b646-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7x54\" (UID: \"b5a74cf5-440b-4152-8375-aca329c2b646\") " pod="openshift-insights/insights-runtime-extractor-w7x54" Jul 29 22:47:21.090063 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:21.089666 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 22:47:21.090063 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:21.089692 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 22:47:21.090063 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:21.089747 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5a74cf5-440b-4152-8375-aca329c2b646-insights-runtime-extractor-tls podName:b5a74cf5-440b-4152-8375-aca329c2b646 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:29.089730971 +0000 UTC m=+59.045826806 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b5a74cf5-440b-4152-8375-aca329c2b646-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w7x54" (UID: "b5a74cf5-440b-4152-8375-aca329c2b646") : secret "insights-runtime-extractor-tls" not found Jul 29 22:47:21.090063 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:21.089765 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b5a74cf5-440b-4152-8375-aca329c2b646-kube-rbac-proxy-cm podName:b5a74cf5-440b-4152-8375-aca329c2b646 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:29.089758902 +0000 UTC m=+59.045854734 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b5a74cf5-440b-4152-8375-aca329c2b646-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w7x54" (UID: "b5a74cf5-440b-4152-8375-aca329c2b646") : configmap "kube-rbac-proxy" not found Jul 29 22:47:21.796049 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:21.796013 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f29f636-a8bd-4503-90bb-98290dccbb49-metrics-tls\") pod \"dns-default-qzms6\" (UID: \"5f29f636-a8bd-4503-90bb-98290dccbb49\") " pod="openshift-dns/dns-default-qzms6" Jul 29 22:47:21.796234 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:21.796175 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 22:47:21.796277 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:21.796237 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f29f636-a8bd-4503-90bb-98290dccbb49-metrics-tls podName:5f29f636-a8bd-4503-90bb-98290dccbb49 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:37.796222853 +0000 UTC m=+67.752318686 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f29f636-a8bd-4503-90bb-98290dccbb49-metrics-tls") pod "dns-default-qzms6" (UID: "5f29f636-a8bd-4503-90bb-98290dccbb49") : secret "dns-default-metrics-tls" not found Jul 29 22:47:29.152904 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:29.152858 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b5a74cf5-440b-4152-8375-aca329c2b646-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7x54\" (UID: \"b5a74cf5-440b-4152-8375-aca329c2b646\") " pod="openshift-insights/insights-runtime-extractor-w7x54" Jul 29 22:47:29.153417 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:29.152951 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b5a74cf5-440b-4152-8375-aca329c2b646-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7x54\" (UID: \"b5a74cf5-440b-4152-8375-aca329c2b646\") " pod="openshift-insights/insights-runtime-extractor-w7x54" Jul 29 22:47:29.153417 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:29.153006 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 22:47:29.153417 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:29.153075 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5a74cf5-440b-4152-8375-aca329c2b646-insights-runtime-extractor-tls podName:b5a74cf5-440b-4152-8375-aca329c2b646 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:45.153059021 +0000 UTC m=+75.109154852 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b5a74cf5-440b-4152-8375-aca329c2b646-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w7x54" (UID: "b5a74cf5-440b-4152-8375-aca329c2b646") : secret "insights-runtime-extractor-tls" not found Jul 29 22:47:29.153540 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:29.153522 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b5a74cf5-440b-4152-8375-aca329c2b646-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7x54\" (UID: \"b5a74cf5-440b-4152-8375-aca329c2b646\") " pod="openshift-insights/insights-runtime-extractor-w7x54" Jul 29 22:47:30.753575 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:30.753544 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-65k6t" Jul 29 22:47:36.205511 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:36.205470 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19b4fc0c-1b07-4c57-88df-5d40a7a07cfa-original-pull-secret\") pod \"global-pull-secret-syncer-xlxhw\" (UID: \"19b4fc0c-1b07-4c57-88df-5d40a7a07cfa\") " pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:47:36.205994 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:36.205570 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f61a04d-54f8-42b5-978f-0298dd8ac438-metrics-certs\") pod \"network-metrics-daemon-wfdzg\" (UID: \"6f61a04d-54f8-42b5-978f-0298dd8ac438\") " pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:47:36.208886 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:36.208859 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 22:47:36.208886 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:36.208871 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 22:47:36.218774 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:36.218750 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f61a04d-54f8-42b5-978f-0298dd8ac438-metrics-certs\") pod \"network-metrics-daemon-wfdzg\" (UID: \"6f61a04d-54f8-42b5-978f-0298dd8ac438\") " pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:47:36.218888 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:36.218819 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19b4fc0c-1b07-4c57-88df-5d40a7a07cfa-original-pull-secret\") pod \"global-pull-secret-syncer-xlxhw\" (UID: \"19b4fc0c-1b07-4c57-88df-5d40a7a07cfa\") " pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:47:36.316252 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:36.316219 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hgxlh\"" Jul 29 22:47:36.321735 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:36.321709 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xlxhw" Jul 29 22:47:36.323854 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:36.323834 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfdzg" Jul 29 22:47:36.407493 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:36.407453 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6x8f\" (UniqueName: \"kubernetes.io/projected/29dab441-c8b5-45e4-b586-5c52a843833d-kube-api-access-p6x8f\") pod \"network-check-target-xs48r\" (UID: \"29dab441-c8b5-45e4-b586-5c52a843833d\") " pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:47:36.410989 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:36.410896 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 22:47:36.421008 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:36.420981 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 22:47:36.434143 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:36.434108 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6x8f\" (UniqueName: \"kubernetes.io/projected/29dab441-c8b5-45e4-b586-5c52a843833d-kube-api-access-p6x8f\") pod \"network-check-target-xs48r\" (UID: \"29dab441-c8b5-45e4-b586-5c52a843833d\") " pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:47:36.480461 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:36.480387 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xlxhw"] Jul 29 22:47:36.482896 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:47:36.482870 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19b4fc0c_1b07_4c57_88df_5d40a7a07cfa.slice/crio-15cb5d419c198c477ec5e45d6f7940e2a337a8f052026f6ebb4e7f573bee6893 WatchSource:0}: Error finding container 15cb5d419c198c477ec5e45d6f7940e2a337a8f052026f6ebb4e7f573bee6893: Status 404 returned error can't find the container with id 15cb5d419c198c477ec5e45d6f7940e2a337a8f052026f6ebb4e7f573bee6893 Jul 29 22:47:36.486519 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:36.486494 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wfdzg"] Jul 29 22:47:36.489978 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:47:36.489940 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f61a04d_54f8_42b5_978f_0298dd8ac438.slice/crio-726cf0e3fa886392d05927ef8ed0167267b6b16037ed21ad316c68f513c31487 WatchSource:0}: Error finding container 726cf0e3fa886392d05927ef8ed0167267b6b16037ed21ad316c68f513c31487: Status 404 returned error can't find the container with id 726cf0e3fa886392d05927ef8ed0167267b6b16037ed21ad316c68f513c31487 Jul 29 22:47:36.629255 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:36.629228 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s6c2g\"" Jul 29 22:47:36.637370 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:36.637346 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:47:36.757149 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:36.757111 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xs48r"] Jul 29 22:47:36.760111 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:47:36.760086 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29dab441_c8b5_45e4_b586_5c52a843833d.slice/crio-09fb6fe9f126cdc5838132e9ac2ebd573bf7ffbcd01323ce0350aa22fb50bace WatchSource:0}: Error finding container 09fb6fe9f126cdc5838132e9ac2ebd573bf7ffbcd01323ce0350aa22fb50bace: Status 404 returned error can't find the container with id 09fb6fe9f126cdc5838132e9ac2ebd573bf7ffbcd01323ce0350aa22fb50bace Jul 29 22:47:36.850457 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:36.850422 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wfdzg" event={"ID":"6f61a04d-54f8-42b5-978f-0298dd8ac438","Type":"ContainerStarted","Data":"726cf0e3fa886392d05927ef8ed0167267b6b16037ed21ad316c68f513c31487"} Jul 29 22:47:36.851485 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:36.851462 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xlxhw" event={"ID":"19b4fc0c-1b07-4c57-88df-5d40a7a07cfa","Type":"ContainerStarted","Data":"15cb5d419c198c477ec5e45d6f7940e2a337a8f052026f6ebb4e7f573bee6893"} Jul 29 22:47:36.852489 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:36.852465 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xs48r" event={"ID":"29dab441-c8b5-45e4-b586-5c52a843833d","Type":"ContainerStarted","Data":"09fb6fe9f126cdc5838132e9ac2ebd573bf7ffbcd01323ce0350aa22fb50bace"} Jul 29 22:47:37.818147 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:37.818053 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f29f636-a8bd-4503-90bb-98290dccbb49-metrics-tls\") pod \"dns-default-qzms6\" (UID: \"5f29f636-a8bd-4503-90bb-98290dccbb49\") " pod="openshift-dns/dns-default-qzms6" Jul 29 22:47:37.820936 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:37.820903 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f29f636-a8bd-4503-90bb-98290dccbb49-metrics-tls\") pod \"dns-default-qzms6\" (UID: \"5f29f636-a8bd-4503-90bb-98290dccbb49\") " pod="openshift-dns/dns-default-qzms6" Jul 29 22:47:37.859352 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:37.859314 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wfdzg" event={"ID":"6f61a04d-54f8-42b5-978f-0298dd8ac438","Type":"ContainerStarted","Data":"9365e63cf7bcb43d207c3a9ae14f40fa97f76336757fac1583c0f28003fa25d6"} Jul 29 22:47:37.859544 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:37.859421 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wfdzg" event={"ID":"6f61a04d-54f8-42b5-978f-0298dd8ac438","Type":"ContainerStarted","Data":"9b52f6382b923da0891110de6ae1de88da0ca6bdbd4c7915a6eb211f83ee967b"} Jul 29 22:47:37.880264 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:37.880147 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wfdzg" podStartSLOduration=66.867237122 podStartE2EDuration="1m7.880126385s" totalImagesPullingTime="1.012889263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:37.878879044 +0000 UTC m=+67.834974900" watchObservedRunningTime="2026-07-29 22:47:37.880126385 +0000 UTC m=+67.836222241" Jul 29 22:47:38.095230 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:38.095146 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tpckt\"" Jul 29 22:47:38.102612 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:38.102581 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qzms6" Jul 29 22:47:38.277667 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:38.277599 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qzms6"] Jul 29 22:47:38.282581 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:47:38.282535 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f29f636_a8bd_4503_90bb_98290dccbb49.slice/crio-83e64f26cc1c6cd2306fdb733a9e363fcc0377b7516dc51b7a6505c6c66e07e3 WatchSource:0}: Error finding container 83e64f26cc1c6cd2306fdb733a9e363fcc0377b7516dc51b7a6505c6c66e07e3: Status 404 returned error can't find the container with id 83e64f26cc1c6cd2306fdb733a9e363fcc0377b7516dc51b7a6505c6c66e07e3 Jul 29 22:47:38.865668 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:38.865615 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qzms6" event={"ID":"5f29f636-a8bd-4503-90bb-98290dccbb49","Type":"ContainerStarted","Data":"83e64f26cc1c6cd2306fdb733a9e363fcc0377b7516dc51b7a6505c6c66e07e3"} Jul 29 22:47:40.580613 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.580571 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-2q5xk"] Jul 29 22:47:40.600618 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.600586 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6dd57b497-dnbld"] Jul 29 22:47:40.601800 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.601779 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-2q5xk" Jul 29 22:47:40.606131 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.606085 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 29 22:47:40.606464 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.606424 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-nsfb8\"" Jul 29 22:47:40.608844 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.608825 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 29 22:47:40.616243 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.616218 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-2q5xk"] Jul 29 22:47:40.616337 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.616251 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dd57b497-dnbld" Jul 29 22:47:40.616337 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.616276 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dd57b497-dnbld"] Jul 29 22:47:40.622173 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.622147 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 29 22:47:40.622397 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.622371 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fv65f\"" Jul 29 22:47:40.622550 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.622530 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 29 22:47:40.622888 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.622827 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 29 22:47:40.622982 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.622890 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 29 22:47:40.623427 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.623361 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 29 22:47:40.740089 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.740008 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7247d701-618f-44d3-8ca1-addb0d93d30e-console-config\") pod \"console-6dd57b497-dnbld\" (UID: \"7247d701-618f-44d3-8ca1-addb0d93d30e\") " pod="openshift-console/console-6dd57b497-dnbld" Jul 29 22:47:40.740089 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.740068 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7247d701-618f-44d3-8ca1-addb0d93d30e-service-ca\") pod \"console-6dd57b497-dnbld\" (UID: \"7247d701-618f-44d3-8ca1-addb0d93d30e\") " pod="openshift-console/console-6dd57b497-dnbld" Jul 29 22:47:40.740333 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.740100 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b5cv\" (UniqueName: \"kubernetes.io/projected/7247d701-618f-44d3-8ca1-addb0d93d30e-kube-api-access-9b5cv\") pod \"console-6dd57b497-dnbld\" (UID: \"7247d701-618f-44d3-8ca1-addb0d93d30e\") " pod="openshift-console/console-6dd57b497-dnbld" Jul 29 22:47:40.740333 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.740136 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7247d701-618f-44d3-8ca1-addb0d93d30e-oauth-serving-cert\") pod \"console-6dd57b497-dnbld\" (UID: \"7247d701-618f-44d3-8ca1-addb0d93d30e\") " pod="openshift-console/console-6dd57b497-dnbld" Jul 29 22:47:40.740333 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.740162 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7247d701-618f-44d3-8ca1-addb0d93d30e-console-serving-cert\") pod \"console-6dd57b497-dnbld\" (UID: \"7247d701-618f-44d3-8ca1-addb0d93d30e\") " pod="openshift-console/console-6dd57b497-dnbld" Jul 29 22:47:40.740333 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.740241 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7247d701-618f-44d3-8ca1-addb0d93d30e-console-oauth-config\") pod \"console-6dd57b497-dnbld\" (UID: \"7247d701-618f-44d3-8ca1-addb0d93d30e\") " pod="openshift-console/console-6dd57b497-dnbld" Jul 29 22:47:40.740333 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.740272 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgngv\" (UniqueName: \"kubernetes.io/projected/7a24d6ed-ed41-4133-953c-ca387e4593ec-kube-api-access-dgngv\") pod \"downloads-7c97dc4555-2q5xk\" (UID: \"7a24d6ed-ed41-4133-953c-ca387e4593ec\") " pod="openshift-console/downloads-7c97dc4555-2q5xk" Jul 29 22:47:40.841133 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.841050 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgngv\" (UniqueName: \"kubernetes.io/projected/7a24d6ed-ed41-4133-953c-ca387e4593ec-kube-api-access-dgngv\") pod \"downloads-7c97dc4555-2q5xk\" (UID: \"7a24d6ed-ed41-4133-953c-ca387e4593ec\") " pod="openshift-console/downloads-7c97dc4555-2q5xk" Jul 29 22:47:40.841133 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.841104 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7247d701-618f-44d3-8ca1-addb0d93d30e-console-config\") pod \"console-6dd57b497-dnbld\" (UID: \"7247d701-618f-44d3-8ca1-addb0d93d30e\") " pod="openshift-console/console-6dd57b497-dnbld" Jul 29 22:47:40.841133 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.841129 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7247d701-618f-44d3-8ca1-addb0d93d30e-service-ca\") pod \"console-6dd57b497-dnbld\" (UID: \"7247d701-618f-44d3-8ca1-addb0d93d30e\") " pod="openshift-console/console-6dd57b497-dnbld" Jul 29 22:47:40.841415 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.841160 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b5cv\" (UniqueName: \"kubernetes.io/projected/7247d701-618f-44d3-8ca1-addb0d93d30e-kube-api-access-9b5cv\") pod \"console-6dd57b497-dnbld\" (UID: \"7247d701-618f-44d3-8ca1-addb0d93d30e\") " pod="openshift-console/console-6dd57b497-dnbld" Jul 29 22:47:40.841415 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.841195 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7247d701-618f-44d3-8ca1-addb0d93d30e-oauth-serving-cert\") pod \"console-6dd57b497-dnbld\" (UID: \"7247d701-618f-44d3-8ca1-addb0d93d30e\") " pod="openshift-console/console-6dd57b497-dnbld" Jul 29 22:47:40.841415 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.841220 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7247d701-618f-44d3-8ca1-addb0d93d30e-console-serving-cert\") pod \"console-6dd57b497-dnbld\" (UID: \"7247d701-618f-44d3-8ca1-addb0d93d30e\") " pod="openshift-console/console-6dd57b497-dnbld" Jul 29 22:47:40.841415 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.841272 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7247d701-618f-44d3-8ca1-addb0d93d30e-console-oauth-config\") pod \"console-6dd57b497-dnbld\" (UID: \"7247d701-618f-44d3-8ca1-addb0d93d30e\") " pod="openshift-console/console-6dd57b497-dnbld" Jul 29 22:47:40.842166 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.842108 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7247d701-618f-44d3-8ca1-addb0d93d30e-oauth-serving-cert\") pod \"console-6dd57b497-dnbld\" (UID: \"7247d701-618f-44d3-8ca1-addb0d93d30e\") " pod="openshift-console/console-6dd57b497-dnbld" Jul 29 22:47:40.842166 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.842115 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7247d701-618f-44d3-8ca1-addb0d93d30e-service-ca\") pod \"console-6dd57b497-dnbld\" (UID: \"7247d701-618f-44d3-8ca1-addb0d93d30e\") " pod="openshift-console/console-6dd57b497-dnbld" Jul 29 22:47:40.842656 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.842599 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7247d701-618f-44d3-8ca1-addb0d93d30e-console-config\") pod \"console-6dd57b497-dnbld\" (UID: \"7247d701-618f-44d3-8ca1-addb0d93d30e\") " pod="openshift-console/console-6dd57b497-dnbld" Jul 29 22:47:40.843984 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.843964 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7247d701-618f-44d3-8ca1-addb0d93d30e-console-oauth-config\") pod \"console-6dd57b497-dnbld\" (UID: \"7247d701-618f-44d3-8ca1-addb0d93d30e\") " pod="openshift-console/console-6dd57b497-dnbld" Jul 29 22:47:40.843984 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.843976 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7247d701-618f-44d3-8ca1-addb0d93d30e-console-serving-cert\") pod \"console-6dd57b497-dnbld\" (UID: \"7247d701-618f-44d3-8ca1-addb0d93d30e\") " pod="openshift-console/console-6dd57b497-dnbld" Jul 29 22:47:40.876109 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.876068 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgngv\" (UniqueName: \"kubernetes.io/projected/7a24d6ed-ed41-4133-953c-ca387e4593ec-kube-api-access-dgngv\") pod \"downloads-7c97dc4555-2q5xk\" (UID: \"7a24d6ed-ed41-4133-953c-ca387e4593ec\") " pod="openshift-console/downloads-7c97dc4555-2q5xk" Jul 29 22:47:40.877557 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.877530 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b5cv\" (UniqueName: \"kubernetes.io/projected/7247d701-618f-44d3-8ca1-addb0d93d30e-kube-api-access-9b5cv\") pod \"console-6dd57b497-dnbld\" (UID: \"7247d701-618f-44d3-8ca1-addb0d93d30e\") " pod="openshift-console/console-6dd57b497-dnbld" Jul 29 22:47:40.914349 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.914311 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-2q5xk" Jul 29 22:47:40.926327 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:40.926299 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dd57b497-dnbld" Jul 29 22:47:41.963503 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:41.962768 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dd57b497-dnbld"] Jul 29 22:47:41.969715 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:47:41.969667 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7247d701_618f_44d3_8ca1_addb0d93d30e.slice/crio-6870c315a445b5600b7ccb26ed505f81751e534c3ff085431b0f2bfa1d9fe977 WatchSource:0}: Error finding container 6870c315a445b5600b7ccb26ed505f81751e534c3ff085431b0f2bfa1d9fe977: Status 404 returned error can't find the container with id 6870c315a445b5600b7ccb26ed505f81751e534c3ff085431b0f2bfa1d9fe977 Jul 29 22:47:41.985957 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:41.985890 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-2q5xk"] Jul 29 22:47:41.989695 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:47:41.989655 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a24d6ed_ed41_4133_953c_ca387e4593ec.slice/crio-450b81f66f3b1f5f39928c676f803ce53ebe0b03e2c8e1e94b6338f567244c82 WatchSource:0}: Error finding container 450b81f66f3b1f5f39928c676f803ce53ebe0b03e2c8e1e94b6338f567244c82: Status 404 returned error can't find the container with id 450b81f66f3b1f5f39928c676f803ce53ebe0b03e2c8e1e94b6338f567244c82 Jul 29 22:47:42.886470 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:42.886432 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dd57b497-dnbld" event={"ID":"7247d701-618f-44d3-8ca1-addb0d93d30e","Type":"ContainerStarted","Data":"6870c315a445b5600b7ccb26ed505f81751e534c3ff085431b0f2bfa1d9fe977"} Jul 29 22:47:42.891194 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:42.891163 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qzms6" event={"ID":"5f29f636-a8bd-4503-90bb-98290dccbb49","Type":"ContainerStarted","Data":"8e523ed4de1a6c5e64aa70add597124d17ace9c60bb1202763255918dbe3532e"} Jul 29 22:47:42.891342 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:42.891220 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qzms6" event={"ID":"5f29f636-a8bd-4503-90bb-98290dccbb49","Type":"ContainerStarted","Data":"d365b10f09991e6bc3c681052052644c715cd32cd97c609b35477f6fd9e21de6"} Jul 29 22:47:42.891579 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:42.891560 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qzms6" Jul 29 22:47:42.893612 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:42.893587 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xs48r" event={"ID":"29dab441-c8b5-45e4-b586-5c52a843833d","Type":"ContainerStarted","Data":"ca707e85f9869e0009dca29f5d4cbf812fbaf390d347ff4440cf8b980a4a20fe"} Jul 29 22:47:42.894082 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:42.894061 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:47:42.897438 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:42.897371 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-2q5xk" event={"ID":"7a24d6ed-ed41-4133-953c-ca387e4593ec","Type":"ContainerStarted","Data":"450b81f66f3b1f5f39928c676f803ce53ebe0b03e2c8e1e94b6338f567244c82"} Jul 29 22:47:42.902156 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:42.902101 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xlxhw" event={"ID":"19b4fc0c-1b07-4c57-88df-5d40a7a07cfa","Type":"ContainerStarted","Data":"2413633e794420c4a0769356f2d7ceed1fb53cc2a7f57d1671914400a0e1fec7"} Jul 29 22:47:42.914595 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:42.914540 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qzms6" podStartSLOduration=34.389381906 podStartE2EDuration="37.914519728s" totalImagesPullingTime="3.525137822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:42.912568913 +0000 UTC m=+72.868664766" watchObservedRunningTime="2026-07-29 22:47:42.914519728 +0000 UTC m=+72.870615560" Jul 29 22:47:42.930933 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:42.930872 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xlxhw" podStartSLOduration=67.602219254 podStartE2EDuration="1m12.930851652s" totalImagesPullingTime="5.328632398s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:42.930564698 +0000 UTC m=+72.886660552" watchObservedRunningTime="2026-07-29 22:47:42.930851652 +0000 UTC m=+72.886947507" Jul 29 22:47:42.946872 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:42.946812 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xs48r" podStartSLOduration=67.900759218 podStartE2EDuration="1m12.946791527s" totalImagesPullingTime="5.046032309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:42.94633903 +0000 UTC m=+72.902434885" watchObservedRunningTime="2026-07-29 22:47:42.946791527 +0000 UTC m=+72.902887386" Jul 29 22:47:45.180069 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:45.180020 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b5a74cf5-440b-4152-8375-aca329c2b646-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7x54\" (UID: \"b5a74cf5-440b-4152-8375-aca329c2b646\") " pod="openshift-insights/insights-runtime-extractor-w7x54" Jul 29 22:47:45.182807 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:45.182778 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b5a74cf5-440b-4152-8375-aca329c2b646-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7x54\" (UID: \"b5a74cf5-440b-4152-8375-aca329c2b646\") " pod="openshift-insights/insights-runtime-extractor-w7x54" Jul 29 22:47:45.445352 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:45.445156 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m9mf7\"" Jul 29 22:47:45.452709 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:45.452679 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w7x54" Jul 29 22:47:45.603766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:45.603732 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w7x54"] Jul 29 22:47:45.606582 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:47:45.606545 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5a74cf5_440b_4152_8375_aca329c2b646.slice/crio-e7b2b037d1aa0e33bb841d9dcc0f749e2fbbb28648fb79ff38977048523a3f0d WatchSource:0}: Error finding container e7b2b037d1aa0e33bb841d9dcc0f749e2fbbb28648fb79ff38977048523a3f0d: Status 404 returned error can't find the container with id e7b2b037d1aa0e33bb841d9dcc0f749e2fbbb28648fb79ff38977048523a3f0d Jul 29 22:47:45.916101 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:45.916070 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dd57b497-dnbld" event={"ID":"7247d701-618f-44d3-8ca1-addb0d93d30e","Type":"ContainerStarted","Data":"a1f0dd0b3364e73cf22577c1949a6613a3b631f666f7777cfcdca60d9870eac9"} Jul 29 22:47:45.917412 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:45.917378 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w7x54" event={"ID":"b5a74cf5-440b-4152-8375-aca329c2b646","Type":"ContainerStarted","Data":"e7b2b037d1aa0e33bb841d9dcc0f749e2fbbb28648fb79ff38977048523a3f0d"} Jul 29 22:47:45.936030 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:45.935975 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6dd57b497-dnbld" podStartSLOduration=2.584084722 podStartE2EDuration="5.93595832s" totalImagesPullingTime="3.351873598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:45.935210145 +0000 UTC m=+75.891306001" watchObservedRunningTime="2026-07-29 22:47:45.93595832 +0000 UTC m=+75.892054171" Jul 29 22:47:46.540484 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.540444 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-7kr7n"] Jul 29 22:47:46.545230 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.544515 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7kr7n" Jul 29 22:47:46.549570 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.549307 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 29 22:47:46.549570 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.549363 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 29 22:47:46.549570 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.549308 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 29 22:47:46.551177 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.550554 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 29 22:47:46.551177 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.550841 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-v5zrg\"" Jul 29 22:47:46.551177 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.551038 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 29 22:47:46.554616 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.554429 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-7kr7n"] Jul 29 22:47:46.602247 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.602218 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hl5xk"] Jul 29 22:47:46.607421 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.606416 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hl5xk" Jul 29 22:47:46.611684 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.610667 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sjfmc\"" Jul 29 22:47:46.611684 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.610925 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 29 22:47:46.611684 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.611151 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 29 22:47:46.611684 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.611307 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 29 22:47:46.699419 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.698906 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92d5f7be-457e-4787-bc9e-3d4859ce7f03-metrics-client-ca\") pod \"node-exporter-hl5xk\" (UID: \"92d5f7be-457e-4787-bc9e-3d4859ce7f03\") " pod="openshift-monitoring/node-exporter-hl5xk" Jul 29 22:47:46.699419 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.698948 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf2vr\" (UniqueName: \"kubernetes.io/projected/92d5f7be-457e-4787-bc9e-3d4859ce7f03-kube-api-access-mf2vr\") pod \"node-exporter-hl5xk\" (UID: \"92d5f7be-457e-4787-bc9e-3d4859ce7f03\") " pod="openshift-monitoring/node-exporter-hl5xk" Jul 29 22:47:46.699419 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.698968 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/276b66d3-320e-482e-9e01-abec897af39b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-7kr7n\" (UID: \"276b66d3-320e-482e-9e01-abec897af39b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7kr7n" Jul 29 22:47:46.699419 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.698988 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrqj5\" (UniqueName: \"kubernetes.io/projected/276b66d3-320e-482e-9e01-abec897af39b-kube-api-access-mrqj5\") pod \"openshift-state-metrics-b8f49f5c6-7kr7n\" (UID: \"276b66d3-320e-482e-9e01-abec897af39b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7kr7n" Jul 29 22:47:46.699419 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.699008 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/92d5f7be-457e-4787-bc9e-3d4859ce7f03-node-exporter-wtmp\") pod \"node-exporter-hl5xk\" (UID: \"92d5f7be-457e-4787-bc9e-3d4859ce7f03\") " pod="openshift-monitoring/node-exporter-hl5xk" Jul 29 22:47:46.699419 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.699032 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/276b66d3-320e-482e-9e01-abec897af39b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-7kr7n\" (UID: \"276b66d3-320e-482e-9e01-abec897af39b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7kr7n" Jul 29 22:47:46.699419 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.699063 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/276b66d3-320e-482e-9e01-abec897af39b-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-7kr7n\" (UID: \"276b66d3-320e-482e-9e01-abec897af39b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7kr7n" Jul 29 22:47:46.699419 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.699092 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/92d5f7be-457e-4787-bc9e-3d4859ce7f03-node-exporter-textfile\") pod \"node-exporter-hl5xk\" (UID: \"92d5f7be-457e-4787-bc9e-3d4859ce7f03\") " pod="openshift-monitoring/node-exporter-hl5xk" Jul 29 22:47:46.699419 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.699115 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/92d5f7be-457e-4787-bc9e-3d4859ce7f03-node-exporter-tls\") pod \"node-exporter-hl5xk\" (UID: \"92d5f7be-457e-4787-bc9e-3d4859ce7f03\") " pod="openshift-monitoring/node-exporter-hl5xk" Jul 29 22:47:46.699419 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.699158 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/92d5f7be-457e-4787-bc9e-3d4859ce7f03-node-exporter-accelerators-collector-config\") pod \"node-exporter-hl5xk\" (UID: \"92d5f7be-457e-4787-bc9e-3d4859ce7f03\") " pod="openshift-monitoring/node-exporter-hl5xk" Jul 29 22:47:46.699419 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.699204 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/92d5f7be-457e-4787-bc9e-3d4859ce7f03-root\") pod \"node-exporter-hl5xk\" (UID: \"92d5f7be-457e-4787-bc9e-3d4859ce7f03\") " pod="openshift-monitoring/node-exporter-hl5xk" Jul 29 22:47:46.699419 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.699232 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92d5f7be-457e-4787-bc9e-3d4859ce7f03-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hl5xk\" (UID: \"92d5f7be-457e-4787-bc9e-3d4859ce7f03\") " pod="openshift-monitoring/node-exporter-hl5xk" Jul 29 22:47:46.699419 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.699270 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92d5f7be-457e-4787-bc9e-3d4859ce7f03-sys\") pod \"node-exporter-hl5xk\" (UID: \"92d5f7be-457e-4787-bc9e-3d4859ce7f03\") " pod="openshift-monitoring/node-exporter-hl5xk" Jul 29 22:47:46.800349 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.799863 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/92d5f7be-457e-4787-bc9e-3d4859ce7f03-root\") pod \"node-exporter-hl5xk\" (UID: \"92d5f7be-457e-4787-bc9e-3d4859ce7f03\") " pod="openshift-monitoring/node-exporter-hl5xk" Jul 29 22:47:46.800349 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.799915 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92d5f7be-457e-4787-bc9e-3d4859ce7f03-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hl5xk\" (UID: \"92d5f7be-457e-4787-bc9e-3d4859ce7f03\") " pod="openshift-monitoring/node-exporter-hl5xk" Jul 29 22:47:46.800349 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.799955 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92d5f7be-457e-4787-bc9e-3d4859ce7f03-sys\") pod \"node-exporter-hl5xk\" (UID: \"92d5f7be-457e-4787-bc9e-3d4859ce7f03\") " pod="openshift-monitoring/node-exporter-hl5xk" Jul 29 22:47:46.800349 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.799986 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92d5f7be-457e-4787-bc9e-3d4859ce7f03-metrics-client-ca\") pod \"node-exporter-hl5xk\" (UID: \"92d5f7be-457e-4787-bc9e-3d4859ce7f03\") " pod="openshift-monitoring/node-exporter-hl5xk" Jul 29 22:47:46.800349 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.800011 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf2vr\" (UniqueName: \"kubernetes.io/projected/92d5f7be-457e-4787-bc9e-3d4859ce7f03-kube-api-access-mf2vr\") pod \"node-exporter-hl5xk\" (UID: \"92d5f7be-457e-4787-bc9e-3d4859ce7f03\") " pod="openshift-monitoring/node-exporter-hl5xk" Jul 29 22:47:46.800349 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.800036 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/276b66d3-320e-482e-9e01-abec897af39b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-7kr7n\" (UID: \"276b66d3-320e-482e-9e01-abec897af39b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7kr7n" Jul 29 22:47:46.800349 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.800064 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrqj5\" (UniqueName: \"kubernetes.io/projected/276b66d3-320e-482e-9e01-abec897af39b-kube-api-access-mrqj5\") pod \"openshift-state-metrics-b8f49f5c6-7kr7n\" (UID: \"276b66d3-320e-482e-9e01-abec897af39b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7kr7n" Jul 29 22:47:46.800349 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.800090 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/92d5f7be-457e-4787-bc9e-3d4859ce7f03-node-exporter-wtmp\") pod \"node-exporter-hl5xk\" (UID: \"92d5f7be-457e-4787-bc9e-3d4859ce7f03\") " pod="openshift-monitoring/node-exporter-hl5xk" Jul 29 22:47:46.800349 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.800116 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/276b66d3-320e-482e-9e01-abec897af39b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-7kr7n\" (UID: \"276b66d3-320e-482e-9e01-abec897af39b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7kr7n" Jul 29 22:47:46.800349 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.800148 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/276b66d3-320e-482e-9e01-abec897af39b-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-7kr7n\" (UID: \"276b66d3-320e-482e-9e01-abec897af39b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7kr7n" Jul 29 22:47:46.800349 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.800175 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/92d5f7be-457e-4787-bc9e-3d4859ce7f03-node-exporter-textfile\") pod \"node-exporter-hl5xk\" (UID: \"92d5f7be-457e-4787-bc9e-3d4859ce7f03\") " pod="openshift-monitoring/node-exporter-hl5xk" Jul 29 22:47:46.800349 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.800197 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/92d5f7be-457e-4787-bc9e-3d4859ce7f03-node-exporter-tls\") pod \"node-exporter-hl5xk\" (UID: \"92d5f7be-457e-4787-bc9e-3d4859ce7f03\") " pod="openshift-monitoring/node-exporter-hl5xk" Jul 29 22:47:46.800349 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.800238 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/92d5f7be-457e-4787-bc9e-3d4859ce7f03-node-exporter-accelerators-collector-config\") pod \"node-exporter-hl5xk\" (UID: \"92d5f7be-457e-4787-bc9e-3d4859ce7f03\") " pod="openshift-monitoring/node-exporter-hl5xk" Jul 29 22:47:46.801125 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.800899 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/92d5f7be-457e-4787-bc9e-3d4859ce7f03-node-exporter-accelerators-collector-config\") pod \"node-exporter-hl5xk\" (UID: \"92d5f7be-457e-4787-bc9e-3d4859ce7f03\") " pod="openshift-monitoring/node-exporter-hl5xk" Jul 29 22:47:46.801125 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.800979 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/92d5f7be-457e-4787-bc9e-3d4859ce7f03-root\") pod \"node-exporter-hl5xk\" (UID: \"92d5f7be-457e-4787-bc9e-3d4859ce7f03\") " pod="openshift-monitoring/node-exporter-hl5xk" Jul 29 22:47:46.803007 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.802020 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92d5f7be-457e-4787-bc9e-3d4859ce7f03-sys\") pod \"node-exporter-hl5xk\" (UID: \"92d5f7be-457e-4787-bc9e-3d4859ce7f03\") " pod="openshift-monitoring/node-exporter-hl5xk" Jul 29 22:47:46.803007 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.802499 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92d5f7be-457e-4787-bc9e-3d4859ce7f03-metrics-client-ca\") pod \"node-exporter-hl5xk\" (UID: \"92d5f7be-457e-4787-bc9e-3d4859ce7f03\") " pod="openshift-monitoring/node-exporter-hl5xk" Jul 29 22:47:46.803007 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:46.802757 2570 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 29 22:47:46.803007 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:46.802830 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/276b66d3-320e-482e-9e01-abec897af39b-openshift-state-metrics-tls podName:276b66d3-320e-482e-9e01-abec897af39b nodeName:}" failed. No retries permitted until 2026-07-29 22:47:47.302809122 +0000 UTC m=+77.258904969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/276b66d3-320e-482e-9e01-abec897af39b-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-7kr7n" (UID: "276b66d3-320e-482e-9e01-abec897af39b") : secret "openshift-state-metrics-tls" not found Jul 29 22:47:46.804070 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.803509 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/92d5f7be-457e-4787-bc9e-3d4859ce7f03-node-exporter-textfile\") pod \"node-exporter-hl5xk\" (UID: \"92d5f7be-457e-4787-bc9e-3d4859ce7f03\") " pod="openshift-monitoring/node-exporter-hl5xk" Jul 29 22:47:46.804070 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.803656 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/92d5f7be-457e-4787-bc9e-3d4859ce7f03-node-exporter-wtmp\") pod \"node-exporter-hl5xk\" (UID: \"92d5f7be-457e-4787-bc9e-3d4859ce7f03\") " pod="openshift-monitoring/node-exporter-hl5xk" Jul 29 22:47:46.804070 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.803867 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/276b66d3-320e-482e-9e01-abec897af39b-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-7kr7n\" (UID: \"276b66d3-320e-482e-9e01-abec897af39b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7kr7n" Jul 29 22:47:46.804070 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:46.803943 2570 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 29 22:47:46.804070 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:47:46.803989 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92d5f7be-457e-4787-bc9e-3d4859ce7f03-node-exporter-tls podName:92d5f7be-457e-4787-bc9e-3d4859ce7f03 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:47.303973593 +0000 UTC m=+77.260069432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/92d5f7be-457e-4787-bc9e-3d4859ce7f03-node-exporter-tls") pod "node-exporter-hl5xk" (UID: "92d5f7be-457e-4787-bc9e-3d4859ce7f03") : secret "node-exporter-tls" not found Jul 29 22:47:46.808082 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.808036 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/276b66d3-320e-482e-9e01-abec897af39b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-7kr7n\" (UID: \"276b66d3-320e-482e-9e01-abec897af39b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7kr7n" Jul 29 22:47:46.822643 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.820127 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrqj5\" (UniqueName: \"kubernetes.io/projected/276b66d3-320e-482e-9e01-abec897af39b-kube-api-access-mrqj5\") pod \"openshift-state-metrics-b8f49f5c6-7kr7n\" (UID: \"276b66d3-320e-482e-9e01-abec897af39b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7kr7n" Jul 29 22:47:46.828039 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.828011 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92d5f7be-457e-4787-bc9e-3d4859ce7f03-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hl5xk\" (UID: \"92d5f7be-457e-4787-bc9e-3d4859ce7f03\") " pod="openshift-monitoring/node-exporter-hl5xk" Jul 29 22:47:46.833188 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:46.833055 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf2vr\" (UniqueName: \"kubernetes.io/projected/92d5f7be-457e-4787-bc9e-3d4859ce7f03-kube-api-access-mf2vr\") pod \"node-exporter-hl5xk\" (UID: \"92d5f7be-457e-4787-bc9e-3d4859ce7f03\") " pod="openshift-monitoring/node-exporter-hl5xk" Jul 29 22:47:47.305293 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.305247 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/276b66d3-320e-482e-9e01-abec897af39b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-7kr7n\" (UID: \"276b66d3-320e-482e-9e01-abec897af39b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7kr7n" Jul 29 22:47:47.305496 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.305314 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/92d5f7be-457e-4787-bc9e-3d4859ce7f03-node-exporter-tls\") pod \"node-exporter-hl5xk\" (UID: \"92d5f7be-457e-4787-bc9e-3d4859ce7f03\") " pod="openshift-monitoring/node-exporter-hl5xk" Jul 29 22:47:47.308250 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.308205 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/92d5f7be-457e-4787-bc9e-3d4859ce7f03-node-exporter-tls\") pod \"node-exporter-hl5xk\" (UID: \"92d5f7be-457e-4787-bc9e-3d4859ce7f03\") " pod="openshift-monitoring/node-exporter-hl5xk" Jul 29 22:47:47.309911 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.309864 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/276b66d3-320e-482e-9e01-abec897af39b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-7kr7n\" (UID: \"276b66d3-320e-482e-9e01-abec897af39b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7kr7n" Jul 29 22:47:47.459614 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.459578 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7kr7n" Jul 29 22:47:47.523816 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.523513 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hl5xk" Jul 29 22:47:47.548987 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:47:47.548932 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92d5f7be_457e_4787_bc9e_3d4859ce7f03.slice/crio-3c0a6ee503489264d1bbc3fc0f8aabddad262c02a4698f7ef5305ee0f70e69ec WatchSource:0}: Error finding container 3c0a6ee503489264d1bbc3fc0f8aabddad262c02a4698f7ef5305ee0f70e69ec: Status 404 returned error can't find the container with id 3c0a6ee503489264d1bbc3fc0f8aabddad262c02a4698f7ef5305ee0f70e69ec Jul 29 22:47:47.638400 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.638367 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-7kr7n"] Jul 29 22:47:47.641975 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.641903 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 22:47:47.643391 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:47:47.643362 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod276b66d3_320e_482e_9e01_abec897af39b.slice/crio-b494820a6bdae2333175c501a34e4860d5a898e88fc8adab4009ed9ce931c7b7 WatchSource:0}: Error finding container b494820a6bdae2333175c501a34e4860d5a898e88fc8adab4009ed9ce931c7b7: Status 404 returned error can't find the container with id b494820a6bdae2333175c501a34e4860d5a898e88fc8adab4009ed9ce931c7b7 Jul 29 22:47:47.647170 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.647151 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.650125 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.650102 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 29 22:47:47.650234 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.650102 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-lzsrw\"" Jul 29 22:47:47.650234 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.650211 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 29 22:47:47.650796 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.650732 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 29 22:47:47.650865 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.650808 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 29 22:47:47.651380 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.650987 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 29 22:47:47.651380 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.650991 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 29 22:47:47.651380 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.651114 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 29 22:47:47.651380 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.651218 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 29 22:47:47.651380 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.651243 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 29 22:47:47.669994 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.669891 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 22:47:47.810023 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.809997 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2e38b37c-5ceb-4476-ba92-68e04e3158a5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.810093 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.810068 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.810152 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.810102 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-config-volume\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.810152 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.810134 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e38b37c-5ceb-4476-ba92-68e04e3158a5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.810253 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.810158 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llzlt\" (UniqueName: \"kubernetes.io/projected/2e38b37c-5ceb-4476-ba92-68e04e3158a5-kube-api-access-llzlt\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.810253 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.810190 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.810253 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.810213 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2e38b37c-5ceb-4476-ba92-68e04e3158a5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.810253 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.810241 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2e38b37c-5ceb-4476-ba92-68e04e3158a5-config-out\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.810505 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.810265 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.810505 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.810296 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.810505 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.810331 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-web-config\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.810505 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.810370 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.810505 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.810398 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e38b37c-5ceb-4476-ba92-68e04e3158a5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.911478 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.911395 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.911478 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.911442 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e38b37c-5ceb-4476-ba92-68e04e3158a5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.911478 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.911476 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2e38b37c-5ceb-4476-ba92-68e04e3158a5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.911808 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.911512 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.911808 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.911541 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-config-volume\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.911808 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.911571 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e38b37c-5ceb-4476-ba92-68e04e3158a5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.911808 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.911593 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llzlt\" (UniqueName: \"kubernetes.io/projected/2e38b37c-5ceb-4476-ba92-68e04e3158a5-kube-api-access-llzlt\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.911808 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.911623 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.913626 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.912251 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2e38b37c-5ceb-4476-ba92-68e04e3158a5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.913626 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.912295 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2e38b37c-5ceb-4476-ba92-68e04e3158a5-config-out\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.913626 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.912322 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.913626 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.912356 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.913626 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.912389 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-web-config\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.913626 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.913284 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e38b37c-5ceb-4476-ba92-68e04e3158a5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.913626 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.913484 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e38b37c-5ceb-4476-ba92-68e04e3158a5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.914049 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.913743 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2e38b37c-5ceb-4476-ba92-68e04e3158a5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.914887 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.914845 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2e38b37c-5ceb-4476-ba92-68e04e3158a5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.918544 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.918520 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2e38b37c-5ceb-4476-ba92-68e04e3158a5-config-out\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.918825 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.918803 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.918899 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.918822 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-web-config\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.918899 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.918822 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.919298 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.919273 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.919769 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.919747 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-config-volume\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.919895 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.919879 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.921264 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.921216 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llzlt\" (UniqueName: \"kubernetes.io/projected/2e38b37c-5ceb-4476-ba92-68e04e3158a5-kube-api-access-llzlt\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.921360 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.921331 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:47.931062 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.931029 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hl5xk" event={"ID":"92d5f7be-457e-4787-bc9e-3d4859ce7f03","Type":"ContainerStarted","Data":"3c0a6ee503489264d1bbc3fc0f8aabddad262c02a4698f7ef5305ee0f70e69ec"} Jul 29 22:47:47.934672 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.934542 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7kr7n" event={"ID":"276b66d3-320e-482e-9e01-abec897af39b","Type":"ContainerStarted","Data":"6296dcf909dd3c461ba2e76e1190dc138aa593c977286ec1fdde08c11478257e"} Jul 29 22:47:47.934672 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.934610 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7kr7n" event={"ID":"276b66d3-320e-482e-9e01-abec897af39b","Type":"ContainerStarted","Data":"9cf03a55e9ac59431f394754cea8671ec2fe3c32d8d3c39fb589fd126fbeca8d"} Jul 29 22:47:47.934672 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.934655 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7kr7n" event={"ID":"276b66d3-320e-482e-9e01-abec897af39b","Type":"ContainerStarted","Data":"b494820a6bdae2333175c501a34e4860d5a898e88fc8adab4009ed9ce931c7b7"} Jul 29 22:47:47.960676 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:47.960374 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:48.149175 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:48.149050 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 22:47:48.150399 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:47:48.150360 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e38b37c_5ceb_4476_ba92_68e04e3158a5.slice/crio-1ca988165392c0e598e292b458b4626e3543253687c621814a692f3d3e72edd8 WatchSource:0}: Error finding container 1ca988165392c0e598e292b458b4626e3543253687c621814a692f3d3e72edd8: Status 404 returned error can't find the container with id 1ca988165392c0e598e292b458b4626e3543253687c621814a692f3d3e72edd8 Jul 29 22:47:48.941295 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:48.941220 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e38b37c-5ceb-4476-ba92-68e04e3158a5","Type":"ContainerStarted","Data":"1ca988165392c0e598e292b458b4626e3543253687c621814a692f3d3e72edd8"} Jul 29 22:47:49.577915 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.577874 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-758bc6d4b-pdkf4"] Jul 29 22:47:49.592815 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.592782 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" Jul 29 22:47:49.596310 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.595570 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-ld592\"" Jul 29 22:47:49.596310 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.595905 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 29 22:47:49.596310 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.596002 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 29 22:47:49.596310 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.596131 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 29 22:47:49.600061 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.597137 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2b7qo1gpl2mb1\"" Jul 29 22:47:49.600061 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.597356 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 29 22:47:49.600061 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.597708 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 29 22:47:49.600649 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.600574 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-758bc6d4b-pdkf4"] Jul 29 22:47:49.601767 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.601308 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54b68bc694-9hpvf"] Jul 29 22:47:49.605945 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.605925 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b68bc694-9hpvf" Jul 29 22:47:49.614327 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.614298 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 29 22:47:49.615688 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.615664 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54b68bc694-9hpvf"] Jul 29 22:47:49.727958 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.727929 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/930c892f-30bf-4c89-bd0f-08b8d28007fa-service-ca\") pod \"console-54b68bc694-9hpvf\" (UID: \"930c892f-30bf-4c89-bd0f-08b8d28007fa\") " pod="openshift-console/console-54b68bc694-9hpvf" Jul 29 22:47:49.728145 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.727974 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/930c892f-30bf-4c89-bd0f-08b8d28007fa-oauth-serving-cert\") pod \"console-54b68bc694-9hpvf\" (UID: \"930c892f-30bf-4c89-bd0f-08b8d28007fa\") " pod="openshift-console/console-54b68bc694-9hpvf" Jul 29 22:47:49.728145 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.728011 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bcea12a1-da75-478c-b78e-10e4e2659aa8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-758bc6d4b-pdkf4\" (UID: \"bcea12a1-da75-478c-b78e-10e4e2659aa8\") " pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" Jul 29 22:47:49.728145 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.728038 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bcea12a1-da75-478c-b78e-10e4e2659aa8-secret-grpc-tls\") pod \"thanos-querier-758bc6d4b-pdkf4\" (UID: \"bcea12a1-da75-478c-b78e-10e4e2659aa8\") " pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" Jul 29 22:47:49.728145 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.728059 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpzls\" (UniqueName: \"kubernetes.io/projected/bcea12a1-da75-478c-b78e-10e4e2659aa8-kube-api-access-qpzls\") pod \"thanos-querier-758bc6d4b-pdkf4\" (UID: \"bcea12a1-da75-478c-b78e-10e4e2659aa8\") " pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" Jul 29 22:47:49.728145 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.728091 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bcea12a1-da75-478c-b78e-10e4e2659aa8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-758bc6d4b-pdkf4\" (UID: \"bcea12a1-da75-478c-b78e-10e4e2659aa8\") " pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" Jul 29 22:47:49.728145 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.728112 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/930c892f-30bf-4c89-bd0f-08b8d28007fa-console-serving-cert\") pod \"console-54b68bc694-9hpvf\" (UID: \"930c892f-30bf-4c89-bd0f-08b8d28007fa\") " pod="openshift-console/console-54b68bc694-9hpvf" Jul 29 22:47:49.728145 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.728145 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bcea12a1-da75-478c-b78e-10e4e2659aa8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-758bc6d4b-pdkf4\" (UID: \"bcea12a1-da75-478c-b78e-10e4e2659aa8\") " pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" Jul 29 22:47:49.728488 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.728177 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bcea12a1-da75-478c-b78e-10e4e2659aa8-metrics-client-ca\") pod \"thanos-querier-758bc6d4b-pdkf4\" (UID: \"bcea12a1-da75-478c-b78e-10e4e2659aa8\") " pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" Jul 29 22:47:49.728488 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.728223 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/930c892f-30bf-4c89-bd0f-08b8d28007fa-console-config\") pod \"console-54b68bc694-9hpvf\" (UID: \"930c892f-30bf-4c89-bd0f-08b8d28007fa\") " pod="openshift-console/console-54b68bc694-9hpvf" Jul 29 22:47:49.728488 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.728248 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/930c892f-30bf-4c89-bd0f-08b8d28007fa-trusted-ca-bundle\") pod \"console-54b68bc694-9hpvf\" (UID: \"930c892f-30bf-4c89-bd0f-08b8d28007fa\") " pod="openshift-console/console-54b68bc694-9hpvf" Jul 29 22:47:49.728488 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.728281 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bcea12a1-da75-478c-b78e-10e4e2659aa8-secret-thanos-querier-tls\") pod \"thanos-querier-758bc6d4b-pdkf4\" (UID: \"bcea12a1-da75-478c-b78e-10e4e2659aa8\") " pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" Jul 29 22:47:49.728488 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.728312 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/930c892f-30bf-4c89-bd0f-08b8d28007fa-console-oauth-config\") pod \"console-54b68bc694-9hpvf\" (UID: \"930c892f-30bf-4c89-bd0f-08b8d28007fa\") " pod="openshift-console/console-54b68bc694-9hpvf" Jul 29 22:47:49.728488 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.728347 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bcea12a1-da75-478c-b78e-10e4e2659aa8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-758bc6d4b-pdkf4\" (UID: \"bcea12a1-da75-478c-b78e-10e4e2659aa8\") " pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" Jul 29 22:47:49.728488 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.728373 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnsc5\" (UniqueName: \"kubernetes.io/projected/930c892f-30bf-4c89-bd0f-08b8d28007fa-kube-api-access-pnsc5\") pod \"console-54b68bc694-9hpvf\" (UID: \"930c892f-30bf-4c89-bd0f-08b8d28007fa\") " pod="openshift-console/console-54b68bc694-9hpvf" Jul 29 22:47:49.829207 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.829110 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bcea12a1-da75-478c-b78e-10e4e2659aa8-secret-grpc-tls\") pod \"thanos-querier-758bc6d4b-pdkf4\" (UID: \"bcea12a1-da75-478c-b78e-10e4e2659aa8\") " pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" Jul 29 22:47:49.829207 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.829166 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpzls\" (UniqueName: \"kubernetes.io/projected/bcea12a1-da75-478c-b78e-10e4e2659aa8-kube-api-access-qpzls\") pod \"thanos-querier-758bc6d4b-pdkf4\" (UID: \"bcea12a1-da75-478c-b78e-10e4e2659aa8\") " pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" Jul 29 22:47:49.829436 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.829209 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bcea12a1-da75-478c-b78e-10e4e2659aa8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-758bc6d4b-pdkf4\" (UID: \"bcea12a1-da75-478c-b78e-10e4e2659aa8\") " pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" Jul 29 22:47:49.829436 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.829234 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/930c892f-30bf-4c89-bd0f-08b8d28007fa-console-serving-cert\") pod \"console-54b68bc694-9hpvf\" (UID: \"930c892f-30bf-4c89-bd0f-08b8d28007fa\") " pod="openshift-console/console-54b68bc694-9hpvf" Jul 29 22:47:49.829436 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.829273 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bcea12a1-da75-478c-b78e-10e4e2659aa8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-758bc6d4b-pdkf4\" (UID: \"bcea12a1-da75-478c-b78e-10e4e2659aa8\") " pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" Jul 29 22:47:49.829436 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.829304 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bcea12a1-da75-478c-b78e-10e4e2659aa8-metrics-client-ca\") pod \"thanos-querier-758bc6d4b-pdkf4\" (UID: \"bcea12a1-da75-478c-b78e-10e4e2659aa8\") " pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" Jul 29 22:47:49.829436 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.829346 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/930c892f-30bf-4c89-bd0f-08b8d28007fa-console-config\") pod \"console-54b68bc694-9hpvf\" (UID: \"930c892f-30bf-4c89-bd0f-08b8d28007fa\") " pod="openshift-console/console-54b68bc694-9hpvf" Jul 29 22:47:49.829436 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.829370 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/930c892f-30bf-4c89-bd0f-08b8d28007fa-trusted-ca-bundle\") pod \"console-54b68bc694-9hpvf\" (UID: \"930c892f-30bf-4c89-bd0f-08b8d28007fa\") " pod="openshift-console/console-54b68bc694-9hpvf" Jul 29 22:47:49.830173 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.830144 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/930c892f-30bf-4c89-bd0f-08b8d28007fa-console-config\") pod \"console-54b68bc694-9hpvf\" (UID: \"930c892f-30bf-4c89-bd0f-08b8d28007fa\") " pod="openshift-console/console-54b68bc694-9hpvf" Jul 29 22:47:49.830359 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.830335 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bcea12a1-da75-478c-b78e-10e4e2659aa8-secret-thanos-querier-tls\") pod \"thanos-querier-758bc6d4b-pdkf4\" (UID: \"bcea12a1-da75-478c-b78e-10e4e2659aa8\") " pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" Jul 29 22:47:49.830444 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.830387 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/930c892f-30bf-4c89-bd0f-08b8d28007fa-console-oauth-config\") pod \"console-54b68bc694-9hpvf\" (UID: \"930c892f-30bf-4c89-bd0f-08b8d28007fa\") " pod="openshift-console/console-54b68bc694-9hpvf" Jul 29 22:47:49.830444 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.830424 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bcea12a1-da75-478c-b78e-10e4e2659aa8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-758bc6d4b-pdkf4\" (UID: \"bcea12a1-da75-478c-b78e-10e4e2659aa8\") " pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" Jul 29 22:47:49.830555 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.830457 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnsc5\" (UniqueName: \"kubernetes.io/projected/930c892f-30bf-4c89-bd0f-08b8d28007fa-kube-api-access-pnsc5\") pod \"console-54b68bc694-9hpvf\" (UID: \"930c892f-30bf-4c89-bd0f-08b8d28007fa\") " pod="openshift-console/console-54b68bc694-9hpvf" Jul 29 22:47:49.830555 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.830507 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/930c892f-30bf-4c89-bd0f-08b8d28007fa-service-ca\") pod \"console-54b68bc694-9hpvf\" (UID: \"930c892f-30bf-4c89-bd0f-08b8d28007fa\") " pod="openshift-console/console-54b68bc694-9hpvf" Jul 29 22:47:49.830555 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.830537 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/930c892f-30bf-4c89-bd0f-08b8d28007fa-oauth-serving-cert\") pod \"console-54b68bc694-9hpvf\" (UID: \"930c892f-30bf-4c89-bd0f-08b8d28007fa\") " pod="openshift-console/console-54b68bc694-9hpvf" Jul 29 22:47:49.830747 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.830575 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bcea12a1-da75-478c-b78e-10e4e2659aa8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-758bc6d4b-pdkf4\" (UID: \"bcea12a1-da75-478c-b78e-10e4e2659aa8\") " pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" Jul 29 22:47:49.830747 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.830652 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/930c892f-30bf-4c89-bd0f-08b8d28007fa-trusted-ca-bundle\") pod \"console-54b68bc694-9hpvf\" (UID: \"930c892f-30bf-4c89-bd0f-08b8d28007fa\") " pod="openshift-console/console-54b68bc694-9hpvf" Jul 29 22:47:49.830865 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.830803 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bcea12a1-da75-478c-b78e-10e4e2659aa8-metrics-client-ca\") pod \"thanos-querier-758bc6d4b-pdkf4\" (UID: \"bcea12a1-da75-478c-b78e-10e4e2659aa8\") " pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" Jul 29 22:47:49.831825 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.831666 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/930c892f-30bf-4c89-bd0f-08b8d28007fa-service-ca\") pod \"console-54b68bc694-9hpvf\" (UID: \"930c892f-30bf-4c89-bd0f-08b8d28007fa\") " pod="openshift-console/console-54b68bc694-9hpvf" Jul 29 22:47:49.831825 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.831746 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/930c892f-30bf-4c89-bd0f-08b8d28007fa-oauth-serving-cert\") pod \"console-54b68bc694-9hpvf\" (UID: \"930c892f-30bf-4c89-bd0f-08b8d28007fa\") " pod="openshift-console/console-54b68bc694-9hpvf" Jul 29 22:47:49.833745 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.833694 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bcea12a1-da75-478c-b78e-10e4e2659aa8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-758bc6d4b-pdkf4\" (UID: \"bcea12a1-da75-478c-b78e-10e4e2659aa8\") " pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" Jul 29 22:47:49.834555 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.834236 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bcea12a1-da75-478c-b78e-10e4e2659aa8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-758bc6d4b-pdkf4\" (UID: \"bcea12a1-da75-478c-b78e-10e4e2659aa8\") " pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" Jul 29 22:47:49.834555 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.834314 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bcea12a1-da75-478c-b78e-10e4e2659aa8-secret-grpc-tls\") pod \"thanos-querier-758bc6d4b-pdkf4\" (UID: \"bcea12a1-da75-478c-b78e-10e4e2659aa8\") " pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" Jul 29 22:47:49.834555 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.834511 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bcea12a1-da75-478c-b78e-10e4e2659aa8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-758bc6d4b-pdkf4\" (UID: \"bcea12a1-da75-478c-b78e-10e4e2659aa8\") " pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" Jul 29 22:47:49.834555 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.834535 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/930c892f-30bf-4c89-bd0f-08b8d28007fa-console-serving-cert\") pod \"console-54b68bc694-9hpvf\" (UID: \"930c892f-30bf-4c89-bd0f-08b8d28007fa\") " pod="openshift-console/console-54b68bc694-9hpvf" Jul 29 22:47:49.836145 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.836118 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bcea12a1-da75-478c-b78e-10e4e2659aa8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-758bc6d4b-pdkf4\" (UID: \"bcea12a1-da75-478c-b78e-10e4e2659aa8\") " pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" Jul 29 22:47:49.836430 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.836405 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/930c892f-30bf-4c89-bd0f-08b8d28007fa-console-oauth-config\") pod \"console-54b68bc694-9hpvf\" (UID: \"930c892f-30bf-4c89-bd0f-08b8d28007fa\") " pod="openshift-console/console-54b68bc694-9hpvf" Jul 29 22:47:49.836701 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.836644 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bcea12a1-da75-478c-b78e-10e4e2659aa8-secret-thanos-querier-tls\") pod \"thanos-querier-758bc6d4b-pdkf4\" (UID: \"bcea12a1-da75-478c-b78e-10e4e2659aa8\") " pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" Jul 29 22:47:49.838323 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.838298 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpzls\" (UniqueName: \"kubernetes.io/projected/bcea12a1-da75-478c-b78e-10e4e2659aa8-kube-api-access-qpzls\") pod \"thanos-querier-758bc6d4b-pdkf4\" (UID: \"bcea12a1-da75-478c-b78e-10e4e2659aa8\") " pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" Jul 29 22:47:49.838539 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.838519 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnsc5\" (UniqueName: \"kubernetes.io/projected/930c892f-30bf-4c89-bd0f-08b8d28007fa-kube-api-access-pnsc5\") pod \"console-54b68bc694-9hpvf\" (UID: \"930c892f-30bf-4c89-bd0f-08b8d28007fa\") " pod="openshift-console/console-54b68bc694-9hpvf" Jul 29 22:47:49.909970 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.909933 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" Jul 29 22:47:49.923769 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:49.923487 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b68bc694-9hpvf" Jul 29 22:47:50.926703 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:50.926657 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6dd57b497-dnbld" Jul 29 22:47:50.927167 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:50.926798 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6dd57b497-dnbld" Jul 29 22:47:50.932954 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:50.932930 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6dd57b497-dnbld" Jul 29 22:47:50.955946 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:50.955922 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6dd57b497-dnbld" Jul 29 22:47:51.348909 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:51.348845 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-8qd72"] Jul 29 22:47:51.357358 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:51.357331 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8qd72" Jul 29 22:47:51.360192 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:51.360167 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rgcbr\"" Jul 29 22:47:51.360721 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:51.360700 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 29 22:47:51.363287 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:51.362184 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-8qd72"] Jul 29 22:47:51.545782 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:51.545744 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/29d66010-429a-4a52-ae3e-4d7f5607c019-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-8qd72\" (UID: \"29d66010-429a-4a52-ae3e-4d7f5607c019\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8qd72" Jul 29 22:47:51.546047 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:51.545835 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8ntr\" (UniqueName: \"kubernetes.io/projected/29d66010-429a-4a52-ae3e-4d7f5607c019-kube-api-access-d8ntr\") pod \"monitoring-plugin-68b7fc9574-8qd72\" (UID: \"29d66010-429a-4a52-ae3e-4d7f5607c019\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8qd72" Jul 29 22:47:51.647183 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:51.647103 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/29d66010-429a-4a52-ae3e-4d7f5607c019-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-8qd72\" (UID: \"29d66010-429a-4a52-ae3e-4d7f5607c019\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8qd72" Jul 29 22:47:51.647183 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:51.647169 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8ntr\" (UniqueName: \"kubernetes.io/projected/29d66010-429a-4a52-ae3e-4d7f5607c019-kube-api-access-d8ntr\") pod \"monitoring-plugin-68b7fc9574-8qd72\" (UID: \"29d66010-429a-4a52-ae3e-4d7f5607c019\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8qd72" Jul 29 22:47:51.650667 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:51.650615 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/29d66010-429a-4a52-ae3e-4d7f5607c019-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-8qd72\" (UID: \"29d66010-429a-4a52-ae3e-4d7f5607c019\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8qd72" Jul 29 22:47:51.656410 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:51.656362 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8ntr\" (UniqueName: \"kubernetes.io/projected/29d66010-429a-4a52-ae3e-4d7f5607c019-kube-api-access-d8ntr\") pod \"monitoring-plugin-68b7fc9574-8qd72\" (UID: \"29d66010-429a-4a52-ae3e-4d7f5607c019\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8qd72" Jul 29 22:47:51.672127 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:51.672097 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8qd72" Jul 29 22:47:52.047472 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.046347 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-8qd72"] Jul 29 22:47:52.252978 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:47:52.252938 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29d66010_429a_4a52_ae3e_4d7f5607c019.slice/crio-5fcb2b3e062eb647592b73669d957ee73e11d78dff77f660df967cab18b62c55 WatchSource:0}: Error finding container 5fcb2b3e062eb647592b73669d957ee73e11d78dff77f660df967cab18b62c55: Status 404 returned error can't find the container with id 5fcb2b3e062eb647592b73669d957ee73e11d78dff77f660df967cab18b62c55 Jul 29 22:47:52.285785 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.285749 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54b68bc694-9hpvf"] Jul 29 22:47:52.287706 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.287535 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-758bc6d4b-pdkf4"] Jul 29 22:47:52.525466 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:47:52.525378 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod930c892f_30bf_4c89_bd0f_08b8d28007fa.slice/crio-5094a8774bd5e2b603267b0f99cf4f8b8b233cafbc13723533bb083a74443dcf WatchSource:0}: Error finding container 5094a8774bd5e2b603267b0f99cf4f8b8b233cafbc13723533bb083a74443dcf: Status 404 returned error can't find the container with id 5094a8774bd5e2b603267b0f99cf4f8b8b233cafbc13723533bb083a74443dcf Jul 29 22:47:52.526551 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:47:52.526511 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcea12a1_da75_478c_b78e_10e4e2659aa8.slice/crio-8efd48055fc42bd2439b106c7040b485924497270c3960d6418267973003f132 WatchSource:0}: Error finding container 8efd48055fc42bd2439b106c7040b485924497270c3960d6418267973003f132: Status 404 returned error can't find the container with id 8efd48055fc42bd2439b106c7040b485924497270c3960d6418267973003f132 Jul 29 22:47:52.826162 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.826081 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 22:47:52.830186 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.830156 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:52.833377 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.833343 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 29 22:47:52.833738 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.833722 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 29 22:47:52.834335 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.833927 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 29 22:47:52.834335 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.833974 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 29 22:47:52.834335 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.834057 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-tbviaga3a12b\"" Jul 29 22:47:52.834335 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.834068 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 29 22:47:52.834335 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.834199 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 29 22:47:52.834932 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.834758 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 29 22:47:52.835474 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.835129 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 29 22:47:52.835474 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.835142 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vbm87\"" Jul 29 22:47:52.835474 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.835166 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 29 22:47:52.835681 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.835507 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 29 22:47:52.835755 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.835740 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 29 22:47:52.836525 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.835939 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 29 22:47:52.836525 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.835956 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 29 22:47:52.836525 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.836228 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 29 22:47:52.838749 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.838727 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 29 22:47:52.854886 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.854858 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 22:47:52.909515 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.909480 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qzms6" Jul 29 22:47:52.957795 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.956859 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:52.957795 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.956894 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-config\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:52.957795 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.956917 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:52.957795 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.956935 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:52.957795 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.956965 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:52.957795 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.957000 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:52.957795 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.957053 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:52.957795 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.957090 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dea35e65-a3d8-4028-85a4-8436bee84a11-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:52.957795 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.957114 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:52.957795 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.957138 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-web-config\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:52.957795 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.957173 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:52.957795 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.957206 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:52.957795 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.957240 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk9v8\" (UniqueName: \"kubernetes.io/projected/dea35e65-a3d8-4028-85a4-8436bee84a11-kube-api-access-kk9v8\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:52.957795 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.957265 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dea35e65-a3d8-4028-85a4-8436bee84a11-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:52.957795 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.957297 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:52.957795 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.957322 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:52.959230 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.957346 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:52.959230 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.957375 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:52.959230 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.957399 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:52.959230 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.957430 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dea35e65-a3d8-4028-85a4-8436bee84a11-config-out\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:52.966437 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.966363 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w7x54" event={"ID":"b5a74cf5-440b-4152-8375-aca329c2b646","Type":"ContainerStarted","Data":"b95fbdc93f059b305ae39e6f86790ce53ff02fd1b85a2da84af641bdf90a8ca4"} Jul 29 22:47:52.969024 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.968967 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7kr7n" event={"ID":"276b66d3-320e-482e-9e01-abec897af39b","Type":"ContainerStarted","Data":"c1317494e7b7aef0502b09455d0543521d496e80bb0ccb79c7f135da183152a2"} Jul 29 22:47:52.970477 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.970424 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8qd72" event={"ID":"29d66010-429a-4a52-ae3e-4d7f5607c019","Type":"ContainerStarted","Data":"5fcb2b3e062eb647592b73669d957ee73e11d78dff77f660df967cab18b62c55"} Jul 29 22:47:52.972398 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.972301 2570 generic.go:356] "Generic (PLEG): container finished" podID="92d5f7be-457e-4787-bc9e-3d4859ce7f03" containerID="55a20e7c504bdae68e00702a11d378e46e14c3ba8b36752ada60bfba94417300" exitCode=0 Jul 29 22:47:52.972571 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.972549 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hl5xk" event={"ID":"92d5f7be-457e-4787-bc9e-3d4859ce7f03","Type":"ContainerDied","Data":"55a20e7c504bdae68e00702a11d378e46e14c3ba8b36752ada60bfba94417300"} Jul 29 22:47:52.974590 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.974557 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b68bc694-9hpvf" event={"ID":"930c892f-30bf-4c89-bd0f-08b8d28007fa","Type":"ContainerStarted","Data":"7779ec77a7cda9136972be7690a059889e822c7171406a8c27ec20d0bf79b9b8"} Jul 29 22:47:52.974691 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.974600 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b68bc694-9hpvf" event={"ID":"930c892f-30bf-4c89-bd0f-08b8d28007fa","Type":"ContainerStarted","Data":"5094a8774bd5e2b603267b0f99cf4f8b8b233cafbc13723533bb083a74443dcf"} Jul 29 22:47:52.977050 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.977023 2570 generic.go:356] "Generic (PLEG): container finished" podID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerID="c038dff4f10f2caac0d2d59848497fe4f857e73b28f8bcf9b6a26ff7f4ea3670" exitCode=0 Jul 29 22:47:52.977148 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.977072 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e38b37c-5ceb-4476-ba92-68e04e3158a5","Type":"ContainerDied","Data":"c038dff4f10f2caac0d2d59848497fe4f857e73b28f8bcf9b6a26ff7f4ea3670"} Jul 29 22:47:52.979433 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.979222 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" event={"ID":"bcea12a1-da75-478c-b78e-10e4e2659aa8","Type":"ContainerStarted","Data":"8efd48055fc42bd2439b106c7040b485924497270c3960d6418267973003f132"} Jul 29 22:47:52.989814 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:52.989768 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7kr7n" podStartSLOduration=2.24000298 podStartE2EDuration="6.989749444s" totalImagesPullingTime="4.749746464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:52.987904312 +0000 UTC m=+82.944000167" watchObservedRunningTime="2026-07-29 22:47:52.989749444 +0000 UTC m=+82.945845310" Jul 29 22:47:53.058093 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.057980 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.058093 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.058017 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.058093 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.058043 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.058093 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.058085 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.058606 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.058107 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.058606 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.058134 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dea35e65-a3d8-4028-85a4-8436bee84a11-config-out\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.058606 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.058167 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.058606 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.058211 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-config\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.060658 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.059743 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.060658 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.059795 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.060658 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.059824 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.060658 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.059855 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.060658 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.059923 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.060658 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.059964 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dea35e65-a3d8-4028-85a4-8436bee84a11-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.060658 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.059991 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.060658 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.060015 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-web-config\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.060658 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.060053 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.060658 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.060102 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.060658 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.060140 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk9v8\" (UniqueName: \"kubernetes.io/projected/dea35e65-a3d8-4028-85a4-8436bee84a11-kube-api-access-kk9v8\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.060658 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.060175 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dea35e65-a3d8-4028-85a4-8436bee84a11-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.060658 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.060304 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.060658 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.059042 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.061600 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.061579 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.061837 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.061815 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dea35e65-a3d8-4028-85a4-8436bee84a11-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.063449 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.061944 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.063449 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.062648 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dea35e65-a3d8-4028-85a4-8436bee84a11-config-out\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.066531 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.066204 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.067922 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.067155 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.067922 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.067359 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.067922 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.067518 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.067922 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.067795 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.069285 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.069262 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-config\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.069382 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.069312 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.069382 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.069336 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.069822 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.069753 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dea35e65-a3d8-4028-85a4-8436bee84a11-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.070703 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.070682 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-web-config\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.072509 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.072482 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.072758 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.072737 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.073590 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.073569 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.077756 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.077682 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk9v8\" (UniqueName: \"kubernetes.io/projected/dea35e65-a3d8-4028-85a4-8436bee84a11-kube-api-access-kk9v8\") pod \"prometheus-k8s-0\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.144661 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.144619 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:47:53.989881 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.989324 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hl5xk" event={"ID":"92d5f7be-457e-4787-bc9e-3d4859ce7f03","Type":"ContainerStarted","Data":"7e1fd16434402a1fcd570d9689a679f27dfda0b7ecf7372a7fe0b88e848ec942"} Jul 29 22:47:53.989881 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:53.989386 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hl5xk" event={"ID":"92d5f7be-457e-4787-bc9e-3d4859ce7f03","Type":"ContainerStarted","Data":"2bedd33f7e4be7eecf5d1b88a4a08ceadecc2bbbe362a6068e36feeb0de48cf4"} Jul 29 22:47:54.016806 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:54.016719 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54b68bc694-9hpvf" podStartSLOduration=5.016694009 podStartE2EDuration="5.016694009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:53.065598828 +0000 UTC m=+83.021694683" watchObservedRunningTime="2026-07-29 22:47:54.016694009 +0000 UTC m=+83.972789912" Jul 29 22:47:56.795244 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:56.795185 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hl5xk" podStartSLOduration=6.367693601 podStartE2EDuration="10.79516298s" totalImagesPullingTime="4.320685939s" totalInitContainerRuntime="106.78344ms" isStatefulPod=true podCreationTimestamp="2026-07-29 22:47:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:54.018558059 +0000 UTC m=+83.974653914" watchObservedRunningTime="2026-07-29 22:47:56.79516298 +0000 UTC m=+86.751258834" Jul 29 22:47:56.795712 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:56.795386 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54b68bc694-9hpvf"] Jul 29 22:47:59.924186 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:47:59.924138 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54b68bc694-9hpvf" Jul 29 22:48:03.956118 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:03.956085 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 22:48:04.744286 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:48:04.744253 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddea35e65_a3d8_4028_85a4_8436bee84a11.slice/crio-65f64aaf6a5491d9e40ffd1e5292bc655b2e06891f220cdfe14aa716031f29b5 WatchSource:0}: Error finding container 65f64aaf6a5491d9e40ffd1e5292bc655b2e06891f220cdfe14aa716031f29b5: Status 404 returned error can't find the container with id 65f64aaf6a5491d9e40ffd1e5292bc655b2e06891f220cdfe14aa716031f29b5 Jul 29 22:48:05.037015 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:05.036892 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-2q5xk" event={"ID":"7a24d6ed-ed41-4133-953c-ca387e4593ec","Type":"ContainerStarted","Data":"6abf4b1b1dfea80c60a44225196a03d6d3cda8489e06ad6c46cf262623a5bb41"} Jul 29 22:48:05.037015 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:05.036959 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-2q5xk" Jul 29 22:48:05.038042 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:05.038015 2570 patch_prober.go:28] interesting pod/downloads-7c97dc4555-2q5xk container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.11:8080/\": dial tcp 10.134.0.11:8080: connect: connection refused" start-of-body= Jul 29 22:48:05.038120 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:05.038067 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7c97dc4555-2q5xk" podUID="7a24d6ed-ed41-4133-953c-ca387e4593ec" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.11:8080/\": dial tcp 10.134.0.11:8080: connect: connection refused" Jul 29 22:48:05.039304 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:05.039281 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e38b37c-5ceb-4476-ba92-68e04e3158a5","Type":"ContainerStarted","Data":"95ef6b471ac412f33375aae161e0e87ca229622e341cd6021e39b2277b9a9e3c"} Jul 29 22:48:05.041762 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:05.041733 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" event={"ID":"bcea12a1-da75-478c-b78e-10e4e2659aa8","Type":"ContainerStarted","Data":"ef7f4eebe730d6f8bb28bbc6e7c598d3e73d278828fe8ca1e63f0744b1e12a0f"} Jul 29 22:48:05.043781 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:05.043756 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w7x54" event={"ID":"b5a74cf5-440b-4152-8375-aca329c2b646","Type":"ContainerStarted","Data":"913579fa40a3a3bdff423fbca1d271ff7012815ed78f5e9501f9985940e5760c"} Jul 29 22:48:05.045738 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:05.045710 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8qd72" event={"ID":"29d66010-429a-4a52-ae3e-4d7f5607c019","Type":"ContainerStarted","Data":"d92dab5002f804558751eff1a0d5bc0e081dfeaed4352dba6d74141c94a01d8c"} Jul 29 22:48:05.045933 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:05.045912 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8qd72" Jul 29 22:48:05.047591 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:05.047524 2570 generic.go:356] "Generic (PLEG): container finished" podID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerID="3508968db139fc742e22aae909614d8e75d740ef3f3ac9ada137de25322d71c7" exitCode=0 Jul 29 22:48:05.047591 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:05.047560 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dea35e65-a3d8-4028-85a4-8436bee84a11","Type":"ContainerDied","Data":"3508968db139fc742e22aae909614d8e75d740ef3f3ac9ada137de25322d71c7"} Jul 29 22:48:05.047771 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:05.047614 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dea35e65-a3d8-4028-85a4-8436bee84a11","Type":"ContainerStarted","Data":"65f64aaf6a5491d9e40ffd1e5292bc655b2e06891f220cdfe14aa716031f29b5"} Jul 29 22:48:05.051406 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:05.051371 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8qd72" Jul 29 22:48:05.056699 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:05.056058 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-2q5xk" podStartSLOduration=2.177002086 podStartE2EDuration="25.056046894s" totalImagesPullingTime="22.879044808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:48:05.054359682 +0000 UTC m=+95.010455535" watchObservedRunningTime="2026-07-29 22:48:05.056046894 +0000 UTC m=+95.012142747" Jul 29 22:48:05.072961 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:05.072909 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8qd72" podStartSLOduration=1.503129985 podStartE2EDuration="14.072888249s" totalImagesPullingTime="12.569758264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:48:05.072292729 +0000 UTC m=+95.028388598" watchObservedRunningTime="2026-07-29 22:48:05.072888249 +0000 UTC m=+95.028984143" Jul 29 22:48:06.061885 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:06.061663 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e38b37c-5ceb-4476-ba92-68e04e3158a5","Type":"ContainerStarted","Data":"9915a05b57d8ec4a0d0ee658e5a0a0b5a0a4493d3c98bd13915d235c6a815c7f"} Jul 29 22:48:06.061885 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:06.061751 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e38b37c-5ceb-4476-ba92-68e04e3158a5","Type":"ContainerStarted","Data":"346ffd79e45445e2f1276623d71d7638dd39d544f8dcb5114512ea10129e6f55"} Jul 29 22:48:06.061885 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:06.061794 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e38b37c-5ceb-4476-ba92-68e04e3158a5","Type":"ContainerStarted","Data":"02cd721e96dbb59fcbf3b0d5820701800a6fc8986fcfd1e851c7833e1222da77"} Jul 29 22:48:06.061885 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:06.061833 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e38b37c-5ceb-4476-ba92-68e04e3158a5","Type":"ContainerStarted","Data":"27934e183d40a1724ab39c39a3b7a38ebfa718465840c308f2573e3d9cce9b69"} Jul 29 22:48:06.064966 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:06.064402 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" event={"ID":"bcea12a1-da75-478c-b78e-10e4e2659aa8","Type":"ContainerStarted","Data":"d5b16213539edfc2d3a0323efdfeb19effe500985ab2a31f733c863af3999e77"} Jul 29 22:48:06.064966 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:06.064481 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" event={"ID":"bcea12a1-da75-478c-b78e-10e4e2659aa8","Type":"ContainerStarted","Data":"314bdc6afb2645606a79fff9101dc6bd76913ee378a99a2404cab7298205e3e7"} Jul 29 22:48:06.077363 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:06.077127 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-2q5xk" Jul 29 22:48:08.059954 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:08.059908 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dd57b497-dnbld"] Jul 29 22:48:08.082896 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:08.082788 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e38b37c-5ceb-4476-ba92-68e04e3158a5","Type":"ContainerStarted","Data":"42d86fab3e0b6739aa8b14eafc9b1966e901d4f5686d4d3f1ef76a35cb0326c2"} Jul 29 22:48:08.087777 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:08.087583 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" event={"ID":"bcea12a1-da75-478c-b78e-10e4e2659aa8","Type":"ContainerStarted","Data":"84b4463d3a25d054f38a997349327caac1898c8464a49103dad0555885d067f5"} Jul 29 22:48:08.087777 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:08.087679 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" event={"ID":"bcea12a1-da75-478c-b78e-10e4e2659aa8","Type":"ContainerStarted","Data":"62653806dfb26b7f2ebe587dbbdaf7237ee036379841d5b370b50548b09a8b95"} Jul 29 22:48:08.087777 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:08.087723 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" event={"ID":"bcea12a1-da75-478c-b78e-10e4e2659aa8","Type":"ContainerStarted","Data":"b8ba8273cf49e8ebf8644bcfe6522061350dff5fad51d61a9e1c6f015405160e"} Jul 29 22:48:08.153983 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:08.153919 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.20364901 podStartE2EDuration="21.153895872s" totalImagesPullingTime="17.926549628s" totalInitContainerRuntime="23.697234ms" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:48:08.15304372 +0000 UTC m=+98.109139578" watchObservedRunningTime="2026-07-29 22:48:08.153895872 +0000 UTC m=+98.109991725" Jul 29 22:48:08.179881 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:08.179824 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" podStartSLOduration=5.1049939460000004 podStartE2EDuration="19.179803006s" totalImagesPullingTime="14.07480906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:48:08.177866504 +0000 UTC m=+98.133962361" watchObservedRunningTime="2026-07-29 22:48:08.179803006 +0000 UTC m=+98.135898861" Jul 29 22:48:09.093718 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:09.093687 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" Jul 29 22:48:10.103960 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:10.103928 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-758bc6d4b-pdkf4" Jul 29 22:48:12.110413 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:12.110372 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dea35e65-a3d8-4028-85a4-8436bee84a11","Type":"ContainerStarted","Data":"5086bad078bd4dd0a24f6d7c0cc3644747f5eca703b7250b5629126db1997983"} Jul 29 22:48:12.112979 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:12.112940 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w7x54" event={"ID":"b5a74cf5-440b-4152-8375-aca329c2b646","Type":"ContainerStarted","Data":"6ad65c2bc5e49a82fbc28516b3c104b2b0b8f494958a891d1771efa0f2ca2cb7"} Jul 29 22:48:13.122067 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:13.122016 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dea35e65-a3d8-4028-85a4-8436bee84a11","Type":"ContainerStarted","Data":"34506760c65c126b7e22dde19c234de02413a613785de879a48b219eb3942afe"} Jul 29 22:48:13.122668 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:13.122111 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dea35e65-a3d8-4028-85a4-8436bee84a11","Type":"ContainerStarted","Data":"f1c3d85629ea5379e8534995b0ca7e4f50a8c14b4cd2867ae8a67cd48ce2aae1"} Jul 29 22:48:13.122668 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:13.122159 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dea35e65-a3d8-4028-85a4-8436bee84a11","Type":"ContainerStarted","Data":"d73873003f2772f89f3a7e77829d5325b1819db8a802e5231c6aabb2a30a820a"} Jul 29 22:48:13.122668 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:13.122199 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dea35e65-a3d8-4028-85a4-8436bee84a11","Type":"ContainerStarted","Data":"45b8701c7476b5e461a0b737ad1d1d1a7fe8d60d1981d51a556863dd4f573377"} Jul 29 22:48:13.122668 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:13.122239 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dea35e65-a3d8-4028-85a4-8436bee84a11","Type":"ContainerStarted","Data":"514fa581be1664a0f6f6a13fef1553fc61c84c9e79d97f46d5c7658be576ec3f"} Jul 29 22:48:13.145912 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:13.145875 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:13.152824 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:13.152759 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=14.229207305 podStartE2EDuration="21.152735548s" totalImagesPullingTime="6.901874711s" totalInitContainerRuntime="21.653532ms" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:48:13.151034051 +0000 UTC m=+103.107129940" watchObservedRunningTime="2026-07-29 22:48:13.152735548 +0000 UTC m=+103.108831405" Jul 29 22:48:13.153667 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:13.153606 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-w7x54" podStartSLOduration=33.989135397 podStartE2EDuration="1m0.153593493s" totalImagesPullingTime="26.164458096s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:47:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:48:12.138117318 +0000 UTC m=+102.094213175" watchObservedRunningTime="2026-07-29 22:48:13.153593493 +0000 UTC m=+103.109689348" Jul 29 22:48:14.913770 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:14.913734 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xs48r" Jul 29 22:48:21.817482 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:21.817406 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-54b68bc694-9hpvf" podUID="930c892f-30bf-4c89-bd0f-08b8d28007fa" containerName="console" containerID="cri-o://7779ec77a7cda9136972be7690a059889e822c7171406a8c27ec20d0bf79b9b8" gracePeriod=15 Jul 29 22:48:22.077102 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.077028 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b68bc694-9hpvf" Jul 29 22:48:22.161575 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.161540 2570 generic.go:356] "Generic (PLEG): container finished" podID="930c892f-30bf-4c89-bd0f-08b8d28007fa" containerID="7779ec77a7cda9136972be7690a059889e822c7171406a8c27ec20d0bf79b9b8" exitCode=0 Jul 29 22:48:22.161761 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.161583 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b68bc694-9hpvf" Jul 29 22:48:22.161761 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.161584 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b68bc694-9hpvf" event={"ID":"930c892f-30bf-4c89-bd0f-08b8d28007fa","Type":"ContainerDied","Data":"7779ec77a7cda9136972be7690a059889e822c7171406a8c27ec20d0bf79b9b8"} Jul 29 22:48:22.161835 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.161757 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b68bc694-9hpvf" event={"ID":"930c892f-30bf-4c89-bd0f-08b8d28007fa","Type":"ContainerDied","Data":"5094a8774bd5e2b603267b0f99cf4f8b8b233cafbc13723533bb083a74443dcf"} Jul 29 22:48:22.161835 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.161787 2570 scope.go:117] "RemoveContainer" containerID="7779ec77a7cda9136972be7690a059889e822c7171406a8c27ec20d0bf79b9b8" Jul 29 22:48:22.170067 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.170046 2570 scope.go:117] "RemoveContainer" containerID="7779ec77a7cda9136972be7690a059889e822c7171406a8c27ec20d0bf79b9b8" Jul 29 22:48:22.170363 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:48:22.170344 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7779ec77a7cda9136972be7690a059889e822c7171406a8c27ec20d0bf79b9b8\": container with ID starting with 7779ec77a7cda9136972be7690a059889e822c7171406a8c27ec20d0bf79b9b8 not found: ID does not exist" containerID="7779ec77a7cda9136972be7690a059889e822c7171406a8c27ec20d0bf79b9b8" Jul 29 22:48:22.170404 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.170375 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7779ec77a7cda9136972be7690a059889e822c7171406a8c27ec20d0bf79b9b8"} err="failed to get container status \"7779ec77a7cda9136972be7690a059889e822c7171406a8c27ec20d0bf79b9b8\": rpc error: code = NotFound desc = could not find container \"7779ec77a7cda9136972be7690a059889e822c7171406a8c27ec20d0bf79b9b8\": container with ID starting with 7779ec77a7cda9136972be7690a059889e822c7171406a8c27ec20d0bf79b9b8 not found: ID does not exist" Jul 29 22:48:22.244689 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.244655 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/930c892f-30bf-4c89-bd0f-08b8d28007fa-console-config\") pod \"930c892f-30bf-4c89-bd0f-08b8d28007fa\" (UID: \"930c892f-30bf-4c89-bd0f-08b8d28007fa\") " Jul 29 22:48:22.244868 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.244701 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/930c892f-30bf-4c89-bd0f-08b8d28007fa-console-serving-cert\") pod \"930c892f-30bf-4c89-bd0f-08b8d28007fa\" (UID: \"930c892f-30bf-4c89-bd0f-08b8d28007fa\") " Jul 29 22:48:22.244868 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.244729 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnsc5\" (UniqueName: \"kubernetes.io/projected/930c892f-30bf-4c89-bd0f-08b8d28007fa-kube-api-access-pnsc5\") pod \"930c892f-30bf-4c89-bd0f-08b8d28007fa\" (UID: \"930c892f-30bf-4c89-bd0f-08b8d28007fa\") " Jul 29 22:48:22.244868 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.244745 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/930c892f-30bf-4c89-bd0f-08b8d28007fa-trusted-ca-bundle\") pod \"930c892f-30bf-4c89-bd0f-08b8d28007fa\" (UID: \"930c892f-30bf-4c89-bd0f-08b8d28007fa\") " Jul 29 22:48:22.244868 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.244779 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/930c892f-30bf-4c89-bd0f-08b8d28007fa-oauth-serving-cert\") pod \"930c892f-30bf-4c89-bd0f-08b8d28007fa\" (UID: \"930c892f-30bf-4c89-bd0f-08b8d28007fa\") " Jul 29 22:48:22.244868 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.244807 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/930c892f-30bf-4c89-bd0f-08b8d28007fa-console-oauth-config\") pod \"930c892f-30bf-4c89-bd0f-08b8d28007fa\" (UID: \"930c892f-30bf-4c89-bd0f-08b8d28007fa\") " Jul 29 22:48:22.245108 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.244870 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/930c892f-30bf-4c89-bd0f-08b8d28007fa-service-ca\") pod \"930c892f-30bf-4c89-bd0f-08b8d28007fa\" (UID: \"930c892f-30bf-4c89-bd0f-08b8d28007fa\") " Jul 29 22:48:22.245166 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.245109 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/930c892f-30bf-4c89-bd0f-08b8d28007fa-console-config" (OuterVolumeSpecName: "console-config") pod "930c892f-30bf-4c89-bd0f-08b8d28007fa" (UID: "930c892f-30bf-4c89-bd0f-08b8d28007fa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:48:22.245219 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.245197 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/930c892f-30bf-4c89-bd0f-08b8d28007fa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "930c892f-30bf-4c89-bd0f-08b8d28007fa" (UID: "930c892f-30bf-4c89-bd0f-08b8d28007fa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:48:22.245269 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.245218 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/930c892f-30bf-4c89-bd0f-08b8d28007fa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "930c892f-30bf-4c89-bd0f-08b8d28007fa" (UID: "930c892f-30bf-4c89-bd0f-08b8d28007fa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:48:22.245419 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.245397 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/930c892f-30bf-4c89-bd0f-08b8d28007fa-service-ca" (OuterVolumeSpecName: "service-ca") pod "930c892f-30bf-4c89-bd0f-08b8d28007fa" (UID: "930c892f-30bf-4c89-bd0f-08b8d28007fa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:48:22.247183 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.247154 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/930c892f-30bf-4c89-bd0f-08b8d28007fa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "930c892f-30bf-4c89-bd0f-08b8d28007fa" (UID: "930c892f-30bf-4c89-bd0f-08b8d28007fa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:48:22.247293 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.247189 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/930c892f-30bf-4c89-bd0f-08b8d28007fa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "930c892f-30bf-4c89-bd0f-08b8d28007fa" (UID: "930c892f-30bf-4c89-bd0f-08b8d28007fa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:48:22.247293 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.247232 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/930c892f-30bf-4c89-bd0f-08b8d28007fa-kube-api-access-pnsc5" (OuterVolumeSpecName: "kube-api-access-pnsc5") pod "930c892f-30bf-4c89-bd0f-08b8d28007fa" (UID: "930c892f-30bf-4c89-bd0f-08b8d28007fa"). InnerVolumeSpecName "kube-api-access-pnsc5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 22:48:22.345997 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.345907 2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/930c892f-30bf-4c89-bd0f-08b8d28007fa-service-ca\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:48:22.345997 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.345939 2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/930c892f-30bf-4c89-bd0f-08b8d28007fa-console-config\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:48:22.345997 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.345950 2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/930c892f-30bf-4c89-bd0f-08b8d28007fa-console-serving-cert\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:48:22.345997 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.345961 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnsc5\" (UniqueName: \"kubernetes.io/projected/930c892f-30bf-4c89-bd0f-08b8d28007fa-kube-api-access-pnsc5\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:48:22.345997 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.345970 2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/930c892f-30bf-4c89-bd0f-08b8d28007fa-trusted-ca-bundle\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:48:22.345997 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.346001 2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/930c892f-30bf-4c89-bd0f-08b8d28007fa-oauth-serving-cert\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:48:22.346336 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.346012 2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/930c892f-30bf-4c89-bd0f-08b8d28007fa-console-oauth-config\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:48:22.484212 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.484177 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54b68bc694-9hpvf"] Jul 29 22:48:22.488034 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.488008 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54b68bc694-9hpvf"] Jul 29 22:48:22.506458 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:22.506430 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="930c892f-30bf-4c89-bd0f-08b8d28007fa" path="/var/lib/kubelet/pods/930c892f-30bf-4c89-bd0f-08b8d28007fa/volumes" Jul 29 22:48:24.452817 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:24.452790 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-smhlc_7ede295e-e0e9-4a75-b7de-109a53d9fe57/serve-healthcheck-canary/0.log" Jul 29 22:48:33.085329 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:33.085273 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6dd57b497-dnbld" podUID="7247d701-618f-44d3-8ca1-addb0d93d30e" containerName="console" containerID="cri-o://a1f0dd0b3364e73cf22577c1949a6613a3b631f666f7777cfcdca60d9870eac9" gracePeriod=15 Jul 29 22:48:33.207879 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:33.207851 2570 generic.go:356] "Generic (PLEG): container finished" podID="7247d701-618f-44d3-8ca1-addb0d93d30e" containerID="a1f0dd0b3364e73cf22577c1949a6613a3b631f666f7777cfcdca60d9870eac9" exitCode=0 Jul 29 22:48:33.208031 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:33.207921 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dd57b497-dnbld" event={"ID":"7247d701-618f-44d3-8ca1-addb0d93d30e","Type":"ContainerDied","Data":"a1f0dd0b3364e73cf22577c1949a6613a3b631f666f7777cfcdca60d9870eac9"} Jul 29 22:48:33.364394 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:33.364317 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dd57b497-dnbld" Jul 29 22:48:33.545879 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:33.545839 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7247d701-618f-44d3-8ca1-addb0d93d30e-console-oauth-config\") pod \"7247d701-618f-44d3-8ca1-addb0d93d30e\" (UID: \"7247d701-618f-44d3-8ca1-addb0d93d30e\") " Jul 29 22:48:33.545879 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:33.545886 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7247d701-618f-44d3-8ca1-addb0d93d30e-service-ca\") pod \"7247d701-618f-44d3-8ca1-addb0d93d30e\" (UID: \"7247d701-618f-44d3-8ca1-addb0d93d30e\") " Jul 29 22:48:33.546126 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:33.545921 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9b5cv\" (UniqueName: \"kubernetes.io/projected/7247d701-618f-44d3-8ca1-addb0d93d30e-kube-api-access-9b5cv\") pod \"7247d701-618f-44d3-8ca1-addb0d93d30e\" (UID: \"7247d701-618f-44d3-8ca1-addb0d93d30e\") " Jul 29 22:48:33.546126 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:33.545971 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7247d701-618f-44d3-8ca1-addb0d93d30e-console-serving-cert\") pod \"7247d701-618f-44d3-8ca1-addb0d93d30e\" (UID: \"7247d701-618f-44d3-8ca1-addb0d93d30e\") " Jul 29 22:48:33.546126 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:33.546014 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7247d701-618f-44d3-8ca1-addb0d93d30e-console-config\") pod \"7247d701-618f-44d3-8ca1-addb0d93d30e\" (UID: \"7247d701-618f-44d3-8ca1-addb0d93d30e\") " Jul 29 22:48:33.546126 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:33.546035 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7247d701-618f-44d3-8ca1-addb0d93d30e-oauth-serving-cert\") pod \"7247d701-618f-44d3-8ca1-addb0d93d30e\" (UID: \"7247d701-618f-44d3-8ca1-addb0d93d30e\") " Jul 29 22:48:33.546419 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:33.546389 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7247d701-618f-44d3-8ca1-addb0d93d30e-console-config" (OuterVolumeSpecName: "console-config") pod "7247d701-618f-44d3-8ca1-addb0d93d30e" (UID: "7247d701-618f-44d3-8ca1-addb0d93d30e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:48:33.546548 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:33.546414 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7247d701-618f-44d3-8ca1-addb0d93d30e-service-ca" (OuterVolumeSpecName: "service-ca") pod "7247d701-618f-44d3-8ca1-addb0d93d30e" (UID: "7247d701-618f-44d3-8ca1-addb0d93d30e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:48:33.546548 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:33.546470 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7247d701-618f-44d3-8ca1-addb0d93d30e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7247d701-618f-44d3-8ca1-addb0d93d30e" (UID: "7247d701-618f-44d3-8ca1-addb0d93d30e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:48:33.548146 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:33.548121 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7247d701-618f-44d3-8ca1-addb0d93d30e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7247d701-618f-44d3-8ca1-addb0d93d30e" (UID: "7247d701-618f-44d3-8ca1-addb0d93d30e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:48:33.548502 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:33.548481 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7247d701-618f-44d3-8ca1-addb0d93d30e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7247d701-618f-44d3-8ca1-addb0d93d30e" (UID: "7247d701-618f-44d3-8ca1-addb0d93d30e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:48:33.548575 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:33.548507 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7247d701-618f-44d3-8ca1-addb0d93d30e-kube-api-access-9b5cv" (OuterVolumeSpecName: "kube-api-access-9b5cv") pod "7247d701-618f-44d3-8ca1-addb0d93d30e" (UID: "7247d701-618f-44d3-8ca1-addb0d93d30e"). InnerVolumeSpecName "kube-api-access-9b5cv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 22:48:33.647016 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:33.646918 2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7247d701-618f-44d3-8ca1-addb0d93d30e-console-config\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:48:33.647016 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:33.646952 2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7247d701-618f-44d3-8ca1-addb0d93d30e-oauth-serving-cert\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:48:33.647016 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:33.646964 2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7247d701-618f-44d3-8ca1-addb0d93d30e-console-oauth-config\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:48:33.647016 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:33.646975 2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7247d701-618f-44d3-8ca1-addb0d93d30e-service-ca\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:48:33.647016 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:33.646986 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9b5cv\" (UniqueName: \"kubernetes.io/projected/7247d701-618f-44d3-8ca1-addb0d93d30e-kube-api-access-9b5cv\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:48:33.647016 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:33.646997 2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7247d701-618f-44d3-8ca1-addb0d93d30e-console-serving-cert\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:48:34.212928 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:34.212897 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dd57b497-dnbld" Jul 29 22:48:34.212928 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:34.212906 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dd57b497-dnbld" event={"ID":"7247d701-618f-44d3-8ca1-addb0d93d30e","Type":"ContainerDied","Data":"6870c315a445b5600b7ccb26ed505f81751e534c3ff085431b0f2bfa1d9fe977"} Jul 29 22:48:34.213438 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:34.212972 2570 scope.go:117] "RemoveContainer" containerID="a1f0dd0b3364e73cf22577c1949a6613a3b631f666f7777cfcdca60d9870eac9" Jul 29 22:48:34.236823 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:34.236797 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dd57b497-dnbld"] Jul 29 22:48:34.240645 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:34.240613 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6dd57b497-dnbld"] Jul 29 22:48:34.509120 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:34.509087 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7247d701-618f-44d3-8ca1-addb0d93d30e" path="/var/lib/kubelet/pods/7247d701-618f-44d3-8ca1-addb0d93d30e/volumes" Jul 29 22:48:53.145888 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:53.145848 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:53.199709 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:53.199680 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:53.307580 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:48:53.307556 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:06.899648 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:06.899600 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 22:49:06.900710 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:06.900439 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerName="kube-rbac-proxy" containerID="cri-o://346ffd79e45445e2f1276623d71d7638dd39d544f8dcb5114512ea10129e6f55" gracePeriod=120 Jul 29 22:49:06.900710 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:06.900466 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerName="prom-label-proxy" containerID="cri-o://42d86fab3e0b6739aa8b14eafc9b1966e901d4f5686d4d3f1ef76a35cb0326c2" gracePeriod=120 Jul 29 22:49:06.900710 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:06.900423 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerName="alertmanager" containerID="cri-o://95ef6b471ac412f33375aae161e0e87ca229622e341cd6021e39b2277b9a9e3c" gracePeriod=120 Jul 29 22:49:06.900710 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:06.900647 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerName="config-reloader" containerID="cri-o://27934e183d40a1724ab39c39a3b7a38ebfa718465840c308f2573e3d9cce9b69" gracePeriod=120 Jul 29 22:49:06.901064 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:06.900625 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerName="kube-rbac-proxy-metric" containerID="cri-o://9915a05b57d8ec4a0d0ee658e5a0a0b5a0a4493d3c98bd13915d235c6a815c7f" gracePeriod=120 Jul 29 22:49:06.901064 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:06.900821 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerName="kube-rbac-proxy-web" containerID="cri-o://02cd721e96dbb59fcbf3b0d5820701800a6fc8986fcfd1e851c7833e1222da77" gracePeriod=120 Jul 29 22:49:07.372022 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:07.371991 2570 generic.go:356] "Generic (PLEG): container finished" podID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerID="42d86fab3e0b6739aa8b14eafc9b1966e901d4f5686d4d3f1ef76a35cb0326c2" exitCode=0 Jul 29 22:49:07.372022 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:07.372014 2570 generic.go:356] "Generic (PLEG): container finished" podID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerID="9915a05b57d8ec4a0d0ee658e5a0a0b5a0a4493d3c98bd13915d235c6a815c7f" exitCode=0 Jul 29 22:49:07.372022 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:07.372020 2570 generic.go:356] "Generic (PLEG): container finished" podID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerID="346ffd79e45445e2f1276623d71d7638dd39d544f8dcb5114512ea10129e6f55" exitCode=0 Jul 29 22:49:07.372022 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:07.372025 2570 generic.go:356] "Generic (PLEG): container finished" podID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerID="27934e183d40a1724ab39c39a3b7a38ebfa718465840c308f2573e3d9cce9b69" exitCode=0 Jul 29 22:49:07.372022 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:07.372030 2570 generic.go:356] "Generic (PLEG): container finished" podID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerID="95ef6b471ac412f33375aae161e0e87ca229622e341cd6021e39b2277b9a9e3c" exitCode=0 Jul 29 22:49:07.372303 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:07.372049 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e38b37c-5ceb-4476-ba92-68e04e3158a5","Type":"ContainerDied","Data":"42d86fab3e0b6739aa8b14eafc9b1966e901d4f5686d4d3f1ef76a35cb0326c2"} Jul 29 22:49:07.372303 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:07.372130 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e38b37c-5ceb-4476-ba92-68e04e3158a5","Type":"ContainerDied","Data":"9915a05b57d8ec4a0d0ee658e5a0a0b5a0a4493d3c98bd13915d235c6a815c7f"} Jul 29 22:49:07.372303 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:07.372157 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e38b37c-5ceb-4476-ba92-68e04e3158a5","Type":"ContainerDied","Data":"346ffd79e45445e2f1276623d71d7638dd39d544f8dcb5114512ea10129e6f55"} Jul 29 22:49:07.372303 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:07.372182 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e38b37c-5ceb-4476-ba92-68e04e3158a5","Type":"ContainerDied","Data":"27934e183d40a1724ab39c39a3b7a38ebfa718465840c308f2573e3d9cce9b69"} Jul 29 22:49:07.372303 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:07.372205 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e38b37c-5ceb-4476-ba92-68e04e3158a5","Type":"ContainerDied","Data":"95ef6b471ac412f33375aae161e0e87ca229622e341cd6021e39b2277b9a9e3c"} Jul 29 22:49:08.151475 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.151451 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.248044 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.248020 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-secret-alertmanager-kube-rbac-proxy\") pod \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " Jul 29 22:49:08.248192 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.248058 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-config-volume\") pod \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " Jul 29 22:49:08.248192 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.248092 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2e38b37c-5ceb-4476-ba92-68e04e3158a5-alertmanager-main-db\") pod \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " Jul 29 22:49:08.248192 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.248125 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e38b37c-5ceb-4476-ba92-68e04e3158a5-alertmanager-trusted-ca-bundle\") pod \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " Jul 29 22:49:08.248192 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.248150 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llzlt\" (UniqueName: \"kubernetes.io/projected/2e38b37c-5ceb-4476-ba92-68e04e3158a5-kube-api-access-llzlt\") pod \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " Jul 29 22:49:08.248192 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.248184 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-secret-alertmanager-kube-rbac-proxy-web\") pod \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " Jul 29 22:49:08.248426 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.248217 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-cluster-tls-config\") pod \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " Jul 29 22:49:08.248426 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.248241 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-secret-alertmanager-main-tls\") pod \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " Jul 29 22:49:08.248426 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.248294 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2e38b37c-5ceb-4476-ba92-68e04e3158a5-tls-assets\") pod \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " Jul 29 22:49:08.248426 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.248317 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " Jul 29 22:49:08.248426 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.248355 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-web-config\") pod \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " Jul 29 22:49:08.248426 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.248393 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e38b37c-5ceb-4476-ba92-68e04e3158a5-metrics-client-ca\") pod \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " Jul 29 22:49:08.248762 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.248448 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2e38b37c-5ceb-4476-ba92-68e04e3158a5-config-out\") pod \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\" (UID: \"2e38b37c-5ceb-4476-ba92-68e04e3158a5\") " Jul 29 22:49:08.248762 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.248481 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e38b37c-5ceb-4476-ba92-68e04e3158a5-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "2e38b37c-5ceb-4476-ba92-68e04e3158a5" (UID: "2e38b37c-5ceb-4476-ba92-68e04e3158a5"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 22:49:08.248762 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.248560 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e38b37c-5ceb-4476-ba92-68e04e3158a5-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "2e38b37c-5ceb-4476-ba92-68e04e3158a5" (UID: "2e38b37c-5ceb-4476-ba92-68e04e3158a5"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:49:08.248905 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.248777 2570 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2e38b37c-5ceb-4476-ba92-68e04e3158a5-alertmanager-main-db\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:08.248905 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.248797 2570 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e38b37c-5ceb-4476-ba92-68e04e3158a5-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:08.249689 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.249662 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e38b37c-5ceb-4476-ba92-68e04e3158a5-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "2e38b37c-5ceb-4476-ba92-68e04e3158a5" (UID: "2e38b37c-5ceb-4476-ba92-68e04e3158a5"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:49:08.251040 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.250985 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-config-volume" (OuterVolumeSpecName: "config-volume") pod "2e38b37c-5ceb-4476-ba92-68e04e3158a5" (UID: "2e38b37c-5ceb-4476-ba92-68e04e3158a5"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:08.251201 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.251115 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "2e38b37c-5ceb-4476-ba92-68e04e3158a5" (UID: "2e38b37c-5ceb-4476-ba92-68e04e3158a5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:08.251201 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.251177 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "2e38b37c-5ceb-4476-ba92-68e04e3158a5" (UID: "2e38b37c-5ceb-4476-ba92-68e04e3158a5"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:08.251482 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.251461 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e38b37c-5ceb-4476-ba92-68e04e3158a5-config-out" (OuterVolumeSpecName: "config-out") pod "2e38b37c-5ceb-4476-ba92-68e04e3158a5" (UID: "2e38b37c-5ceb-4476-ba92-68e04e3158a5"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 22:49:08.251927 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.251904 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "2e38b37c-5ceb-4476-ba92-68e04e3158a5" (UID: "2e38b37c-5ceb-4476-ba92-68e04e3158a5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:08.252019 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.251957 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e38b37c-5ceb-4476-ba92-68e04e3158a5-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2e38b37c-5ceb-4476-ba92-68e04e3158a5" (UID: "2e38b37c-5ceb-4476-ba92-68e04e3158a5"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 22:49:08.252436 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.252402 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "2e38b37c-5ceb-4476-ba92-68e04e3158a5" (UID: "2e38b37c-5ceb-4476-ba92-68e04e3158a5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:08.252553 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.252534 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e38b37c-5ceb-4476-ba92-68e04e3158a5-kube-api-access-llzlt" (OuterVolumeSpecName: "kube-api-access-llzlt") pod "2e38b37c-5ceb-4476-ba92-68e04e3158a5" (UID: "2e38b37c-5ceb-4476-ba92-68e04e3158a5"). InnerVolumeSpecName "kube-api-access-llzlt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 22:49:08.255297 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.255278 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "2e38b37c-5ceb-4476-ba92-68e04e3158a5" (UID: "2e38b37c-5ceb-4476-ba92-68e04e3158a5"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:08.261791 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.261756 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-web-config" (OuterVolumeSpecName: "web-config") pod "2e38b37c-5ceb-4476-ba92-68e04e3158a5" (UID: "2e38b37c-5ceb-4476-ba92-68e04e3158a5"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:08.349912 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.349877 2570 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2e38b37c-5ceb-4476-ba92-68e04e3158a5-tls-assets\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:08.349912 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.349908 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:08.349912 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.349919 2570 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-web-config\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:08.350132 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.349927 2570 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e38b37c-5ceb-4476-ba92-68e04e3158a5-metrics-client-ca\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:08.350132 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.349936 2570 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2e38b37c-5ceb-4476-ba92-68e04e3158a5-config-out\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:08.350132 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.349944 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:08.350132 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.349952 2570 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-config-volume\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:08.350132 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.349960 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llzlt\" (UniqueName: \"kubernetes.io/projected/2e38b37c-5ceb-4476-ba92-68e04e3158a5-kube-api-access-llzlt\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:08.350132 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.349968 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:08.350132 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.349976 2570 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-cluster-tls-config\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:08.350132 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.349984 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2e38b37c-5ceb-4476-ba92-68e04e3158a5-secret-alertmanager-main-tls\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:08.379058 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.379023 2570 generic.go:356] "Generic (PLEG): container finished" podID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerID="02cd721e96dbb59fcbf3b0d5820701800a6fc8986fcfd1e851c7833e1222da77" exitCode=0 Jul 29 22:49:08.379220 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.379095 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.379220 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.379099 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e38b37c-5ceb-4476-ba92-68e04e3158a5","Type":"ContainerDied","Data":"02cd721e96dbb59fcbf3b0d5820701800a6fc8986fcfd1e851c7833e1222da77"} Jul 29 22:49:08.379220 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.379167 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e38b37c-5ceb-4476-ba92-68e04e3158a5","Type":"ContainerDied","Data":"1ca988165392c0e598e292b458b4626e3543253687c621814a692f3d3e72edd8"} Jul 29 22:49:08.379220 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.379201 2570 scope.go:117] "RemoveContainer" containerID="42d86fab3e0b6739aa8b14eafc9b1966e901d4f5686d4d3f1ef76a35cb0326c2" Jul 29 22:49:08.387208 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.387091 2570 scope.go:117] "RemoveContainer" containerID="9915a05b57d8ec4a0d0ee658e5a0a0b5a0a4493d3c98bd13915d235c6a815c7f" Jul 29 22:49:08.394122 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.394100 2570 scope.go:117] "RemoveContainer" containerID="346ffd79e45445e2f1276623d71d7638dd39d544f8dcb5114512ea10129e6f55" Jul 29 22:49:08.400945 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.400918 2570 scope.go:117] "RemoveContainer" containerID="02cd721e96dbb59fcbf3b0d5820701800a6fc8986fcfd1e851c7833e1222da77" Jul 29 22:49:08.402785 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.402765 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 22:49:08.406716 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.406696 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 22:49:08.409207 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.409195 2570 scope.go:117] "RemoveContainer" containerID="27934e183d40a1724ab39c39a3b7a38ebfa718465840c308f2573e3d9cce9b69" Jul 29 22:49:08.415687 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.415671 2570 scope.go:117] "RemoveContainer" containerID="95ef6b471ac412f33375aae161e0e87ca229622e341cd6021e39b2277b9a9e3c" Jul 29 22:49:08.422346 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.422327 2570 scope.go:117] "RemoveContainer" containerID="c038dff4f10f2caac0d2d59848497fe4f857e73b28f8bcf9b6a26ff7f4ea3670" Jul 29 22:49:08.429412 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.429388 2570 scope.go:117] "RemoveContainer" containerID="42d86fab3e0b6739aa8b14eafc9b1966e901d4f5686d4d3f1ef76a35cb0326c2" Jul 29 22:49:08.429704 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:49:08.429682 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42d86fab3e0b6739aa8b14eafc9b1966e901d4f5686d4d3f1ef76a35cb0326c2\": container with ID starting with 42d86fab3e0b6739aa8b14eafc9b1966e901d4f5686d4d3f1ef76a35cb0326c2 not found: ID does not exist" containerID="42d86fab3e0b6739aa8b14eafc9b1966e901d4f5686d4d3f1ef76a35cb0326c2" Jul 29 22:49:08.429774 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.429715 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42d86fab3e0b6739aa8b14eafc9b1966e901d4f5686d4d3f1ef76a35cb0326c2"} err="failed to get container status \"42d86fab3e0b6739aa8b14eafc9b1966e901d4f5686d4d3f1ef76a35cb0326c2\": rpc error: code = NotFound desc = could not find container \"42d86fab3e0b6739aa8b14eafc9b1966e901d4f5686d4d3f1ef76a35cb0326c2\": container with ID starting with 42d86fab3e0b6739aa8b14eafc9b1966e901d4f5686d4d3f1ef76a35cb0326c2 not found: ID does not exist" Jul 29 22:49:08.429774 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.429733 2570 scope.go:117] "RemoveContainer" containerID="9915a05b57d8ec4a0d0ee658e5a0a0b5a0a4493d3c98bd13915d235c6a815c7f" Jul 29 22:49:08.429987 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:49:08.429970 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9915a05b57d8ec4a0d0ee658e5a0a0b5a0a4493d3c98bd13915d235c6a815c7f\": container with ID starting with 9915a05b57d8ec4a0d0ee658e5a0a0b5a0a4493d3c98bd13915d235c6a815c7f not found: ID does not exist" containerID="9915a05b57d8ec4a0d0ee658e5a0a0b5a0a4493d3c98bd13915d235c6a815c7f" Jul 29 22:49:08.430047 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.429996 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9915a05b57d8ec4a0d0ee658e5a0a0b5a0a4493d3c98bd13915d235c6a815c7f"} err="failed to get container status \"9915a05b57d8ec4a0d0ee658e5a0a0b5a0a4493d3c98bd13915d235c6a815c7f\": rpc error: code = NotFound desc = could not find container \"9915a05b57d8ec4a0d0ee658e5a0a0b5a0a4493d3c98bd13915d235c6a815c7f\": container with ID starting with 9915a05b57d8ec4a0d0ee658e5a0a0b5a0a4493d3c98bd13915d235c6a815c7f not found: ID does not exist" Jul 29 22:49:08.430047 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.430020 2570 scope.go:117] "RemoveContainer" containerID="346ffd79e45445e2f1276623d71d7638dd39d544f8dcb5114512ea10129e6f55" Jul 29 22:49:08.430256 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:49:08.430241 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"346ffd79e45445e2f1276623d71d7638dd39d544f8dcb5114512ea10129e6f55\": container with ID starting with 346ffd79e45445e2f1276623d71d7638dd39d544f8dcb5114512ea10129e6f55 not found: ID does not exist" containerID="346ffd79e45445e2f1276623d71d7638dd39d544f8dcb5114512ea10129e6f55" Jul 29 22:49:08.430291 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.430263 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"346ffd79e45445e2f1276623d71d7638dd39d544f8dcb5114512ea10129e6f55"} err="failed to get container status \"346ffd79e45445e2f1276623d71d7638dd39d544f8dcb5114512ea10129e6f55\": rpc error: code = NotFound desc = could not find container \"346ffd79e45445e2f1276623d71d7638dd39d544f8dcb5114512ea10129e6f55\": container with ID starting with 346ffd79e45445e2f1276623d71d7638dd39d544f8dcb5114512ea10129e6f55 not found: ID does not exist" Jul 29 22:49:08.430291 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.430277 2570 scope.go:117] "RemoveContainer" containerID="02cd721e96dbb59fcbf3b0d5820701800a6fc8986fcfd1e851c7833e1222da77" Jul 29 22:49:08.430511 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:49:08.430495 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02cd721e96dbb59fcbf3b0d5820701800a6fc8986fcfd1e851c7833e1222da77\": container with ID starting with 02cd721e96dbb59fcbf3b0d5820701800a6fc8986fcfd1e851c7833e1222da77 not found: ID does not exist" containerID="02cd721e96dbb59fcbf3b0d5820701800a6fc8986fcfd1e851c7833e1222da77" Jul 29 22:49:08.430571 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.430519 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02cd721e96dbb59fcbf3b0d5820701800a6fc8986fcfd1e851c7833e1222da77"} err="failed to get container status \"02cd721e96dbb59fcbf3b0d5820701800a6fc8986fcfd1e851c7833e1222da77\": rpc error: code = NotFound desc = could not find container \"02cd721e96dbb59fcbf3b0d5820701800a6fc8986fcfd1e851c7833e1222da77\": container with ID starting with 02cd721e96dbb59fcbf3b0d5820701800a6fc8986fcfd1e851c7833e1222da77 not found: ID does not exist" Jul 29 22:49:08.430571 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.430540 2570 scope.go:117] "RemoveContainer" containerID="27934e183d40a1724ab39c39a3b7a38ebfa718465840c308f2573e3d9cce9b69" Jul 29 22:49:08.430829 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:49:08.430793 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27934e183d40a1724ab39c39a3b7a38ebfa718465840c308f2573e3d9cce9b69\": container with ID starting with 27934e183d40a1724ab39c39a3b7a38ebfa718465840c308f2573e3d9cce9b69 not found: ID does not exist" containerID="27934e183d40a1724ab39c39a3b7a38ebfa718465840c308f2573e3d9cce9b69" Jul 29 22:49:08.430829 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.430819 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27934e183d40a1724ab39c39a3b7a38ebfa718465840c308f2573e3d9cce9b69"} err="failed to get container status \"27934e183d40a1724ab39c39a3b7a38ebfa718465840c308f2573e3d9cce9b69\": rpc error: code = NotFound desc = could not find container \"27934e183d40a1724ab39c39a3b7a38ebfa718465840c308f2573e3d9cce9b69\": container with ID starting with 27934e183d40a1724ab39c39a3b7a38ebfa718465840c308f2573e3d9cce9b69 not found: ID does not exist" Jul 29 22:49:08.430829 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.430834 2570 scope.go:117] "RemoveContainer" containerID="95ef6b471ac412f33375aae161e0e87ca229622e341cd6021e39b2277b9a9e3c" Jul 29 22:49:08.431320 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:49:08.431268 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95ef6b471ac412f33375aae161e0e87ca229622e341cd6021e39b2277b9a9e3c\": container with ID starting with 95ef6b471ac412f33375aae161e0e87ca229622e341cd6021e39b2277b9a9e3c not found: ID does not exist" containerID="95ef6b471ac412f33375aae161e0e87ca229622e341cd6021e39b2277b9a9e3c" Jul 29 22:49:08.431415 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.431320 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95ef6b471ac412f33375aae161e0e87ca229622e341cd6021e39b2277b9a9e3c"} err="failed to get container status \"95ef6b471ac412f33375aae161e0e87ca229622e341cd6021e39b2277b9a9e3c\": rpc error: code = NotFound desc = could not find container \"95ef6b471ac412f33375aae161e0e87ca229622e341cd6021e39b2277b9a9e3c\": container with ID starting with 95ef6b471ac412f33375aae161e0e87ca229622e341cd6021e39b2277b9a9e3c not found: ID does not exist" Jul 29 22:49:08.431415 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.431340 2570 scope.go:117] "RemoveContainer" containerID="c038dff4f10f2caac0d2d59848497fe4f857e73b28f8bcf9b6a26ff7f4ea3670" Jul 29 22:49:08.431674 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:49:08.431601 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c038dff4f10f2caac0d2d59848497fe4f857e73b28f8bcf9b6a26ff7f4ea3670\": container with ID starting with c038dff4f10f2caac0d2d59848497fe4f857e73b28f8bcf9b6a26ff7f4ea3670 not found: ID does not exist" containerID="c038dff4f10f2caac0d2d59848497fe4f857e73b28f8bcf9b6a26ff7f4ea3670" Jul 29 22:49:08.431674 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.431658 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c038dff4f10f2caac0d2d59848497fe4f857e73b28f8bcf9b6a26ff7f4ea3670"} err="failed to get container status \"c038dff4f10f2caac0d2d59848497fe4f857e73b28f8bcf9b6a26ff7f4ea3670\": rpc error: code = NotFound desc = could not find container \"c038dff4f10f2caac0d2d59848497fe4f857e73b28f8bcf9b6a26ff7f4ea3670\": container with ID starting with c038dff4f10f2caac0d2d59848497fe4f857e73b28f8bcf9b6a26ff7f4ea3670 not found: ID does not exist" Jul 29 22:49:08.433229 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.433210 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 22:49:08.433487 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.433476 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="930c892f-30bf-4c89-bd0f-08b8d28007fa" containerName="console" Jul 29 22:49:08.433525 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.433489 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="930c892f-30bf-4c89-bd0f-08b8d28007fa" containerName="console" Jul 29 22:49:08.433525 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.433497 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerName="prom-label-proxy" Jul 29 22:49:08.433525 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.433503 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerName="prom-label-proxy" Jul 29 22:49:08.433525 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.433512 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerName="kube-rbac-proxy-metric" Jul 29 22:49:08.433525 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.433518 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerName="kube-rbac-proxy-metric" Jul 29 22:49:08.433525 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.433523 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7247d701-618f-44d3-8ca1-addb0d93d30e" containerName="console" Jul 29 22:49:08.433708 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.433652 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7247d701-618f-44d3-8ca1-addb0d93d30e" containerName="console" Jul 29 22:49:08.433708 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.433669 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerName="init-config-reloader" Jul 29 22:49:08.433708 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.433677 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerName="init-config-reloader" Jul 29 22:49:08.433708 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.433687 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerName="kube-rbac-proxy-web" Jul 29 22:49:08.433708 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.433694 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerName="kube-rbac-proxy-web" Jul 29 22:49:08.433708 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.433703 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerName="alertmanager" Jul 29 22:49:08.433870 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.433710 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerName="alertmanager" Jul 29 22:49:08.433870 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.433721 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerName="kube-rbac-proxy" Jul 29 22:49:08.433870 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.433727 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerName="kube-rbac-proxy" Jul 29 22:49:08.433870 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.433744 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerName="config-reloader" Jul 29 22:49:08.433870 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.433752 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerName="config-reloader" Jul 29 22:49:08.433870 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.433819 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerName="prom-label-proxy" Jul 29 22:49:08.433870 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.433831 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerName="kube-rbac-proxy-web" Jul 29 22:49:08.433870 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.433840 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerName="alertmanager" Jul 29 22:49:08.433870 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.433848 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7247d701-618f-44d3-8ca1-addb0d93d30e" containerName="console" Jul 29 22:49:08.433870 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.433856 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerName="kube-rbac-proxy" Jul 29 22:49:08.433870 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.433864 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerName="kube-rbac-proxy-metric" Jul 29 22:49:08.433870 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.433871 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" containerName="config-reloader" Jul 29 22:49:08.434178 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.433880 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="930c892f-30bf-4c89-bd0f-08b8d28007fa" containerName="console" Jul 29 22:49:08.436008 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.435996 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.439669 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.439655 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 29 22:49:08.439896 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.439878 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 29 22:49:08.439968 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.439884 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 29 22:49:08.440021 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.440005 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 29 22:49:08.440157 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.440140 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-lzsrw\"" Jul 29 22:49:08.440258 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.440245 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 29 22:49:08.440443 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.440431 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 29 22:49:08.441097 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.441083 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 29 22:49:08.441554 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.441500 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 29 22:49:08.445103 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.445085 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 29 22:49:08.453256 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.453234 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 22:49:08.506436 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.506358 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e38b37c-5ceb-4476-ba92-68e04e3158a5" path="/var/lib/kubelet/pods/2e38b37c-5ceb-4476-ba92-68e04e3158a5/volumes" Jul 29 22:49:08.551407 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.551378 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/54411db9-f2e1-4c5e-ae8e-006df158cda2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.551559 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.551417 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54411db9-f2e1-4c5e-ae8e-006df158cda2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.551559 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.551451 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/54411db9-f2e1-4c5e-ae8e-006df158cda2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.551559 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.551540 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54411db9-f2e1-4c5e-ae8e-006df158cda2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.551757 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.551599 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54411db9-f2e1-4c5e-ae8e-006df158cda2-config-out\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.551757 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.551661 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/54411db9-f2e1-4c5e-ae8e-006df158cda2-config-volume\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.551757 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.551698 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54411db9-f2e1-4c5e-ae8e-006df158cda2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.551757 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.551738 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54411db9-f2e1-4c5e-ae8e-006df158cda2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.551940 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.551771 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54411db9-f2e1-4c5e-ae8e-006df158cda2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.551940 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.551799 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjt7q\" (UniqueName: \"kubernetes.io/projected/54411db9-f2e1-4c5e-ae8e-006df158cda2-kube-api-access-rjt7q\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.551940 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.551838 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54411db9-f2e1-4c5e-ae8e-006df158cda2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.551940 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.551861 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54411db9-f2e1-4c5e-ae8e-006df158cda2-web-config\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.551940 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.551884 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/54411db9-f2e1-4c5e-ae8e-006df158cda2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.652274 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.652238 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54411db9-f2e1-4c5e-ae8e-006df158cda2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.652274 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.652272 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54411db9-f2e1-4c5e-ae8e-006df158cda2-web-config\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.652512 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.652287 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/54411db9-f2e1-4c5e-ae8e-006df158cda2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.652512 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.652309 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/54411db9-f2e1-4c5e-ae8e-006df158cda2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.652512 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.652328 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54411db9-f2e1-4c5e-ae8e-006df158cda2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.652512 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.652361 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/54411db9-f2e1-4c5e-ae8e-006df158cda2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.652512 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.652494 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54411db9-f2e1-4c5e-ae8e-006df158cda2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.652766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.652555 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54411db9-f2e1-4c5e-ae8e-006df158cda2-config-out\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.652766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.652589 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/54411db9-f2e1-4c5e-ae8e-006df158cda2-config-volume\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.652766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.652622 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54411db9-f2e1-4c5e-ae8e-006df158cda2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.652766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.652676 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54411db9-f2e1-4c5e-ae8e-006df158cda2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.652766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.652701 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54411db9-f2e1-4c5e-ae8e-006df158cda2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.652766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.652729 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjt7q\" (UniqueName: \"kubernetes.io/projected/54411db9-f2e1-4c5e-ae8e-006df158cda2-kube-api-access-rjt7q\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.653047 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.652888 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/54411db9-f2e1-4c5e-ae8e-006df158cda2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.654443 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.653427 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54411db9-f2e1-4c5e-ae8e-006df158cda2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.654443 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.654176 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54411db9-f2e1-4c5e-ae8e-006df158cda2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.655421 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.655397 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54411db9-f2e1-4c5e-ae8e-006df158cda2-web-config\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.655530 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.655487 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54411db9-f2e1-4c5e-ae8e-006df158cda2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.655530 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.655499 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/54411db9-f2e1-4c5e-ae8e-006df158cda2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.655679 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.655554 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54411db9-f2e1-4c5e-ae8e-006df158cda2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.655679 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.655595 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54411db9-f2e1-4c5e-ae8e-006df158cda2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.655807 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.655791 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/54411db9-f2e1-4c5e-ae8e-006df158cda2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.655848 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.655807 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54411db9-f2e1-4c5e-ae8e-006df158cda2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.656351 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.656330 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54411db9-f2e1-4c5e-ae8e-006df158cda2-config-out\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.657193 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.657173 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/54411db9-f2e1-4c5e-ae8e-006df158cda2-config-volume\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.660948 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.660932 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjt7q\" (UniqueName: \"kubernetes.io/projected/54411db9-f2e1-4c5e-ae8e-006df158cda2-kube-api-access-rjt7q\") pod \"alertmanager-main-0\" (UID: \"54411db9-f2e1-4c5e-ae8e-006df158cda2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.745546 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.745519 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:08.875917 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:08.875890 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 22:49:08.878565 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:49:08.878543 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54411db9_f2e1_4c5e_ae8e_006df158cda2.slice/crio-3b9e0632fe6e7ecf97c709f5617b1b451a28f26217355c4ccfda623a01fbbd6d WatchSource:0}: Error finding container 3b9e0632fe6e7ecf97c709f5617b1b451a28f26217355c4ccfda623a01fbbd6d: Status 404 returned error can't find the container with id 3b9e0632fe6e7ecf97c709f5617b1b451a28f26217355c4ccfda623a01fbbd6d Jul 29 22:49:09.388202 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:09.388169 2570 generic.go:356] "Generic (PLEG): container finished" podID="54411db9-f2e1-4c5e-ae8e-006df158cda2" containerID="3465bcd38b308fcd2882bdde32731921179100380e3d6c54e907cf0c1dfdc4e9" exitCode=0 Jul 29 22:49:09.388624 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:09.388262 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54411db9-f2e1-4c5e-ae8e-006df158cda2","Type":"ContainerDied","Data":"3465bcd38b308fcd2882bdde32731921179100380e3d6c54e907cf0c1dfdc4e9"} Jul 29 22:49:09.388624 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:09.388366 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54411db9-f2e1-4c5e-ae8e-006df158cda2","Type":"ContainerStarted","Data":"3b9e0632fe6e7ecf97c709f5617b1b451a28f26217355c4ccfda623a01fbbd6d"} Jul 29 22:49:10.395737 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:10.395701 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54411db9-f2e1-4c5e-ae8e-006df158cda2","Type":"ContainerStarted","Data":"b00e6e8ad7da8d512aa464240582b22248c074d126c8d8943e59e560cdfab0dd"} Jul 29 22:49:10.396159 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:10.395766 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54411db9-f2e1-4c5e-ae8e-006df158cda2","Type":"ContainerStarted","Data":"49c4a064719452294c52e38d374c4e36546ccea45232dde557c3d5785950764e"} Jul 29 22:49:10.396159 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:10.395789 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54411db9-f2e1-4c5e-ae8e-006df158cda2","Type":"ContainerStarted","Data":"5b346e52c9ed997f6e13513cd54e72a75be31a68223ad2f954f15f635d1566e4"} Jul 29 22:49:10.396159 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:10.395812 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54411db9-f2e1-4c5e-ae8e-006df158cda2","Type":"ContainerStarted","Data":"e31cef8e0bba7e1833a967417d8ce3802b453b44427a9ab394f6c24d75679ec2"} Jul 29 22:49:10.396159 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:10.395837 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54411db9-f2e1-4c5e-ae8e-006df158cda2","Type":"ContainerStarted","Data":"4d7d9015e55bebff3a76151c6617310e6782f84a42031f37c199a9eb403a7444"} Jul 29 22:49:10.396159 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:10.395858 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54411db9-f2e1-4c5e-ae8e-006df158cda2","Type":"ContainerStarted","Data":"15f6e9ce9060cfcb434f4ba6060272a38dd0c30af263dffac6179f82336a3e9c"} Jul 29 22:49:10.424408 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:10.424345 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.409059164 podStartE2EDuration="2.424324204s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.26504ms" isStatefulPod=false podCreationTimestamp="2026-07-29 22:49:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:49:10.422827723 +0000 UTC m=+160.378923575" watchObservedRunningTime="2026-07-29 22:49:10.424324204 +0000 UTC m=+160.380420058" Jul 29 22:49:11.287105 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.287069 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 22:49:11.287552 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.287383 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerName="prometheus" containerID="cri-o://5086bad078bd4dd0a24f6d7c0cc3644747f5eca703b7250b5629126db1997983" gracePeriod=600 Jul 29 22:49:11.287552 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.287405 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerName="kube-rbac-proxy" containerID="cri-o://f1c3d85629ea5379e8534995b0ca7e4f50a8c14b4cd2867ae8a67cd48ce2aae1" gracePeriod=600 Jul 29 22:49:11.287552 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.287425 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerName="config-reloader" containerID="cri-o://514fa581be1664a0f6f6a13fef1553fc61c84c9e79d97f46d5c7658be576ec3f" gracePeriod=600 Jul 29 22:49:11.287552 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.287471 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerName="kube-rbac-proxy-web" containerID="cri-o://d73873003f2772f89f3a7e77829d5325b1819db8a802e5231c6aabb2a30a820a" gracePeriod=600 Jul 29 22:49:11.287552 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.287487 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerName="kube-rbac-proxy-thanos" containerID="cri-o://34506760c65c126b7e22dde19c234de02413a613785de879a48b219eb3942afe" gracePeriod=600 Jul 29 22:49:11.287874 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.287426 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerName="thanos-sidecar" containerID="cri-o://45b8701c7476b5e461a0b737ad1d1d1a7fe8d60d1981d51a556863dd4f573377" gracePeriod=600 Jul 29 22:49:11.405156 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.405131 2570 generic.go:356] "Generic (PLEG): container finished" podID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerID="d73873003f2772f89f3a7e77829d5325b1819db8a802e5231c6aabb2a30a820a" exitCode=0 Jul 29 22:49:11.405156 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.405152 2570 generic.go:356] "Generic (PLEG): container finished" podID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerID="514fa581be1664a0f6f6a13fef1553fc61c84c9e79d97f46d5c7658be576ec3f" exitCode=0 Jul 29 22:49:11.405510 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.405202 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dea35e65-a3d8-4028-85a4-8436bee84a11","Type":"ContainerDied","Data":"d73873003f2772f89f3a7e77829d5325b1819db8a802e5231c6aabb2a30a820a"} Jul 29 22:49:11.405510 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.405263 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dea35e65-a3d8-4028-85a4-8436bee84a11","Type":"ContainerDied","Data":"514fa581be1664a0f6f6a13fef1553fc61c84c9e79d97f46d5c7658be576ec3f"} Jul 29 22:49:11.518219 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.518193 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:11.679688 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.679580 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-prometheus-k8s-rulefiles-0\") pod \"dea35e65-a3d8-4028-85a4-8436bee84a11\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " Jul 29 22:49:11.679688 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.679621 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-configmap-kubelet-serving-ca-bundle\") pod \"dea35e65-a3d8-4028-85a4-8436bee84a11\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " Jul 29 22:49:11.679688 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.679674 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-prometheus-k8s-tls\") pod \"dea35e65-a3d8-4028-85a4-8436bee84a11\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " Jul 29 22:49:11.679688 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.679689 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-kube-rbac-proxy\") pod \"dea35e65-a3d8-4028-85a4-8436bee84a11\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " Jul 29 22:49:11.679982 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.679726 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-grpc-tls\") pod \"dea35e65-a3d8-4028-85a4-8436bee84a11\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " Jul 29 22:49:11.679982 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.679753 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-prometheus-trusted-ca-bundle\") pod \"dea35e65-a3d8-4028-85a4-8436bee84a11\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " Jul 29 22:49:11.679982 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.679787 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"dea35e65-a3d8-4028-85a4-8436bee84a11\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " Jul 29 22:49:11.679982 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.679811 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-web-config\") pod \"dea35e65-a3d8-4028-85a4-8436bee84a11\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " Jul 29 22:49:11.679982 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.679836 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-configmap-metrics-client-ca\") pod \"dea35e65-a3d8-4028-85a4-8436bee84a11\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " Jul 29 22:49:11.679982 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.679873 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-prometheus-k8s-rulefiles-2\") pod \"dea35e65-a3d8-4028-85a4-8436bee84a11\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " Jul 29 22:49:11.679982 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.679898 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"dea35e65-a3d8-4028-85a4-8436bee84a11\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " Jul 29 22:49:11.679982 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.679922 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kk9v8\" (UniqueName: \"kubernetes.io/projected/dea35e65-a3d8-4028-85a4-8436bee84a11-kube-api-access-kk9v8\") pod \"dea35e65-a3d8-4028-85a4-8436bee84a11\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " Jul 29 22:49:11.679982 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.679948 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-metrics-client-certs\") pod \"dea35e65-a3d8-4028-85a4-8436bee84a11\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " Jul 29 22:49:11.679982 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.679980 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dea35e65-a3d8-4028-85a4-8436bee84a11-tls-assets\") pod \"dea35e65-a3d8-4028-85a4-8436bee84a11\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " Jul 29 22:49:11.680401 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.680003 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-configmap-serving-certs-ca-bundle\") pod \"dea35e65-a3d8-4028-85a4-8436bee84a11\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " Jul 29 22:49:11.680401 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.680033 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dea35e65-a3d8-4028-85a4-8436bee84a11-config-out\") pod \"dea35e65-a3d8-4028-85a4-8436bee84a11\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " Jul 29 22:49:11.680401 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.680066 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-prometheus-k8s-rulefiles-1\") pod \"dea35e65-a3d8-4028-85a4-8436bee84a11\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " Jul 29 22:49:11.680401 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.680096 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-thanos-prometheus-http-client-file\") pod \"dea35e65-a3d8-4028-85a4-8436bee84a11\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " Jul 29 22:49:11.680401 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.680125 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-config\") pod \"dea35e65-a3d8-4028-85a4-8436bee84a11\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " Jul 29 22:49:11.680401 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.680168 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dea35e65-a3d8-4028-85a4-8436bee84a11-prometheus-k8s-db\") pod \"dea35e65-a3d8-4028-85a4-8436bee84a11\" (UID: \"dea35e65-a3d8-4028-85a4-8436bee84a11\") " Jul 29 22:49:11.680692 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.680500 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "dea35e65-a3d8-4028-85a4-8436bee84a11" (UID: "dea35e65-a3d8-4028-85a4-8436bee84a11"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:49:11.680802 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.680781 2570 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:11.681177 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.680339 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "dea35e65-a3d8-4028-85a4-8436bee84a11" (UID: "dea35e65-a3d8-4028-85a4-8436bee84a11"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:49:11.681177 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.681067 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "dea35e65-a3d8-4028-85a4-8436bee84a11" (UID: "dea35e65-a3d8-4028-85a4-8436bee84a11"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:49:11.681341 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.681190 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "dea35e65-a3d8-4028-85a4-8436bee84a11" (UID: "dea35e65-a3d8-4028-85a4-8436bee84a11"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:49:11.681341 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.681289 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dea35e65-a3d8-4028-85a4-8436bee84a11-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "dea35e65-a3d8-4028-85a4-8436bee84a11" (UID: "dea35e65-a3d8-4028-85a4-8436bee84a11"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 22:49:11.682523 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.682488 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "dea35e65-a3d8-4028-85a4-8436bee84a11" (UID: "dea35e65-a3d8-4028-85a4-8436bee84a11"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:11.682523 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.682511 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "dea35e65-a3d8-4028-85a4-8436bee84a11" (UID: "dea35e65-a3d8-4028-85a4-8436bee84a11"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:11.682693 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.682541 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "dea35e65-a3d8-4028-85a4-8436bee84a11" (UID: "dea35e65-a3d8-4028-85a4-8436bee84a11"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:11.683004 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.682973 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "dea35e65-a3d8-4028-85a4-8436bee84a11" (UID: "dea35e65-a3d8-4028-85a4-8436bee84a11"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:11.683411 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.683387 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "dea35e65-a3d8-4028-85a4-8436bee84a11" (UID: "dea35e65-a3d8-4028-85a4-8436bee84a11"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:49:11.683937 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.683571 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "dea35e65-a3d8-4028-85a4-8436bee84a11" (UID: "dea35e65-a3d8-4028-85a4-8436bee84a11"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:11.683937 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.683647 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dea35e65-a3d8-4028-85a4-8436bee84a11-config-out" (OuterVolumeSpecName: "config-out") pod "dea35e65-a3d8-4028-85a4-8436bee84a11" (UID: "dea35e65-a3d8-4028-85a4-8436bee84a11"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 22:49:11.683937 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.683733 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "dea35e65-a3d8-4028-85a4-8436bee84a11" (UID: "dea35e65-a3d8-4028-85a4-8436bee84a11"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:49:11.684121 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.683953 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "dea35e65-a3d8-4028-85a4-8436bee84a11" (UID: "dea35e65-a3d8-4028-85a4-8436bee84a11"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:49:11.684121 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.684057 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dea35e65-a3d8-4028-85a4-8436bee84a11-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "dea35e65-a3d8-4028-85a4-8436bee84a11" (UID: "dea35e65-a3d8-4028-85a4-8436bee84a11"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 22:49:11.684577 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.684555 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "dea35e65-a3d8-4028-85a4-8436bee84a11" (UID: "dea35e65-a3d8-4028-85a4-8436bee84a11"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:11.684653 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.684613 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-config" (OuterVolumeSpecName: "config") pod "dea35e65-a3d8-4028-85a4-8436bee84a11" (UID: "dea35e65-a3d8-4028-85a4-8436bee84a11"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:11.684792 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.684775 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dea35e65-a3d8-4028-85a4-8436bee84a11-kube-api-access-kk9v8" (OuterVolumeSpecName: "kube-api-access-kk9v8") pod "dea35e65-a3d8-4028-85a4-8436bee84a11" (UID: "dea35e65-a3d8-4028-85a4-8436bee84a11"). InnerVolumeSpecName "kube-api-access-kk9v8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 22:49:11.685420 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.685404 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "dea35e65-a3d8-4028-85a4-8436bee84a11" (UID: "dea35e65-a3d8-4028-85a4-8436bee84a11"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:11.693357 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.693332 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-web-config" (OuterVolumeSpecName: "web-config") pod "dea35e65-a3d8-4028-85a4-8436bee84a11" (UID: "dea35e65-a3d8-4028-85a4-8436bee84a11"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:11.781927 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.781893 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:11.781927 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.781924 2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:11.781927 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.781934 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kk9v8\" (UniqueName: \"kubernetes.io/projected/dea35e65-a3d8-4028-85a4-8436bee84a11-kube-api-access-kk9v8\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:11.782149 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.781943 2570 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-metrics-client-certs\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:11.782149 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.781952 2570 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dea35e65-a3d8-4028-85a4-8436bee84a11-tls-assets\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:11.782149 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.781960 2570 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:11.782149 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.781969 2570 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dea35e65-a3d8-4028-85a4-8436bee84a11-config-out\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:11.782149 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.781978 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:11.782149 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.781986 2570 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:11.782149 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.781994 2570 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-config\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:11.782149 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.782002 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dea35e65-a3d8-4028-85a4-8436bee84a11-prometheus-k8s-db\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:11.782149 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.782012 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:11.782149 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.782021 2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:11.782149 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.782030 2570 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-kube-rbac-proxy\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:11.782149 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.782038 2570 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-grpc-tls\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:11.782149 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.782045 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:11.782149 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.782053 2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:11.782149 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.782061 2570 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dea35e65-a3d8-4028-85a4-8436bee84a11-web-config\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:11.782149 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:11.782069 2570 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dea35e65-a3d8-4028-85a4-8436bee84a11-configmap-metrics-client-ca\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 22:49:12.413216 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.413183 2570 generic.go:356] "Generic (PLEG): container finished" podID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerID="34506760c65c126b7e22dde19c234de02413a613785de879a48b219eb3942afe" exitCode=0 Jul 29 22:49:12.413216 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.413204 2570 generic.go:356] "Generic (PLEG): container finished" podID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerID="f1c3d85629ea5379e8534995b0ca7e4f50a8c14b4cd2867ae8a67cd48ce2aae1" exitCode=0 Jul 29 22:49:12.413216 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.413210 2570 generic.go:356] "Generic (PLEG): container finished" podID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerID="45b8701c7476b5e461a0b737ad1d1d1a7fe8d60d1981d51a556863dd4f573377" exitCode=0 Jul 29 22:49:12.413216 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.413216 2570 generic.go:356] "Generic (PLEG): container finished" podID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerID="5086bad078bd4dd0a24f6d7c0cc3644747f5eca703b7250b5629126db1997983" exitCode=0 Jul 29 22:49:12.413737 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.413259 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.413737 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.413263 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dea35e65-a3d8-4028-85a4-8436bee84a11","Type":"ContainerDied","Data":"34506760c65c126b7e22dde19c234de02413a613785de879a48b219eb3942afe"} Jul 29 22:49:12.413737 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.413344 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dea35e65-a3d8-4028-85a4-8436bee84a11","Type":"ContainerDied","Data":"f1c3d85629ea5379e8534995b0ca7e4f50a8c14b4cd2867ae8a67cd48ce2aae1"} Jul 29 22:49:12.413737 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.413386 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dea35e65-a3d8-4028-85a4-8436bee84a11","Type":"ContainerDied","Data":"45b8701c7476b5e461a0b737ad1d1d1a7fe8d60d1981d51a556863dd4f573377"} Jul 29 22:49:12.413737 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.413409 2570 scope.go:117] "RemoveContainer" containerID="34506760c65c126b7e22dde19c234de02413a613785de879a48b219eb3942afe" Jul 29 22:49:12.413737 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.413429 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dea35e65-a3d8-4028-85a4-8436bee84a11","Type":"ContainerDied","Data":"5086bad078bd4dd0a24f6d7c0cc3644747f5eca703b7250b5629126db1997983"} Jul 29 22:49:12.413737 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.413469 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dea35e65-a3d8-4028-85a4-8436bee84a11","Type":"ContainerDied","Data":"65f64aaf6a5491d9e40ffd1e5292bc655b2e06891f220cdfe14aa716031f29b5"} Jul 29 22:49:12.421394 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.421376 2570 scope.go:117] "RemoveContainer" containerID="f1c3d85629ea5379e8534995b0ca7e4f50a8c14b4cd2867ae8a67cd48ce2aae1" Jul 29 22:49:12.428743 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.428725 2570 scope.go:117] "RemoveContainer" containerID="d73873003f2772f89f3a7e77829d5325b1819db8a802e5231c6aabb2a30a820a" Jul 29 22:49:12.436291 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.436267 2570 scope.go:117] "RemoveContainer" containerID="45b8701c7476b5e461a0b737ad1d1d1a7fe8d60d1981d51a556863dd4f573377" Jul 29 22:49:12.437965 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.437939 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 22:49:12.441913 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.441886 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 22:49:12.444525 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.444510 2570 scope.go:117] "RemoveContainer" containerID="514fa581be1664a0f6f6a13fef1553fc61c84c9e79d97f46d5c7658be576ec3f" Jul 29 22:49:12.451252 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.451233 2570 scope.go:117] "RemoveContainer" containerID="5086bad078bd4dd0a24f6d7c0cc3644747f5eca703b7250b5629126db1997983" Jul 29 22:49:12.458339 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.458323 2570 scope.go:117] "RemoveContainer" containerID="3508968db139fc742e22aae909614d8e75d740ef3f3ac9ada137de25322d71c7" Jul 29 22:49:12.464659 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.464625 2570 scope.go:117] "RemoveContainer" containerID="34506760c65c126b7e22dde19c234de02413a613785de879a48b219eb3942afe" Jul 29 22:49:12.464929 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:49:12.464907 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34506760c65c126b7e22dde19c234de02413a613785de879a48b219eb3942afe\": container with ID starting with 34506760c65c126b7e22dde19c234de02413a613785de879a48b219eb3942afe not found: ID does not exist" containerID="34506760c65c126b7e22dde19c234de02413a613785de879a48b219eb3942afe" Jul 29 22:49:12.464975 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.464937 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34506760c65c126b7e22dde19c234de02413a613785de879a48b219eb3942afe"} err="failed to get container status \"34506760c65c126b7e22dde19c234de02413a613785de879a48b219eb3942afe\": rpc error: code = NotFound desc = could not find container \"34506760c65c126b7e22dde19c234de02413a613785de879a48b219eb3942afe\": container with ID starting with 34506760c65c126b7e22dde19c234de02413a613785de879a48b219eb3942afe not found: ID does not exist" Jul 29 22:49:12.464975 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.464956 2570 scope.go:117] "RemoveContainer" containerID="f1c3d85629ea5379e8534995b0ca7e4f50a8c14b4cd2867ae8a67cd48ce2aae1" Jul 29 22:49:12.465179 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:49:12.465163 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1c3d85629ea5379e8534995b0ca7e4f50a8c14b4cd2867ae8a67cd48ce2aae1\": container with ID starting with f1c3d85629ea5379e8534995b0ca7e4f50a8c14b4cd2867ae8a67cd48ce2aae1 not found: ID does not exist" containerID="f1c3d85629ea5379e8534995b0ca7e4f50a8c14b4cd2867ae8a67cd48ce2aae1" Jul 29 22:49:12.465214 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.465185 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1c3d85629ea5379e8534995b0ca7e4f50a8c14b4cd2867ae8a67cd48ce2aae1"} err="failed to get container status \"f1c3d85629ea5379e8534995b0ca7e4f50a8c14b4cd2867ae8a67cd48ce2aae1\": rpc error: code = NotFound desc = could not find container \"f1c3d85629ea5379e8534995b0ca7e4f50a8c14b4cd2867ae8a67cd48ce2aae1\": container with ID starting with f1c3d85629ea5379e8534995b0ca7e4f50a8c14b4cd2867ae8a67cd48ce2aae1 not found: ID does not exist" Jul 29 22:49:12.465214 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.465202 2570 scope.go:117] "RemoveContainer" containerID="d73873003f2772f89f3a7e77829d5325b1819db8a802e5231c6aabb2a30a820a" Jul 29 22:49:12.465451 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:49:12.465432 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d73873003f2772f89f3a7e77829d5325b1819db8a802e5231c6aabb2a30a820a\": container with ID starting with d73873003f2772f89f3a7e77829d5325b1819db8a802e5231c6aabb2a30a820a not found: ID does not exist" containerID="d73873003f2772f89f3a7e77829d5325b1819db8a802e5231c6aabb2a30a820a" Jul 29 22:49:12.465505 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.465455 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d73873003f2772f89f3a7e77829d5325b1819db8a802e5231c6aabb2a30a820a"} err="failed to get container status \"d73873003f2772f89f3a7e77829d5325b1819db8a802e5231c6aabb2a30a820a\": rpc error: code = NotFound desc = could not find container \"d73873003f2772f89f3a7e77829d5325b1819db8a802e5231c6aabb2a30a820a\": container with ID starting with d73873003f2772f89f3a7e77829d5325b1819db8a802e5231c6aabb2a30a820a not found: ID does not exist" Jul 29 22:49:12.465505 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.465470 2570 scope.go:117] "RemoveContainer" containerID="45b8701c7476b5e461a0b737ad1d1d1a7fe8d60d1981d51a556863dd4f573377" Jul 29 22:49:12.465736 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:49:12.465711 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45b8701c7476b5e461a0b737ad1d1d1a7fe8d60d1981d51a556863dd4f573377\": container with ID starting with 45b8701c7476b5e461a0b737ad1d1d1a7fe8d60d1981d51a556863dd4f573377 not found: ID does not exist" containerID="45b8701c7476b5e461a0b737ad1d1d1a7fe8d60d1981d51a556863dd4f573377" Jul 29 22:49:12.465825 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.465741 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45b8701c7476b5e461a0b737ad1d1d1a7fe8d60d1981d51a556863dd4f573377"} err="failed to get container status \"45b8701c7476b5e461a0b737ad1d1d1a7fe8d60d1981d51a556863dd4f573377\": rpc error: code = NotFound desc = could not find container \"45b8701c7476b5e461a0b737ad1d1d1a7fe8d60d1981d51a556863dd4f573377\": container with ID starting with 45b8701c7476b5e461a0b737ad1d1d1a7fe8d60d1981d51a556863dd4f573377 not found: ID does not exist" Jul 29 22:49:12.465825 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.465762 2570 scope.go:117] "RemoveContainer" containerID="514fa581be1664a0f6f6a13fef1553fc61c84c9e79d97f46d5c7658be576ec3f" Jul 29 22:49:12.466025 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:49:12.466006 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"514fa581be1664a0f6f6a13fef1553fc61c84c9e79d97f46d5c7658be576ec3f\": container with ID starting with 514fa581be1664a0f6f6a13fef1553fc61c84c9e79d97f46d5c7658be576ec3f not found: ID does not exist" containerID="514fa581be1664a0f6f6a13fef1553fc61c84c9e79d97f46d5c7658be576ec3f" Jul 29 22:49:12.466025 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.466034 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"514fa581be1664a0f6f6a13fef1553fc61c84c9e79d97f46d5c7658be576ec3f"} err="failed to get container status \"514fa581be1664a0f6f6a13fef1553fc61c84c9e79d97f46d5c7658be576ec3f\": rpc error: code = NotFound desc = could not find container \"514fa581be1664a0f6f6a13fef1553fc61c84c9e79d97f46d5c7658be576ec3f\": container with ID starting with 514fa581be1664a0f6f6a13fef1553fc61c84c9e79d97f46d5c7658be576ec3f not found: ID does not exist" Jul 29 22:49:12.466025 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.466054 2570 scope.go:117] "RemoveContainer" containerID="5086bad078bd4dd0a24f6d7c0cc3644747f5eca703b7250b5629126db1997983" Jul 29 22:49:12.466445 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:49:12.466408 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5086bad078bd4dd0a24f6d7c0cc3644747f5eca703b7250b5629126db1997983\": container with ID starting with 5086bad078bd4dd0a24f6d7c0cc3644747f5eca703b7250b5629126db1997983 not found: ID does not exist" containerID="5086bad078bd4dd0a24f6d7c0cc3644747f5eca703b7250b5629126db1997983" Jul 29 22:49:12.466540 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.466438 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5086bad078bd4dd0a24f6d7c0cc3644747f5eca703b7250b5629126db1997983"} err="failed to get container status \"5086bad078bd4dd0a24f6d7c0cc3644747f5eca703b7250b5629126db1997983\": rpc error: code = NotFound desc = could not find container \"5086bad078bd4dd0a24f6d7c0cc3644747f5eca703b7250b5629126db1997983\": container with ID starting with 5086bad078bd4dd0a24f6d7c0cc3644747f5eca703b7250b5629126db1997983 not found: ID does not exist" Jul 29 22:49:12.466540 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.466457 2570 scope.go:117] "RemoveContainer" containerID="3508968db139fc742e22aae909614d8e75d740ef3f3ac9ada137de25322d71c7" Jul 29 22:49:12.466758 ip-10-0-138-44 kubenswrapper[2570]: E0729 22:49:12.466733 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3508968db139fc742e22aae909614d8e75d740ef3f3ac9ada137de25322d71c7\": container with ID starting with 3508968db139fc742e22aae909614d8e75d740ef3f3ac9ada137de25322d71c7 not found: ID does not exist" containerID="3508968db139fc742e22aae909614d8e75d740ef3f3ac9ada137de25322d71c7" Jul 29 22:49:12.466826 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.466761 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3508968db139fc742e22aae909614d8e75d740ef3f3ac9ada137de25322d71c7"} err="failed to get container status \"3508968db139fc742e22aae909614d8e75d740ef3f3ac9ada137de25322d71c7\": rpc error: code = NotFound desc = could not find container \"3508968db139fc742e22aae909614d8e75d740ef3f3ac9ada137de25322d71c7\": container with ID starting with 3508968db139fc742e22aae909614d8e75d740ef3f3ac9ada137de25322d71c7 not found: ID does not exist" Jul 29 22:49:12.466826 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.466782 2570 scope.go:117] "RemoveContainer" containerID="34506760c65c126b7e22dde19c234de02413a613785de879a48b219eb3942afe" Jul 29 22:49:12.467066 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.467043 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34506760c65c126b7e22dde19c234de02413a613785de879a48b219eb3942afe"} err="failed to get container status \"34506760c65c126b7e22dde19c234de02413a613785de879a48b219eb3942afe\": rpc error: code = NotFound desc = could not find container \"34506760c65c126b7e22dde19c234de02413a613785de879a48b219eb3942afe\": container with ID starting with 34506760c65c126b7e22dde19c234de02413a613785de879a48b219eb3942afe not found: ID does not exist" Jul 29 22:49:12.467108 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.467069 2570 scope.go:117] "RemoveContainer" containerID="f1c3d85629ea5379e8534995b0ca7e4f50a8c14b4cd2867ae8a67cd48ce2aae1" Jul 29 22:49:12.467361 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.467342 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1c3d85629ea5379e8534995b0ca7e4f50a8c14b4cd2867ae8a67cd48ce2aae1"} err="failed to get container status \"f1c3d85629ea5379e8534995b0ca7e4f50a8c14b4cd2867ae8a67cd48ce2aae1\": rpc error: code = NotFound desc = could not find container \"f1c3d85629ea5379e8534995b0ca7e4f50a8c14b4cd2867ae8a67cd48ce2aae1\": container with ID starting with f1c3d85629ea5379e8534995b0ca7e4f50a8c14b4cd2867ae8a67cd48ce2aae1 not found: ID does not exist" Jul 29 22:49:12.467439 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.467386 2570 scope.go:117] "RemoveContainer" containerID="d73873003f2772f89f3a7e77829d5325b1819db8a802e5231c6aabb2a30a820a" Jul 29 22:49:12.467665 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.467646 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d73873003f2772f89f3a7e77829d5325b1819db8a802e5231c6aabb2a30a820a"} err="failed to get container status \"d73873003f2772f89f3a7e77829d5325b1819db8a802e5231c6aabb2a30a820a\": rpc error: code = NotFound desc = could not find container \"d73873003f2772f89f3a7e77829d5325b1819db8a802e5231c6aabb2a30a820a\": container with ID starting with d73873003f2772f89f3a7e77829d5325b1819db8a802e5231c6aabb2a30a820a not found: ID does not exist" Jul 29 22:49:12.467773 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.467666 2570 scope.go:117] "RemoveContainer" containerID="45b8701c7476b5e461a0b737ad1d1d1a7fe8d60d1981d51a556863dd4f573377" Jul 29 22:49:12.467906 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.467888 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45b8701c7476b5e461a0b737ad1d1d1a7fe8d60d1981d51a556863dd4f573377"} err="failed to get container status \"45b8701c7476b5e461a0b737ad1d1d1a7fe8d60d1981d51a556863dd4f573377\": rpc error: code = NotFound desc = could not find container \"45b8701c7476b5e461a0b737ad1d1d1a7fe8d60d1981d51a556863dd4f573377\": container with ID starting with 45b8701c7476b5e461a0b737ad1d1d1a7fe8d60d1981d51a556863dd4f573377 not found: ID does not exist" Jul 29 22:49:12.467995 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.467909 2570 scope.go:117] "RemoveContainer" containerID="514fa581be1664a0f6f6a13fef1553fc61c84c9e79d97f46d5c7658be576ec3f" Jul 29 22:49:12.468150 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.468132 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 22:49:12.468228 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.468133 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"514fa581be1664a0f6f6a13fef1553fc61c84c9e79d97f46d5c7658be576ec3f"} err="failed to get container status \"514fa581be1664a0f6f6a13fef1553fc61c84c9e79d97f46d5c7658be576ec3f\": rpc error: code = NotFound desc = could not find container \"514fa581be1664a0f6f6a13fef1553fc61c84c9e79d97f46d5c7658be576ec3f\": container with ID starting with 514fa581be1664a0f6f6a13fef1553fc61c84c9e79d97f46d5c7658be576ec3f not found: ID does not exist" Jul 29 22:49:12.468280 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.468234 2570 scope.go:117] "RemoveContainer" containerID="5086bad078bd4dd0a24f6d7c0cc3644747f5eca703b7250b5629126db1997983" Jul 29 22:49:12.468435 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.468421 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerName="kube-rbac-proxy" Jul 29 22:49:12.468494 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.468438 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerName="kube-rbac-proxy" Jul 29 22:49:12.468494 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.468449 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerName="config-reloader" Jul 29 22:49:12.468494 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.468455 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerName="config-reloader" Jul 29 22:49:12.468494 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.468450 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5086bad078bd4dd0a24f6d7c0cc3644747f5eca703b7250b5629126db1997983"} err="failed to get container status \"5086bad078bd4dd0a24f6d7c0cc3644747f5eca703b7250b5629126db1997983\": rpc error: code = NotFound desc = could not find container \"5086bad078bd4dd0a24f6d7c0cc3644747f5eca703b7250b5629126db1997983\": container with ID starting with 5086bad078bd4dd0a24f6d7c0cc3644747f5eca703b7250b5629126db1997983 not found: ID does not exist" Jul 29 22:49:12.468494 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.468471 2570 scope.go:117] "RemoveContainer" containerID="3508968db139fc742e22aae909614d8e75d740ef3f3ac9ada137de25322d71c7" Jul 29 22:49:12.468745 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.468463 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerName="kube-rbac-proxy-thanos" Jul 29 22:49:12.468745 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.468528 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerName="kube-rbac-proxy-thanos" Jul 29 22:49:12.468745 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.468548 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerName="init-config-reloader" Jul 29 22:49:12.468745 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.468557 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerName="init-config-reloader" Jul 29 22:49:12.468745 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.468574 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerName="prometheus" Jul 29 22:49:12.468745 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.468582 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerName="prometheus" Jul 29 22:49:12.468745 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.468592 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerName="kube-rbac-proxy-web" Jul 29 22:49:12.468745 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.468600 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerName="kube-rbac-proxy-web" Jul 29 22:49:12.468745 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.468687 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3508968db139fc742e22aae909614d8e75d740ef3f3ac9ada137de25322d71c7"} err="failed to get container status \"3508968db139fc742e22aae909614d8e75d740ef3f3ac9ada137de25322d71c7\": rpc error: code = NotFound desc = could not find container \"3508968db139fc742e22aae909614d8e75d740ef3f3ac9ada137de25322d71c7\": container with ID starting with 3508968db139fc742e22aae909614d8e75d740ef3f3ac9ada137de25322d71c7 not found: ID does not exist" Jul 29 22:49:12.468745 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.468704 2570 scope.go:117] "RemoveContainer" containerID="34506760c65c126b7e22dde19c234de02413a613785de879a48b219eb3942afe" Jul 29 22:49:12.469219 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.468624 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerName="thanos-sidecar" Jul 29 22:49:12.469219 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.468765 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerName="thanos-sidecar" Jul 29 22:49:12.469219 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.468878 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerName="config-reloader" Jul 29 22:49:12.469219 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.468895 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerName="kube-rbac-proxy-web" Jul 29 22:49:12.469219 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.468897 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34506760c65c126b7e22dde19c234de02413a613785de879a48b219eb3942afe"} err="failed to get container status \"34506760c65c126b7e22dde19c234de02413a613785de879a48b219eb3942afe\": rpc error: code = NotFound desc = could not find container \"34506760c65c126b7e22dde19c234de02413a613785de879a48b219eb3942afe\": container with ID starting with 34506760c65c126b7e22dde19c234de02413a613785de879a48b219eb3942afe not found: ID does not exist" Jul 29 22:49:12.469219 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.468906 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerName="thanos-sidecar" Jul 29 22:49:12.469219 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.468912 2570 scope.go:117] "RemoveContainer" containerID="f1c3d85629ea5379e8534995b0ca7e4f50a8c14b4cd2867ae8a67cd48ce2aae1" Jul 29 22:49:12.469219 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.468915 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerName="prometheus" Jul 29 22:49:12.469219 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.468925 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerName="kube-rbac-proxy" Jul 29 22:49:12.469219 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.468933 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="dea35e65-a3d8-4028-85a4-8436bee84a11" containerName="kube-rbac-proxy-thanos" Jul 29 22:49:12.469219 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.469091 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1c3d85629ea5379e8534995b0ca7e4f50a8c14b4cd2867ae8a67cd48ce2aae1"} err="failed to get container status \"f1c3d85629ea5379e8534995b0ca7e4f50a8c14b4cd2867ae8a67cd48ce2aae1\": rpc error: code = NotFound desc = could not find container \"f1c3d85629ea5379e8534995b0ca7e4f50a8c14b4cd2867ae8a67cd48ce2aae1\": container with ID starting with f1c3d85629ea5379e8534995b0ca7e4f50a8c14b4cd2867ae8a67cd48ce2aae1 not found: ID does not exist" Jul 29 22:49:12.469219 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.469111 2570 scope.go:117] "RemoveContainer" containerID="d73873003f2772f89f3a7e77829d5325b1819db8a802e5231c6aabb2a30a820a" Jul 29 22:49:12.469839 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.469326 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d73873003f2772f89f3a7e77829d5325b1819db8a802e5231c6aabb2a30a820a"} err="failed to get container status \"d73873003f2772f89f3a7e77829d5325b1819db8a802e5231c6aabb2a30a820a\": rpc error: code = NotFound desc = could not find container \"d73873003f2772f89f3a7e77829d5325b1819db8a802e5231c6aabb2a30a820a\": container with ID starting with d73873003f2772f89f3a7e77829d5325b1819db8a802e5231c6aabb2a30a820a not found: ID does not exist" Jul 29 22:49:12.469839 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.469340 2570 scope.go:117] "RemoveContainer" containerID="45b8701c7476b5e461a0b737ad1d1d1a7fe8d60d1981d51a556863dd4f573377" Jul 29 22:49:12.469839 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.469578 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45b8701c7476b5e461a0b737ad1d1d1a7fe8d60d1981d51a556863dd4f573377"} err="failed to get container status \"45b8701c7476b5e461a0b737ad1d1d1a7fe8d60d1981d51a556863dd4f573377\": rpc error: code = NotFound desc = could not find container \"45b8701c7476b5e461a0b737ad1d1d1a7fe8d60d1981d51a556863dd4f573377\": container with ID starting with 45b8701c7476b5e461a0b737ad1d1d1a7fe8d60d1981d51a556863dd4f573377 not found: ID does not exist" Jul 29 22:49:12.469839 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.469600 2570 scope.go:117] "RemoveContainer" containerID="514fa581be1664a0f6f6a13fef1553fc61c84c9e79d97f46d5c7658be576ec3f" Jul 29 22:49:12.469839 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.469822 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"514fa581be1664a0f6f6a13fef1553fc61c84c9e79d97f46d5c7658be576ec3f"} err="failed to get container status \"514fa581be1664a0f6f6a13fef1553fc61c84c9e79d97f46d5c7658be576ec3f\": rpc error: code = NotFound desc = could not find container \"514fa581be1664a0f6f6a13fef1553fc61c84c9e79d97f46d5c7658be576ec3f\": container with ID starting with 514fa581be1664a0f6f6a13fef1553fc61c84c9e79d97f46d5c7658be576ec3f not found: ID does not exist" Jul 29 22:49:12.469839 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.469841 2570 scope.go:117] "RemoveContainer" containerID="5086bad078bd4dd0a24f6d7c0cc3644747f5eca703b7250b5629126db1997983" Jul 29 22:49:12.470116 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.470039 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5086bad078bd4dd0a24f6d7c0cc3644747f5eca703b7250b5629126db1997983"} err="failed to get container status \"5086bad078bd4dd0a24f6d7c0cc3644747f5eca703b7250b5629126db1997983\": rpc error: code = NotFound desc = could not find container \"5086bad078bd4dd0a24f6d7c0cc3644747f5eca703b7250b5629126db1997983\": container with ID starting with 5086bad078bd4dd0a24f6d7c0cc3644747f5eca703b7250b5629126db1997983 not found: ID does not exist" Jul 29 22:49:12.470116 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.470052 2570 scope.go:117] "RemoveContainer" containerID="3508968db139fc742e22aae909614d8e75d740ef3f3ac9ada137de25322d71c7" Jul 29 22:49:12.470256 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.470237 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3508968db139fc742e22aae909614d8e75d740ef3f3ac9ada137de25322d71c7"} err="failed to get container status \"3508968db139fc742e22aae909614d8e75d740ef3f3ac9ada137de25322d71c7\": rpc error: code = NotFound desc = could not find container \"3508968db139fc742e22aae909614d8e75d740ef3f3ac9ada137de25322d71c7\": container with ID starting with 3508968db139fc742e22aae909614d8e75d740ef3f3ac9ada137de25322d71c7 not found: ID does not exist" Jul 29 22:49:12.470256 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.470255 2570 scope.go:117] "RemoveContainer" containerID="34506760c65c126b7e22dde19c234de02413a613785de879a48b219eb3942afe" Jul 29 22:49:12.470467 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.470450 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34506760c65c126b7e22dde19c234de02413a613785de879a48b219eb3942afe"} err="failed to get container status \"34506760c65c126b7e22dde19c234de02413a613785de879a48b219eb3942afe\": rpc error: code = NotFound desc = could not find container \"34506760c65c126b7e22dde19c234de02413a613785de879a48b219eb3942afe\": container with ID starting with 34506760c65c126b7e22dde19c234de02413a613785de879a48b219eb3942afe not found: ID does not exist" Jul 29 22:49:12.470467 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.470466 2570 scope.go:117] "RemoveContainer" containerID="f1c3d85629ea5379e8534995b0ca7e4f50a8c14b4cd2867ae8a67cd48ce2aae1" Jul 29 22:49:12.470688 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.470671 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1c3d85629ea5379e8534995b0ca7e4f50a8c14b4cd2867ae8a67cd48ce2aae1"} err="failed to get container status \"f1c3d85629ea5379e8534995b0ca7e4f50a8c14b4cd2867ae8a67cd48ce2aae1\": rpc error: code = NotFound desc = could not find container \"f1c3d85629ea5379e8534995b0ca7e4f50a8c14b4cd2867ae8a67cd48ce2aae1\": container with ID starting with f1c3d85629ea5379e8534995b0ca7e4f50a8c14b4cd2867ae8a67cd48ce2aae1 not found: ID does not exist" Jul 29 22:49:12.470735 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.470688 2570 scope.go:117] "RemoveContainer" containerID="d73873003f2772f89f3a7e77829d5325b1819db8a802e5231c6aabb2a30a820a" Jul 29 22:49:12.470891 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.470873 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d73873003f2772f89f3a7e77829d5325b1819db8a802e5231c6aabb2a30a820a"} err="failed to get container status \"d73873003f2772f89f3a7e77829d5325b1819db8a802e5231c6aabb2a30a820a\": rpc error: code = NotFound desc = could not find container \"d73873003f2772f89f3a7e77829d5325b1819db8a802e5231c6aabb2a30a820a\": container with ID starting with d73873003f2772f89f3a7e77829d5325b1819db8a802e5231c6aabb2a30a820a not found: ID does not exist" Jul 29 22:49:12.470934 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.470892 2570 scope.go:117] "RemoveContainer" containerID="45b8701c7476b5e461a0b737ad1d1d1a7fe8d60d1981d51a556863dd4f573377" Jul 29 22:49:12.471093 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.471077 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45b8701c7476b5e461a0b737ad1d1d1a7fe8d60d1981d51a556863dd4f573377"} err="failed to get container status \"45b8701c7476b5e461a0b737ad1d1d1a7fe8d60d1981d51a556863dd4f573377\": rpc error: code = NotFound desc = could not find container \"45b8701c7476b5e461a0b737ad1d1d1a7fe8d60d1981d51a556863dd4f573377\": container with ID starting with 45b8701c7476b5e461a0b737ad1d1d1a7fe8d60d1981d51a556863dd4f573377 not found: ID does not exist" Jul 29 22:49:12.471131 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.471093 2570 scope.go:117] "RemoveContainer" containerID="514fa581be1664a0f6f6a13fef1553fc61c84c9e79d97f46d5c7658be576ec3f" Jul 29 22:49:12.471309 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.471291 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"514fa581be1664a0f6f6a13fef1553fc61c84c9e79d97f46d5c7658be576ec3f"} err="failed to get container status \"514fa581be1664a0f6f6a13fef1553fc61c84c9e79d97f46d5c7658be576ec3f\": rpc error: code = NotFound desc = could not find container \"514fa581be1664a0f6f6a13fef1553fc61c84c9e79d97f46d5c7658be576ec3f\": container with ID starting with 514fa581be1664a0f6f6a13fef1553fc61c84c9e79d97f46d5c7658be576ec3f not found: ID does not exist" Jul 29 22:49:12.471309 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.471308 2570 scope.go:117] "RemoveContainer" containerID="5086bad078bd4dd0a24f6d7c0cc3644747f5eca703b7250b5629126db1997983" Jul 29 22:49:12.471499 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.471484 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5086bad078bd4dd0a24f6d7c0cc3644747f5eca703b7250b5629126db1997983"} err="failed to get container status \"5086bad078bd4dd0a24f6d7c0cc3644747f5eca703b7250b5629126db1997983\": rpc error: code = NotFound desc = could not find container \"5086bad078bd4dd0a24f6d7c0cc3644747f5eca703b7250b5629126db1997983\": container with ID starting with 5086bad078bd4dd0a24f6d7c0cc3644747f5eca703b7250b5629126db1997983 not found: ID does not exist" Jul 29 22:49:12.471550 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.471499 2570 scope.go:117] "RemoveContainer" containerID="3508968db139fc742e22aae909614d8e75d740ef3f3ac9ada137de25322d71c7" Jul 29 22:49:12.471726 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.471705 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3508968db139fc742e22aae909614d8e75d740ef3f3ac9ada137de25322d71c7"} err="failed to get container status \"3508968db139fc742e22aae909614d8e75d740ef3f3ac9ada137de25322d71c7\": rpc error: code = NotFound desc = could not find container \"3508968db139fc742e22aae909614d8e75d740ef3f3ac9ada137de25322d71c7\": container with ID starting with 3508968db139fc742e22aae909614d8e75d740ef3f3ac9ada137de25322d71c7 not found: ID does not exist" Jul 29 22:49:12.474525 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.474509 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.477176 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.477156 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vbm87\"" Jul 29 22:49:12.477330 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.477311 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 29 22:49:12.477392 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.477363 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 29 22:49:12.477510 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.477488 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 29 22:49:12.477652 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.477534 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 29 22:49:12.477652 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.477606 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 29 22:49:12.477783 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.477768 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 29 22:49:12.477833 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.477790 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 29 22:49:12.477833 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.477820 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 29 22:49:12.477985 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.477961 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-tbviaga3a12b\"" Jul 29 22:49:12.478037 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.478020 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 29 22:49:12.478037 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.478029 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 29 22:49:12.478305 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.478289 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 29 22:49:12.478761 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.478741 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 29 22:49:12.479148 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.479131 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 29 22:49:12.481056 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.481037 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 29 22:49:12.484338 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.484312 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 29 22:49:12.492116 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.492091 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 22:49:12.506094 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.506068 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dea35e65-a3d8-4028-85a4-8436bee84a11" path="/var/lib/kubelet/pods/dea35e65-a3d8-4028-85a4-8436bee84a11/volumes" Jul 29 22:49:12.588388 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.588303 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.588388 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.588337 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.588388 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.588355 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.588388 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.588371 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.588622 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.588433 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-config\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.588622 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.588487 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-web-config\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.588622 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.588546 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.588622 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.588568 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq74p\" (UniqueName: \"kubernetes.io/projected/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-kube-api-access-dq74p\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.588794 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.588622 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.588794 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.588669 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.588794 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.588713 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.588794 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.588738 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.588794 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.588761 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.588794 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.588784 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.588960 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.588800 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.588960 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.588820 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.588960 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.588848 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.588960 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.588882 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-config-out\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.588960 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.588898 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.588960 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.588918 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.689543 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.689511 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.689708 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.689557 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.689708 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.689575 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.689708 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.689591 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.689708 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.689604 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.689708 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.689621 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-config\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.689708 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.689675 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-web-config\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.689708 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.689701 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.690039 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.689722 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq74p\" (UniqueName: \"kubernetes.io/projected/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-kube-api-access-dq74p\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.690039 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.689766 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.690039 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.689790 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.690039 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.689819 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.690039 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.689848 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.690039 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.689871 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.690039 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.689899 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.690039 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.689923 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.690039 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.689948 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.690039 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.689969 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.690039 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.689973 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.690039 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.690041 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-config-out\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.690585 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.690070 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.690585 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.690420 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.690585 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.690426 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.690585 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.690578 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.690901 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.690875 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.690961 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.690910 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.691766 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.691737 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.692765 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.692739 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.693068 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.692877 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.693068 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.692906 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-web-config\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.693068 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.692925 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-config-out\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.693929 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.693307 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.693929 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.693724 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-config\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.694314 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.694293 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.695148 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.695115 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.695389 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.695365 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.695525 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.695501 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.695617 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.695599 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.695990 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.695973 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.698330 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.698311 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq74p\" (UniqueName: \"kubernetes.io/projected/3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7-kube-api-access-dq74p\") pod \"prometheus-k8s-0\" (UID: \"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.788514 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.788481 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:12.923203 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:12.923017 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 22:49:12.925218 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:49:12.925192 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ca3da2f_5982_49d4_9c5b_3c78f7e15ac7.slice/crio-828db330d265b5198d5f44c78d6fb737b3ae29dfcaa776e41a1d8607e28724af WatchSource:0}: Error finding container 828db330d265b5198d5f44c78d6fb737b3ae29dfcaa776e41a1d8607e28724af: Status 404 returned error can't find the container with id 828db330d265b5198d5f44c78d6fb737b3ae29dfcaa776e41a1d8607e28724af Jul 29 22:49:13.419015 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:13.418978 2570 generic.go:356] "Generic (PLEG): container finished" podID="3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7" containerID="9ec9513291afe1757465d08e37b7b0642fa82947108e5231e0111cef7feb9a4f" exitCode=0 Jul 29 22:49:13.419454 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:13.419065 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7","Type":"ContainerDied","Data":"9ec9513291afe1757465d08e37b7b0642fa82947108e5231e0111cef7feb9a4f"} Jul 29 22:49:13.419454 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:13.419131 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7","Type":"ContainerStarted","Data":"828db330d265b5198d5f44c78d6fb737b3ae29dfcaa776e41a1d8607e28724af"} Jul 29 22:49:14.427905 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:14.427870 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7","Type":"ContainerStarted","Data":"3538588fc27e6fcc09171a747f41868ffc479c95efb8e6cc8461ed1102333497"} Jul 29 22:49:14.428398 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:14.427945 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7","Type":"ContainerStarted","Data":"94b9334c9fd43a825f0742ef7174d112256168dbc36e62f734d77ba9a2d09ebe"} Jul 29 22:49:14.428398 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:14.427990 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7","Type":"ContainerStarted","Data":"a81704f8e96df977872b2fcea9e9fa29d9a302ae9dd858eb95eb1d3f91d951e8"} Jul 29 22:49:14.428398 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:14.428029 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7","Type":"ContainerStarted","Data":"812eacfd8062150a36e70d8c88105432d41901bef65ebbeb102db78ba5d283ed"} Jul 29 22:49:14.428398 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:14.428075 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7","Type":"ContainerStarted","Data":"1473c8371d52c9fe2d0f0da35520a96ca76b7a39b85e329a84adf41b03eff721"} Jul 29 22:49:14.428398 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:14.428113 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7","Type":"ContainerStarted","Data":"9b47699053f41a22d126bfc9bd68b34ae56fbd6aa48a484a74433acd21addba2"} Jul 29 22:49:14.458127 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:14.458061 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.440961078 podStartE2EDuration="2.458039402s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.078324ms" isStatefulPod=false podCreationTimestamp="2026-07-29 22:49:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:49:14.45793273 +0000 UTC m=+164.414028583" watchObservedRunningTime="2026-07-29 22:49:14.458039402 +0000 UTC m=+164.414135253" Jul 29 22:49:17.789383 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:49:17.789347 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:50:12.789005 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:50:12.788963 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:50:12.804370 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:50:12.804343 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:50:13.664780 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:50:13.664755 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:51:30.378590 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:51:30.378555 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65k6t_a674054c-c6ca-4f41-9d96-9253b99152d4/ovn-acl-logging/0.log" Jul 29 22:51:30.382239 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:51:30.382216 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65k6t_a674054c-c6ca-4f41-9d96-9253b99152d4/ovn-acl-logging/0.log" Jul 29 22:51:30.382910 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:51:30.382889 2570 kubelet.go:1648] "Image garbage collection succeeded" Jul 29 22:54:35.267491 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.267454 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f9b495d4-989mf"] Jul 29 22:54:35.270757 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.270739 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f9b495d4-989mf" Jul 29 22:54:35.273386 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.273360 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fv65f\"" Jul 29 22:54:35.273519 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.273360 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 29 22:54:35.273519 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.273369 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 29 22:54:35.274831 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.274814 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 29 22:54:35.274936 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.274867 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 29 22:54:35.274936 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.274922 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 29 22:54:35.279214 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.279190 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 29 22:54:35.281562 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.281536 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f9b495d4-989mf"] Jul 29 22:54:35.415782 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.415750 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ccbd8190-0335-4ca6-ae37-f58fc16ed097-oauth-serving-cert\") pod \"console-f9b495d4-989mf\" (UID: \"ccbd8190-0335-4ca6-ae37-f58fc16ed097\") " pod="openshift-console/console-f9b495d4-989mf" Jul 29 22:54:35.415782 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.415783 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgl9g\" (UniqueName: \"kubernetes.io/projected/ccbd8190-0335-4ca6-ae37-f58fc16ed097-kube-api-access-wgl9g\") pod \"console-f9b495d4-989mf\" (UID: \"ccbd8190-0335-4ca6-ae37-f58fc16ed097\") " pod="openshift-console/console-f9b495d4-989mf" Jul 29 22:54:35.416014 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.415805 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ccbd8190-0335-4ca6-ae37-f58fc16ed097-console-oauth-config\") pod \"console-f9b495d4-989mf\" (UID: \"ccbd8190-0335-4ca6-ae37-f58fc16ed097\") " pod="openshift-console/console-f9b495d4-989mf" Jul 29 22:54:35.416014 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.415822 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ccbd8190-0335-4ca6-ae37-f58fc16ed097-console-config\") pod \"console-f9b495d4-989mf\" (UID: \"ccbd8190-0335-4ca6-ae37-f58fc16ed097\") " pod="openshift-console/console-f9b495d4-989mf" Jul 29 22:54:35.416014 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.415882 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ccbd8190-0335-4ca6-ae37-f58fc16ed097-trusted-ca-bundle\") pod \"console-f9b495d4-989mf\" (UID: \"ccbd8190-0335-4ca6-ae37-f58fc16ed097\") " pod="openshift-console/console-f9b495d4-989mf" Jul 29 22:54:35.416118 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.416015 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ccbd8190-0335-4ca6-ae37-f58fc16ed097-console-serving-cert\") pod \"console-f9b495d4-989mf\" (UID: \"ccbd8190-0335-4ca6-ae37-f58fc16ed097\") " pod="openshift-console/console-f9b495d4-989mf" Jul 29 22:54:35.416118 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.416044 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ccbd8190-0335-4ca6-ae37-f58fc16ed097-service-ca\") pod \"console-f9b495d4-989mf\" (UID: \"ccbd8190-0335-4ca6-ae37-f58fc16ed097\") " pod="openshift-console/console-f9b495d4-989mf" Jul 29 22:54:35.517370 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.517324 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ccbd8190-0335-4ca6-ae37-f58fc16ed097-oauth-serving-cert\") pod \"console-f9b495d4-989mf\" (UID: \"ccbd8190-0335-4ca6-ae37-f58fc16ed097\") " pod="openshift-console/console-f9b495d4-989mf" Jul 29 22:54:35.517370 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.517358 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgl9g\" (UniqueName: \"kubernetes.io/projected/ccbd8190-0335-4ca6-ae37-f58fc16ed097-kube-api-access-wgl9g\") pod \"console-f9b495d4-989mf\" (UID: \"ccbd8190-0335-4ca6-ae37-f58fc16ed097\") " pod="openshift-console/console-f9b495d4-989mf" Jul 29 22:54:35.517703 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.517385 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ccbd8190-0335-4ca6-ae37-f58fc16ed097-console-oauth-config\") pod \"console-f9b495d4-989mf\" (UID: \"ccbd8190-0335-4ca6-ae37-f58fc16ed097\") " pod="openshift-console/console-f9b495d4-989mf" Jul 29 22:54:35.517703 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.517406 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ccbd8190-0335-4ca6-ae37-f58fc16ed097-console-config\") pod \"console-f9b495d4-989mf\" (UID: \"ccbd8190-0335-4ca6-ae37-f58fc16ed097\") " pod="openshift-console/console-f9b495d4-989mf" Jul 29 22:54:35.517703 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.517433 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ccbd8190-0335-4ca6-ae37-f58fc16ed097-trusted-ca-bundle\") pod \"console-f9b495d4-989mf\" (UID: \"ccbd8190-0335-4ca6-ae37-f58fc16ed097\") " pod="openshift-console/console-f9b495d4-989mf" Jul 29 22:54:35.517703 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.517495 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ccbd8190-0335-4ca6-ae37-f58fc16ed097-console-serving-cert\") pod \"console-f9b495d4-989mf\" (UID: \"ccbd8190-0335-4ca6-ae37-f58fc16ed097\") " pod="openshift-console/console-f9b495d4-989mf" Jul 29 22:54:35.517703 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.517522 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ccbd8190-0335-4ca6-ae37-f58fc16ed097-service-ca\") pod \"console-f9b495d4-989mf\" (UID: \"ccbd8190-0335-4ca6-ae37-f58fc16ed097\") " pod="openshift-console/console-f9b495d4-989mf" Jul 29 22:54:35.518237 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.518211 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ccbd8190-0335-4ca6-ae37-f58fc16ed097-oauth-serving-cert\") pod \"console-f9b495d4-989mf\" (UID: \"ccbd8190-0335-4ca6-ae37-f58fc16ed097\") " pod="openshift-console/console-f9b495d4-989mf" Jul 29 22:54:35.518347 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.518211 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ccbd8190-0335-4ca6-ae37-f58fc16ed097-console-config\") pod \"console-f9b495d4-989mf\" (UID: \"ccbd8190-0335-4ca6-ae37-f58fc16ed097\") " pod="openshift-console/console-f9b495d4-989mf" Jul 29 22:54:35.518347 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.518262 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ccbd8190-0335-4ca6-ae37-f58fc16ed097-service-ca\") pod \"console-f9b495d4-989mf\" (UID: \"ccbd8190-0335-4ca6-ae37-f58fc16ed097\") " pod="openshift-console/console-f9b495d4-989mf" Jul 29 22:54:35.518347 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.518313 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ccbd8190-0335-4ca6-ae37-f58fc16ed097-trusted-ca-bundle\") pod \"console-f9b495d4-989mf\" (UID: \"ccbd8190-0335-4ca6-ae37-f58fc16ed097\") " pod="openshift-console/console-f9b495d4-989mf" Jul 29 22:54:35.520017 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.519998 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ccbd8190-0335-4ca6-ae37-f58fc16ed097-console-serving-cert\") pod \"console-f9b495d4-989mf\" (UID: \"ccbd8190-0335-4ca6-ae37-f58fc16ed097\") " pod="openshift-console/console-f9b495d4-989mf" Jul 29 22:54:35.520100 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.520028 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ccbd8190-0335-4ca6-ae37-f58fc16ed097-console-oauth-config\") pod \"console-f9b495d4-989mf\" (UID: \"ccbd8190-0335-4ca6-ae37-f58fc16ed097\") " pod="openshift-console/console-f9b495d4-989mf" Jul 29 22:54:35.526571 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.526541 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgl9g\" (UniqueName: \"kubernetes.io/projected/ccbd8190-0335-4ca6-ae37-f58fc16ed097-kube-api-access-wgl9g\") pod \"console-f9b495d4-989mf\" (UID: \"ccbd8190-0335-4ca6-ae37-f58fc16ed097\") " pod="openshift-console/console-f9b495d4-989mf" Jul 29 22:54:35.580272 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.580235 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f9b495d4-989mf" Jul 29 22:54:35.714687 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:35.714544 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f9b495d4-989mf"] Jul 29 22:54:35.717573 ip-10-0-138-44 kubenswrapper[2570]: W0729 22:54:35.717537 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccbd8190_0335_4ca6_ae37_f58fc16ed097.slice/crio-50322d560a82be5fdea690622e805a0c8390a1883c7f4e8b82e65fd9e5ba7a0c WatchSource:0}: Error finding container 50322d560a82be5fdea690622e805a0c8390a1883c7f4e8b82e65fd9e5ba7a0c: Status 404 returned error can't find the container with id 50322d560a82be5fdea690622e805a0c8390a1883c7f4e8b82e65fd9e5ba7a0c Jul 29 22:54:36.653378 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:36.653349 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f9b495d4-989mf" event={"ID":"ccbd8190-0335-4ca6-ae37-f58fc16ed097","Type":"ContainerStarted","Data":"615858b3f80e36d4ba5593933464c5f358df191c70d723da9bfa22632973e711"} Jul 29 22:54:36.653806 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:36.653395 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f9b495d4-989mf" event={"ID":"ccbd8190-0335-4ca6-ae37-f58fc16ed097","Type":"ContainerStarted","Data":"50322d560a82be5fdea690622e805a0c8390a1883c7f4e8b82e65fd9e5ba7a0c"} Jul 29 22:54:36.670985 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:36.670931 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f9b495d4-989mf" podStartSLOduration=1.670917821 podStartE2EDuration="1.670917821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:54:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:54:36.670247374 +0000 UTC m=+486.626343250" watchObservedRunningTime="2026-07-29 22:54:36.670917821 +0000 UTC m=+486.627013675" Jul 29 22:54:45.581390 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:45.581345 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f9b495d4-989mf" Jul 29 22:54:45.581969 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:45.581419 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f9b495d4-989mf" Jul 29 22:54:45.586309 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:45.586287 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f9b495d4-989mf" Jul 29 22:54:45.691288 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:54:45.691259 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f9b495d4-989mf" Jul 29 22:56:30.409418 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:56:30.409393 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65k6t_a674054c-c6ca-4f41-9d96-9253b99152d4/ovn-acl-logging/0.log" Jul 29 22:56:30.410991 ip-10-0-138-44 kubenswrapper[2570]: I0729 22:56:30.410969 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65k6t_a674054c-c6ca-4f41-9d96-9253b99152d4/ovn-acl-logging/0.log" Jul 29 23:01:30.436108 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:01:30.436042 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65k6t_a674054c-c6ca-4f41-9d96-9253b99152d4/ovn-acl-logging/0.log" Jul 29 23:01:30.436108 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:01:30.436042 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65k6t_a674054c-c6ca-4f41-9d96-9253b99152d4/ovn-acl-logging/0.log" Jul 29 23:03:45.886018 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:03:45.885980 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jdjw7/must-gather-65wbz"] Jul 29 23:03:45.889524 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:03:45.889503 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jdjw7/must-gather-65wbz" Jul 29 23:03:45.892424 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:03:45.892404 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jdjw7\"/\"openshift-service-ca.crt\"" Jul 29 23:03:45.892533 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:03:45.892500 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jdjw7\"/\"kube-root-ca.crt\"" Jul 29 23:03:45.893861 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:03:45.893843 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jdjw7\"/\"default-dockercfg-mwskx\"" Jul 29 23:03:45.904863 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:03:45.904836 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jdjw7/must-gather-65wbz"] Jul 29 23:03:45.993889 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:03:45.993853 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hmm4\" (UniqueName: \"kubernetes.io/projected/4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff-kube-api-access-2hmm4\") pod \"must-gather-65wbz\" (UID: \"4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff\") " pod="openshift-must-gather-jdjw7/must-gather-65wbz" Jul 29 23:03:45.994099 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:03:45.993917 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff-must-gather-output\") pod \"must-gather-65wbz\" (UID: \"4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff\") " pod="openshift-must-gather-jdjw7/must-gather-65wbz" Jul 29 23:03:46.094739 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:03:46.094700 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff-must-gather-output\") pod \"must-gather-65wbz\" (UID: \"4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff\") " pod="openshift-must-gather-jdjw7/must-gather-65wbz" Jul 29 23:03:46.094936 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:03:46.094786 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hmm4\" (UniqueName: \"kubernetes.io/projected/4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff-kube-api-access-2hmm4\") pod \"must-gather-65wbz\" (UID: \"4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff\") " pod="openshift-must-gather-jdjw7/must-gather-65wbz" Jul 29 23:03:46.095101 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:03:46.095081 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff-must-gather-output\") pod \"must-gather-65wbz\" (UID: \"4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff\") " pod="openshift-must-gather-jdjw7/must-gather-65wbz" Jul 29 23:03:46.103372 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:03:46.103337 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hmm4\" (UniqueName: \"kubernetes.io/projected/4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff-kube-api-access-2hmm4\") pod \"must-gather-65wbz\" (UID: \"4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff\") " pod="openshift-must-gather-jdjw7/must-gather-65wbz" Jul 29 23:03:46.216691 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:03:46.216575 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jdjw7/must-gather-65wbz" Jul 29 23:03:46.350241 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:03:46.350217 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jdjw7/must-gather-65wbz"] Jul 29 23:03:46.352523 ip-10-0-138-44 kubenswrapper[2570]: W0729 23:03:46.352496 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4353e6c9_a2ed_47bf_a8d2_da60eac8e4ff.slice/crio-e3e3435ffea24c83036a847e0930160c0f1138c226b9a6673ea7e73bf63f75f7 WatchSource:0}: Error finding container e3e3435ffea24c83036a847e0930160c0f1138c226b9a6673ea7e73bf63f75f7: Status 404 returned error can't find the container with id e3e3435ffea24c83036a847e0930160c0f1138c226b9a6673ea7e73bf63f75f7 Jul 29 23:03:46.354398 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:03:46.354379 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 23:03:46.753454 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:03:46.753419 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jdjw7/must-gather-65wbz" event={"ID":"4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff","Type":"ContainerStarted","Data":"e3e3435ffea24c83036a847e0930160c0f1138c226b9a6673ea7e73bf63f75f7"} Jul 29 23:03:53.790452 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:03:53.790413 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jdjw7/must-gather-65wbz" event={"ID":"4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff","Type":"ContainerStarted","Data":"6a1e05ddfe1e5c4d75b999a8dc8ac9d1b99a656689a6e00f3af74598b1fe9ab0"} Jul 29 23:03:53.790982 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:03:53.790465 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jdjw7/must-gather-65wbz" event={"ID":"4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff","Type":"ContainerStarted","Data":"0a7599fbb40c91e350efcafc906c49cc8165751ff75746285529b2e035b4cd93"} Jul 29 23:04:05.842477 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:05.842438 2570 generic.go:356] "Generic (PLEG): container finished" podID="4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff" containerID="0a7599fbb40c91e350efcafc906c49cc8165751ff75746285529b2e035b4cd93" exitCode=0 Jul 29 23:04:05.842987 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:05.842489 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jdjw7/must-gather-65wbz" event={"ID":"4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff","Type":"ContainerDied","Data":"0a7599fbb40c91e350efcafc906c49cc8165751ff75746285529b2e035b4cd93"} Jul 29 23:04:05.842987 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:05.842808 2570 scope.go:117] "RemoveContainer" containerID="0a7599fbb40c91e350efcafc906c49cc8165751ff75746285529b2e035b4cd93" Jul 29 23:04:06.410837 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:06.410809 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-jdjw7_must-gather-65wbz_4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff/gather/0.log" Jul 29 23:04:06.855873 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:06.855829 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-z2kfm/must-gather-68kww"] Jul 29 23:04:06.859002 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:06.858982 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z2kfm/must-gather-68kww" Jul 29 23:04:06.861805 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:06.861783 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z2kfm\"/\"kube-root-ca.crt\"" Jul 29 23:04:06.862917 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:06.862900 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z2kfm\"/\"openshift-service-ca.crt\"" Jul 29 23:04:06.863022 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:06.862927 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-z2kfm\"/\"default-dockercfg-m4vvg\"" Jul 29 23:04:06.867813 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:06.867785 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z2kfm/must-gather-68kww"] Jul 29 23:04:06.988843 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:06.988810 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b4125de7-c2d6-4114-a736-91016f7abaef-must-gather-output\") pod \"must-gather-68kww\" (UID: \"b4125de7-c2d6-4114-a736-91016f7abaef\") " pod="openshift-must-gather-z2kfm/must-gather-68kww" Jul 29 23:04:06.989030 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:06.988889 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc8qd\" (UniqueName: \"kubernetes.io/projected/b4125de7-c2d6-4114-a736-91016f7abaef-kube-api-access-jc8qd\") pod \"must-gather-68kww\" (UID: \"b4125de7-c2d6-4114-a736-91016f7abaef\") " pod="openshift-must-gather-z2kfm/must-gather-68kww" Jul 29 23:04:07.090056 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:07.090020 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc8qd\" (UniqueName: \"kubernetes.io/projected/b4125de7-c2d6-4114-a736-91016f7abaef-kube-api-access-jc8qd\") pod \"must-gather-68kww\" (UID: \"b4125de7-c2d6-4114-a736-91016f7abaef\") " pod="openshift-must-gather-z2kfm/must-gather-68kww" Jul 29 23:04:07.090226 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:07.090073 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b4125de7-c2d6-4114-a736-91016f7abaef-must-gather-output\") pod \"must-gather-68kww\" (UID: \"b4125de7-c2d6-4114-a736-91016f7abaef\") " pod="openshift-must-gather-z2kfm/must-gather-68kww" Jul 29 23:04:07.090399 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:07.090384 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b4125de7-c2d6-4114-a736-91016f7abaef-must-gather-output\") pod \"must-gather-68kww\" (UID: \"b4125de7-c2d6-4114-a736-91016f7abaef\") " pod="openshift-must-gather-z2kfm/must-gather-68kww" Jul 29 23:04:07.098143 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:07.098116 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc8qd\" (UniqueName: \"kubernetes.io/projected/b4125de7-c2d6-4114-a736-91016f7abaef-kube-api-access-jc8qd\") pod \"must-gather-68kww\" (UID: \"b4125de7-c2d6-4114-a736-91016f7abaef\") " pod="openshift-must-gather-z2kfm/must-gather-68kww" Jul 29 23:04:07.168317 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:07.168214 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z2kfm/must-gather-68kww" Jul 29 23:04:07.300663 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:07.297883 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z2kfm/must-gather-68kww"] Jul 29 23:04:07.305128 ip-10-0-138-44 kubenswrapper[2570]: W0729 23:04:07.305093 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4125de7_c2d6_4114_a736_91016f7abaef.slice/crio-0baf3a632299ecfba47a3bb0f2fba54ecfebd3220b01e87f25a6b49d6ab689aa WatchSource:0}: Error finding container 0baf3a632299ecfba47a3bb0f2fba54ecfebd3220b01e87f25a6b49d6ab689aa: Status 404 returned error can't find the container with id 0baf3a632299ecfba47a3bb0f2fba54ecfebd3220b01e87f25a6b49d6ab689aa Jul 29 23:04:07.853708 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:07.853668 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z2kfm/must-gather-68kww" event={"ID":"b4125de7-c2d6-4114-a736-91016f7abaef","Type":"ContainerStarted","Data":"0baf3a632299ecfba47a3bb0f2fba54ecfebd3220b01e87f25a6b49d6ab689aa"} Jul 29 23:04:08.860545 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:08.860509 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z2kfm/must-gather-68kww" event={"ID":"b4125de7-c2d6-4114-a736-91016f7abaef","Type":"ContainerStarted","Data":"f734bd9b483967561f38793b8eef619852d1e2b17f05c3e4c41f25860f1ce48c"} Jul 29 23:04:08.861110 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:08.861087 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z2kfm/must-gather-68kww" event={"ID":"b4125de7-c2d6-4114-a736-91016f7abaef","Type":"ContainerStarted","Data":"982717e352747c1bdbb7855ef7a11fa13b1e6059bc3fbbad1d26b24329d58559"} Jul 29 23:04:08.877548 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:08.877492 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-z2kfm/must-gather-68kww" podStartSLOduration=2.124896186 podStartE2EDuration="2.877470947s" totalImagesPullingTime="752.574761ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 23:04:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 23:04:08.876583225 +0000 UTC m=+1058.832679082" watchObservedRunningTime="2026-07-29 23:04:08.877470947 +0000 UTC m=+1058.833566804" Jul 29 23:04:09.535229 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:09.535204 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xlxhw_19b4fc0c-1b07-4c57-88df-5d40a7a07cfa/global-pull-secret-syncer/0.log" Jul 29 23:04:09.632309 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:09.632277 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kxxx9_8b701f00-dc19-4258-a99d-86f2d493108e/konnectivity-agent/0.log" Jul 29 23:04:09.700146 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:09.700096 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-44.ec2.internal_28ee2cd84792d9409e5acf4090158792/haproxy/0.log" Jul 29 23:04:11.700888 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:11.700840 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-jdjw7/must-gather-65wbz"] Jul 29 23:04:11.701469 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:11.701240 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-jdjw7/must-gather-65wbz" podUID="4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff" containerName="copy" containerID="cri-o://6a1e05ddfe1e5c4d75b999a8dc8ac9d1b99a656689a6e00f3af74598b1fe9ab0" gracePeriod=2 Jul 29 23:04:11.703888 ip-10-0-138-44 kubenswrapper[2570]: E0729 23:04:11.703844 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-65wbz\" is forbidden: User \"system:node:ip-10-0-138-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-jdjw7\": no relationship found between node 'ip-10-0-138-44.ec2.internal' and this object" podUID="4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff" pod="openshift-must-gather-jdjw7/must-gather-65wbz" Jul 29 23:04:11.704320 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:11.704298 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-jdjw7/must-gather-65wbz"] Jul 29 23:04:11.879134 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:11.879108 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-jdjw7_must-gather-65wbz_4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff/copy/0.log" Jul 29 23:04:11.879993 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:11.879883 2570 generic.go:356] "Generic (PLEG): container finished" podID="4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff" containerID="6a1e05ddfe1e5c4d75b999a8dc8ac9d1b99a656689a6e00f3af74598b1fe9ab0" exitCode=143 Jul 29 23:04:12.058624 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:12.057044 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-jdjw7_must-gather-65wbz_4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff/copy/0.log" Jul 29 23:04:12.064394 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:12.061405 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jdjw7/must-gather-65wbz" Jul 29 23:04:12.068649 ip-10-0-138-44 kubenswrapper[2570]: E0729 23:04:12.064838 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-65wbz\" is forbidden: User \"system:node:ip-10-0-138-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-jdjw7\": no relationship found between node 'ip-10-0-138-44.ec2.internal' and this object" podUID="4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff" pod="openshift-must-gather-jdjw7/must-gather-65wbz" Jul 29 23:04:12.138647 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:12.138586 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff-must-gather-output\") pod \"4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff\" (UID: \"4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff\") " Jul 29 23:04:12.139129 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:12.139004 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff" (UID: "4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 23:04:12.139209 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:12.139190 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hmm4\" (UniqueName: \"kubernetes.io/projected/4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff-kube-api-access-2hmm4\") pod \"4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff\" (UID: \"4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff\") " Jul 29 23:04:12.140054 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:12.139902 2570 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff-must-gather-output\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 23:04:12.155808 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:12.154816 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff-kube-api-access-2hmm4" (OuterVolumeSpecName: "kube-api-access-2hmm4") pod "4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff" (UID: "4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff"). InnerVolumeSpecName "kube-api-access-2hmm4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 23:04:12.240505 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:12.240459 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hmm4\" (UniqueName: \"kubernetes.io/projected/4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff-kube-api-access-2hmm4\") on node \"ip-10-0-138-44.ec2.internal\" DevicePath \"\"" Jul 29 23:04:12.511304 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:12.511258 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff" path="/var/lib/kubelet/pods/4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff/volumes" Jul 29 23:04:12.887518 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:12.887431 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-jdjw7_must-gather-65wbz_4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff/copy/0.log" Jul 29 23:04:12.889287 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:12.888554 2570 scope.go:117] "RemoveContainer" containerID="6a1e05ddfe1e5c4d75b999a8dc8ac9d1b99a656689a6e00f3af74598b1fe9ab0" Jul 29 23:04:12.889287 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:12.888761 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jdjw7/must-gather-65wbz" Jul 29 23:04:12.901316 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:12.901181 2570 scope.go:117] "RemoveContainer" containerID="0a7599fbb40c91e350efcafc906c49cc8165751ff75746285529b2e035b4cd93" Jul 29 23:04:14.166979 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:14.166949 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54411db9-f2e1-4c5e-ae8e-006df158cda2/alertmanager/0.log" Jul 29 23:04:14.194027 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:14.193993 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54411db9-f2e1-4c5e-ae8e-006df158cda2/config-reloader/0.log" Jul 29 23:04:14.225017 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:14.224984 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54411db9-f2e1-4c5e-ae8e-006df158cda2/kube-rbac-proxy-web/0.log" Jul 29 23:04:14.262202 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:14.262169 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54411db9-f2e1-4c5e-ae8e-006df158cda2/kube-rbac-proxy/0.log" Jul 29 23:04:14.309776 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:14.309745 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54411db9-f2e1-4c5e-ae8e-006df158cda2/kube-rbac-proxy-metric/0.log" Jul 29 23:04:14.350232 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:14.350193 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54411db9-f2e1-4c5e-ae8e-006df158cda2/prom-label-proxy/0.log" Jul 29 23:04:14.376305 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:14.376276 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54411db9-f2e1-4c5e-ae8e-006df158cda2/init-config-reloader/0.log" Jul 29 23:04:14.541590 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:14.541514 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-8qd72_29d66010-429a-4a52-ae3e-4d7f5607c019/monitoring-plugin/0.log" Jul 29 23:04:14.648976 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:14.648942 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hl5xk_92d5f7be-457e-4787-bc9e-3d4859ce7f03/node-exporter/0.log" Jul 29 23:04:14.673378 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:14.673347 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hl5xk_92d5f7be-457e-4787-bc9e-3d4859ce7f03/kube-rbac-proxy/0.log" Jul 29 23:04:14.701770 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:14.701737 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hl5xk_92d5f7be-457e-4787-bc9e-3d4859ce7f03/init-textfile/0.log" Jul 29 23:04:14.810302 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:14.810228 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-7kr7n_276b66d3-320e-482e-9e01-abec897af39b/kube-rbac-proxy-main/0.log" Jul 29 23:04:14.830238 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:14.830206 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-7kr7n_276b66d3-320e-482e-9e01-abec897af39b/kube-rbac-proxy-self/0.log" Jul 29 23:04:14.853518 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:14.853488 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-7kr7n_276b66d3-320e-482e-9e01-abec897af39b/openshift-state-metrics/0.log" Jul 29 23:04:14.892863 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:14.892833 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7/prometheus/0.log" Jul 29 23:04:14.914116 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:14.914080 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7/config-reloader/0.log" Jul 29 23:04:14.940517 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:14.940479 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7/thanos-sidecar/0.log" Jul 29 23:04:14.962887 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:14.962847 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7/kube-rbac-proxy-web/0.log" Jul 29 23:04:14.989744 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:14.989718 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7/kube-rbac-proxy/0.log" Jul 29 23:04:15.014305 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:15.014279 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7/kube-rbac-proxy-thanos/0.log" Jul 29 23:04:15.036361 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:15.036331 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ca3da2f-5982-49d4-9c5b-3c78f7e15ac7/init-config-reloader/0.log" Jul 29 23:04:15.214656 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:15.214547 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-758bc6d4b-pdkf4_bcea12a1-da75-478c-b78e-10e4e2659aa8/thanos-query/0.log" Jul 29 23:04:15.235426 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:15.235400 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-758bc6d4b-pdkf4_bcea12a1-da75-478c-b78e-10e4e2659aa8/kube-rbac-proxy-web/0.log" Jul 29 23:04:15.255776 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:15.255747 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-758bc6d4b-pdkf4_bcea12a1-da75-478c-b78e-10e4e2659aa8/kube-rbac-proxy/0.log" Jul 29 23:04:15.281071 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:15.281043 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-758bc6d4b-pdkf4_bcea12a1-da75-478c-b78e-10e4e2659aa8/prom-label-proxy/0.log" Jul 29 23:04:15.304296 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:15.304266 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-758bc6d4b-pdkf4_bcea12a1-da75-478c-b78e-10e4e2659aa8/kube-rbac-proxy-rules/0.log" Jul 29 23:04:15.349371 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:15.347771 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-758bc6d4b-pdkf4_bcea12a1-da75-478c-b78e-10e4e2659aa8/kube-rbac-proxy-metrics/0.log" Jul 29 23:04:17.671957 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:17.671925 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f9b495d4-989mf_ccbd8190-0335-4ca6-ae37-f58fc16ed097/console/0.log" Jul 29 23:04:17.705801 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:17.705768 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-2q5xk_7a24d6ed-ed41-4133-953c-ca387e4593ec/download-server/0.log" Jul 29 23:04:18.368091 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:18.368055 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-z2kfm/perf-node-gather-daemonset-4p4lw"] Jul 29 23:04:18.368434 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:18.368419 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff" containerName="copy" Jul 29 23:04:18.368515 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:18.368453 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff" containerName="copy" Jul 29 23:04:18.368515 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:18.368462 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff" containerName="gather" Jul 29 23:04:18.368515 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:18.368468 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff" containerName="gather" Jul 29 23:04:18.368699 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:18.368524 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff" containerName="copy" Jul 29 23:04:18.368699 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:18.368533 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="4353e6c9-a2ed-47bf-a8d2-da60eac8e4ff" containerName="gather" Jul 29 23:04:18.373528 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:18.373502 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z2kfm/perf-node-gather-daemonset-4p4lw" Jul 29 23:04:18.382312 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:18.382280 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z2kfm/perf-node-gather-daemonset-4p4lw"] Jul 29 23:04:18.497932 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:18.497891 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbc347ff-e5b9-464d-a3b1-3617c481b2a9-sys\") pod \"perf-node-gather-daemonset-4p4lw\" (UID: \"fbc347ff-e5b9-464d-a3b1-3617c481b2a9\") " pod="openshift-must-gather-z2kfm/perf-node-gather-daemonset-4p4lw" Jul 29 23:04:18.498109 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:18.497953 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj92k\" (UniqueName: \"kubernetes.io/projected/fbc347ff-e5b9-464d-a3b1-3617c481b2a9-kube-api-access-fj92k\") pod \"perf-node-gather-daemonset-4p4lw\" (UID: \"fbc347ff-e5b9-464d-a3b1-3617c481b2a9\") " pod="openshift-must-gather-z2kfm/perf-node-gather-daemonset-4p4lw" Jul 29 23:04:18.498109 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:18.497990 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbc347ff-e5b9-464d-a3b1-3617c481b2a9-lib-modules\") pod \"perf-node-gather-daemonset-4p4lw\" (UID: \"fbc347ff-e5b9-464d-a3b1-3617c481b2a9\") " pod="openshift-must-gather-z2kfm/perf-node-gather-daemonset-4p4lw" Jul 29 23:04:18.498109 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:18.498019 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fbc347ff-e5b9-464d-a3b1-3617c481b2a9-podres\") pod \"perf-node-gather-daemonset-4p4lw\" (UID: \"fbc347ff-e5b9-464d-a3b1-3617c481b2a9\") " pod="openshift-must-gather-z2kfm/perf-node-gather-daemonset-4p4lw" Jul 29 23:04:18.498109 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:18.498084 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fbc347ff-e5b9-464d-a3b1-3617c481b2a9-proc\") pod \"perf-node-gather-daemonset-4p4lw\" (UID: \"fbc347ff-e5b9-464d-a3b1-3617c481b2a9\") " pod="openshift-must-gather-z2kfm/perf-node-gather-daemonset-4p4lw" Jul 29 23:04:18.599188 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:18.599144 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbc347ff-e5b9-464d-a3b1-3617c481b2a9-sys\") pod \"perf-node-gather-daemonset-4p4lw\" (UID: \"fbc347ff-e5b9-464d-a3b1-3617c481b2a9\") " pod="openshift-must-gather-z2kfm/perf-node-gather-daemonset-4p4lw" Jul 29 23:04:18.599423 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:18.599393 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbc347ff-e5b9-464d-a3b1-3617c481b2a9-sys\") pod \"perf-node-gather-daemonset-4p4lw\" (UID: \"fbc347ff-e5b9-464d-a3b1-3617c481b2a9\") " pod="openshift-must-gather-z2kfm/perf-node-gather-daemonset-4p4lw" Jul 29 23:04:18.599550 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:18.599529 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj92k\" (UniqueName: \"kubernetes.io/projected/fbc347ff-e5b9-464d-a3b1-3617c481b2a9-kube-api-access-fj92k\") pod \"perf-node-gather-daemonset-4p4lw\" (UID: \"fbc347ff-e5b9-464d-a3b1-3617c481b2a9\") " pod="openshift-must-gather-z2kfm/perf-node-gather-daemonset-4p4lw" Jul 29 23:04:18.599685 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:18.599669 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbc347ff-e5b9-464d-a3b1-3617c481b2a9-lib-modules\") pod \"perf-node-gather-daemonset-4p4lw\" (UID: \"fbc347ff-e5b9-464d-a3b1-3617c481b2a9\") " pod="openshift-must-gather-z2kfm/perf-node-gather-daemonset-4p4lw" Jul 29 23:04:18.599801 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:18.599787 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fbc347ff-e5b9-464d-a3b1-3617c481b2a9-podres\") pod \"perf-node-gather-daemonset-4p4lw\" (UID: \"fbc347ff-e5b9-464d-a3b1-3617c481b2a9\") " pod="openshift-must-gather-z2kfm/perf-node-gather-daemonset-4p4lw" Jul 29 23:04:18.599920 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:18.599908 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fbc347ff-e5b9-464d-a3b1-3617c481b2a9-proc\") pod \"perf-node-gather-daemonset-4p4lw\" (UID: \"fbc347ff-e5b9-464d-a3b1-3617c481b2a9\") " pod="openshift-must-gather-z2kfm/perf-node-gather-daemonset-4p4lw" Jul 29 23:04:18.600138 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:18.600120 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fbc347ff-e5b9-464d-a3b1-3617c481b2a9-proc\") pod \"perf-node-gather-daemonset-4p4lw\" (UID: \"fbc347ff-e5b9-464d-a3b1-3617c481b2a9\") " pod="openshift-must-gather-z2kfm/perf-node-gather-daemonset-4p4lw" Jul 29 23:04:18.600314 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:18.600290 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbc347ff-e5b9-464d-a3b1-3617c481b2a9-lib-modules\") pod \"perf-node-gather-daemonset-4p4lw\" (UID: \"fbc347ff-e5b9-464d-a3b1-3617c481b2a9\") " pod="openshift-must-gather-z2kfm/perf-node-gather-daemonset-4p4lw" Jul 29 23:04:18.600381 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:18.600290 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fbc347ff-e5b9-464d-a3b1-3617c481b2a9-podres\") pod \"perf-node-gather-daemonset-4p4lw\" (UID: \"fbc347ff-e5b9-464d-a3b1-3617c481b2a9\") " pod="openshift-must-gather-z2kfm/perf-node-gather-daemonset-4p4lw" Jul 29 23:04:18.609466 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:18.609427 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj92k\" (UniqueName: \"kubernetes.io/projected/fbc347ff-e5b9-464d-a3b1-3617c481b2a9-kube-api-access-fj92k\") pod \"perf-node-gather-daemonset-4p4lw\" (UID: \"fbc347ff-e5b9-464d-a3b1-3617c481b2a9\") " pod="openshift-must-gather-z2kfm/perf-node-gather-daemonset-4p4lw" Jul 29 23:04:18.685218 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:18.685134 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z2kfm/perf-node-gather-daemonset-4p4lw" Jul 29 23:04:18.859433 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:18.859008 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z2kfm/perf-node-gather-daemonset-4p4lw"] Jul 29 23:04:18.863061 ip-10-0-138-44 kubenswrapper[2570]: W0729 23:04:18.863019 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfbc347ff_e5b9_464d_a3b1_3617c481b2a9.slice/crio-d090fa408c04a46720ac850933cbb62bbf32dab8845911363da0b6073bc88875 WatchSource:0}: Error finding container d090fa408c04a46720ac850933cbb62bbf32dab8845911363da0b6073bc88875: Status 404 returned error can't find the container with id d090fa408c04a46720ac850933cbb62bbf32dab8845911363da0b6073bc88875 Jul 29 23:04:18.934093 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:18.934063 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z2kfm/perf-node-gather-daemonset-4p4lw" event={"ID":"fbc347ff-e5b9-464d-a3b1-3617c481b2a9","Type":"ContainerStarted","Data":"d090fa408c04a46720ac850933cbb62bbf32dab8845911363da0b6073bc88875"} Jul 29 23:04:19.232943 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:19.232862 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qzms6_5f29f636-a8bd-4503-90bb-98290dccbb49/dns/0.log" Jul 29 23:04:19.252491 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:19.252456 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qzms6_5f29f636-a8bd-4503-90bb-98290dccbb49/kube-rbac-proxy/0.log" Jul 29 23:04:19.323885 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:19.323855 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8pmwl_3100527d-fac5-4ee7-90fa-1171a661b55d/dns-node-resolver/0.log" Jul 29 23:04:19.873558 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:19.873521 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nqd4j_c7d70a2c-8566-4797-914d-58c194ab083c/node-ca/0.log" Jul 29 23:04:19.939887 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:19.939841 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z2kfm/perf-node-gather-daemonset-4p4lw" event={"ID":"fbc347ff-e5b9-464d-a3b1-3617c481b2a9","Type":"ContainerStarted","Data":"a5ccadf61c06e2551a6c9a317db4c43338173b9ee10e0921c61c234de1ffbe0e"} Jul 29 23:04:19.940121 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:19.939924 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-z2kfm/perf-node-gather-daemonset-4p4lw" Jul 29 23:04:19.955685 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:19.955614 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-z2kfm/perf-node-gather-daemonset-4p4lw" podStartSLOduration=1.9555938240000001 podStartE2EDuration="1.955593824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 23:04:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 23:04:19.955427846 +0000 UTC m=+1069.911523701" watchObservedRunningTime="2026-07-29 23:04:19.955593824 +0000 UTC m=+1069.911689684" Jul 29 23:04:21.039267 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:21.039239 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-smhlc_7ede295e-e0e9-4a75-b7de-109a53d9fe57/serve-healthcheck-canary/0.log" Jul 29 23:04:21.542941 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:21.542915 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w7x54_b5a74cf5-440b-4152-8375-aca329c2b646/kube-rbac-proxy/0.log" Jul 29 23:04:21.561710 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:21.561682 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w7x54_b5a74cf5-440b-4152-8375-aca329c2b646/exporter/0.log" Jul 29 23:04:21.581861 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:21.581833 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w7x54_b5a74cf5-440b-4152-8375-aca329c2b646/extractor/0.log" Jul 29 23:04:25.956389 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:25.956316 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-z2kfm/perf-node-gather-daemonset-4p4lw" Jul 29 23:04:27.810935 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:27.810888 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-42mhf_3d6c0871-b732-4f0f-9c25-b14d6cae35b8/migrator/0.log" Jul 29 23:04:27.831424 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:27.831404 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-42mhf_3d6c0871-b732-4f0f-9c25-b14d6cae35b8/graceful-termination/0.log" Jul 29 23:04:29.197931 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:29.197897 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2zd5p_198acb98-b9c5-4b6e-b231-074ba237ecd5/kube-multus/0.log" Jul 29 23:04:29.220378 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:29.220349 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4jxr2_6817a1b0-e9d5-44a1-9e72-400f0911f52b/kube-multus-additional-cni-plugins/0.log" Jul 29 23:04:29.239683 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:29.239656 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4jxr2_6817a1b0-e9d5-44a1-9e72-400f0911f52b/egress-router-binary-copy/0.log" Jul 29 23:04:29.259084 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:29.259059 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4jxr2_6817a1b0-e9d5-44a1-9e72-400f0911f52b/cni-plugins/0.log" Jul 29 23:04:29.280427 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:29.280402 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4jxr2_6817a1b0-e9d5-44a1-9e72-400f0911f52b/bond-cni-plugin/0.log" Jul 29 23:04:29.305946 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:29.305916 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4jxr2_6817a1b0-e9d5-44a1-9e72-400f0911f52b/routeoverride-cni/0.log" Jul 29 23:04:29.326510 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:29.326481 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4jxr2_6817a1b0-e9d5-44a1-9e72-400f0911f52b/whereabouts-cni-bincopy/0.log" Jul 29 23:04:29.350959 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:29.350923 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4jxr2_6817a1b0-e9d5-44a1-9e72-400f0911f52b/whereabouts-cni/0.log" Jul 29 23:04:29.783671 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:29.783621 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wfdzg_6f61a04d-54f8-42b5-978f-0298dd8ac438/network-metrics-daemon/0.log" Jul 29 23:04:29.801394 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:29.801366 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wfdzg_6f61a04d-54f8-42b5-978f-0298dd8ac438/kube-rbac-proxy/0.log" Jul 29 23:04:30.621552 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:30.621505 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65k6t_a674054c-c6ca-4f41-9d96-9253b99152d4/ovn-controller/0.log" Jul 29 23:04:30.638204 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:30.638174 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65k6t_a674054c-c6ca-4f41-9d96-9253b99152d4/ovn-acl-logging/1.log" Jul 29 23:04:30.638204 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:30.638194 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65k6t_a674054c-c6ca-4f41-9d96-9253b99152d4/ovn-acl-logging/0.log" Jul 29 23:04:30.657041 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:30.657010 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65k6t_a674054c-c6ca-4f41-9d96-9253b99152d4/kube-rbac-proxy-node/0.log" Jul 29 23:04:30.680045 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:30.680012 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65k6t_a674054c-c6ca-4f41-9d96-9253b99152d4/kube-rbac-proxy-ovn-metrics/0.log" Jul 29 23:04:30.700142 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:30.700114 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65k6t_a674054c-c6ca-4f41-9d96-9253b99152d4/northd/0.log" Jul 29 23:04:30.720743 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:30.720714 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65k6t_a674054c-c6ca-4f41-9d96-9253b99152d4/nbdb/0.log" Jul 29 23:04:30.740043 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:30.739958 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65k6t_a674054c-c6ca-4f41-9d96-9253b99152d4/sbdb/0.log" Jul 29 23:04:30.798987 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:30.798956 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65k6t_a674054c-c6ca-4f41-9d96-9253b99152d4/ovnkube-controller/0.log" Jul 29 23:04:32.252780 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:32.252748 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-xs48r_29dab441-c8b5-45e4-b586-5c52a843833d/network-check-target-container/0.log" Jul 29 23:04:33.176063 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:33.176036 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-d8gxw_509e6d64-9d9b-4979-8554-f915cde622f0/iptables-alerter/0.log" Jul 29 23:04:33.786622 ip-10-0-138-44 kubenswrapper[2570]: I0729 23:04:33.786570 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-4pd24_0485ba10-803b-4f61-8efd-2c9434e67584/tuned/0.log"