Jul 29 18:32:01.804237 ip-10-0-132-135 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 29 18:32:01.804249 ip-10-0-132-135 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 29 18:32:01.804255 ip-10-0-132-135 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 29 18:32:01.804504 ip-10-0-132-135 systemd[1]: Failed to start Kubernetes Kubelet. Jul 29 18:32:12.048711 ip-10-0-132-135 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 29 18:32:12.048734 ip-10-0-132-135 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot f99471b70a9b41b0a13ff34f32111a64 -- Jul 29 18:34:08.526872 ip-10-0-132-135 systemd[1]: Starting Kubernetes Kubelet... Jul 29 18:34:08.993117 ip-10-0-132-135 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 18:34:08.993117 ip-10-0-132-135 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 29 18:34:08.993117 ip-10-0-132-135 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 18:34:08.993117 ip-10-0-132-135 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 29 18:34:08.993117 ip-10-0-132-135 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 18:34:08.996596 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:08.996458 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 29 18:34:09.007367 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007345 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 18:34:09.007367 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007363 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 18:34:09.007367 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007367 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 18:34:09.007367 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007370 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 18:34:09.007490 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007374 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 18:34:09.007490 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007377 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 18:34:09.007490 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007380 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 18:34:09.007490 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007383 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 18:34:09.007490 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007386 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 18:34:09.007490 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007389 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 18:34:09.007490 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007392 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 18:34:09.007490 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007395 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 18:34:09.007490 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007398 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 18:34:09.007490 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007400 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 18:34:09.007490 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007403 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 18:34:09.007490 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007406 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 18:34:09.007490 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007409 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 18:34:09.007490 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007411 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 18:34:09.007490 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007415 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 18:34:09.007490 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007418 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 18:34:09.007490 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007420 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 18:34:09.007490 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007423 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 18:34:09.007490 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007426 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 18:34:09.007490 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007429 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 18:34:09.008014 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007432 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 18:34:09.008014 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007438 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 18:34:09.008014 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007442 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 18:34:09.008014 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007445 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 18:34:09.008014 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007448 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 18:34:09.008014 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007451 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 18:34:09.008014 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007454 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 18:34:09.008014 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007457 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 18:34:09.008014 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007460 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 18:34:09.008014 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007463 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 18:34:09.008014 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007466 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 18:34:09.008014 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007468 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 18:34:09.008014 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007471 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 18:34:09.008014 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007475 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 18:34:09.008014 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007479 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 18:34:09.008014 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007483 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 18:34:09.008014 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007486 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 18:34:09.008014 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007490 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 18:34:09.008014 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007493 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 18:34:09.008014 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007496 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 18:34:09.008546 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007499 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 18:34:09.008546 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007502 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 29 18:34:09.008546 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007505 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 18:34:09.008546 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007508 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 18:34:09.008546 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007512 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 18:34:09.008546 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007516 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 18:34:09.008546 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007519 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 18:34:09.008546 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007522 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 18:34:09.008546 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007526 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 18:34:09.008546 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007529 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 18:34:09.008546 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007532 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 18:34:09.008546 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007535 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 18:34:09.008546 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007538 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 18:34:09.008546 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007542 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 18:34:09.008546 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007545 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 18:34:09.008546 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007547 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 18:34:09.008546 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007551 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 18:34:09.008546 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007554 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 18:34:09.008546 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007557 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 18:34:09.009058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007559 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 18:34:09.009058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007562 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 18:34:09.009058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007565 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 18:34:09.009058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007567 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 18:34:09.009058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007570 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 18:34:09.009058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007587 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 18:34:09.009058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007593 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 18:34:09.009058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007600 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 18:34:09.009058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007604 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 18:34:09.009058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007608 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 18:34:09.009058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007611 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 18:34:09.009058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007614 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 18:34:09.009058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007617 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 18:34:09.009058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007619 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 18:34:09.009058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007624 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 18:34:09.009058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007627 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 18:34:09.009058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007629 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 18:34:09.009058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007633 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 18:34:09.009058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007635 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 18:34:09.009552 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007638 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 18:34:09.009552 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007641 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 18:34:09.009552 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007644 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 18:34:09.009552 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007646 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 18:34:09.009552 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007649 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 18:34:09.009552 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007652 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 18:34:09.009552 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007655 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 18:34:09.009552 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007657 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 18:34:09.009552 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007660 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 18:34:09.009552 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007663 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 18:34:09.009552 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007666 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 18:34:09.009552 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007668 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 18:34:09.009552 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007671 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 18:34:09.009552 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007673 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 18:34:09.009552 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007676 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 18:34:09.009552 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007679 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 18:34:09.009552 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.007682 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 18:34:09.009552 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008448 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 18:34:09.009552 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008456 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 18:34:09.009552 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008461 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 18:34:09.010097 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008464 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 18:34:09.010097 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008468 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 18:34:09.010097 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008471 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 18:34:09.010097 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008474 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 18:34:09.010097 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008476 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 18:34:09.010097 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008480 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 18:34:09.010097 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008482 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 18:34:09.010097 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008485 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 18:34:09.010097 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008489 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 18:34:09.010097 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008492 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 18:34:09.010097 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008495 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 18:34:09.010097 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008498 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 18:34:09.010097 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008501 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 18:34:09.010097 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008503 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 18:34:09.010097 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008506 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 18:34:09.010097 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008509 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 18:34:09.010097 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008513 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 18:34:09.010097 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008517 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 18:34:09.010097 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008520 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 18:34:09.010097 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008523 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 18:34:09.010680 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008527 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 18:34:09.010680 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008529 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 18:34:09.010680 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008532 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 18:34:09.010680 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008535 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 18:34:09.010680 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008537 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 18:34:09.010680 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008541 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 29 18:34:09.010680 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008543 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 18:34:09.010680 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008546 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 18:34:09.010680 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008549 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 18:34:09.010680 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008552 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 18:34:09.010680 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008554 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 18:34:09.010680 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008560 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 18:34:09.010680 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008565 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 18:34:09.010680 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008567 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 18:34:09.010680 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008570 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 18:34:09.010680 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008573 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 18:34:09.010680 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008576 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 18:34:09.010680 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008578 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 18:34:09.010680 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008581 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 18:34:09.011179 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008584 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 18:34:09.011179 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008587 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 18:34:09.011179 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008590 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 18:34:09.011179 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008593 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 18:34:09.011179 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008596 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 18:34:09.011179 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008599 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 18:34:09.011179 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008601 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 18:34:09.011179 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008604 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 18:34:09.011179 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008606 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 18:34:09.011179 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008609 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 18:34:09.011179 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008612 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 18:34:09.011179 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008615 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 18:34:09.011179 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008618 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 18:34:09.011179 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008620 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 18:34:09.011179 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008623 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 18:34:09.011179 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008626 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 18:34:09.011179 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008628 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 18:34:09.011179 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008631 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 18:34:09.011179 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008651 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 18:34:09.011179 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008654 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 18:34:09.011712 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008658 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 18:34:09.011712 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008660 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 18:34:09.011712 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008663 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 18:34:09.011712 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008666 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 18:34:09.011712 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008669 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 18:34:09.011712 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008672 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 18:34:09.011712 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008675 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 18:34:09.011712 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008677 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 18:34:09.011712 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008682 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 18:34:09.011712 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008686 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 18:34:09.011712 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008689 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 18:34:09.011712 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008692 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 18:34:09.011712 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008696 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 18:34:09.011712 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008698 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 18:34:09.011712 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008701 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 18:34:09.011712 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008704 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 18:34:09.011712 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008707 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 18:34:09.011712 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008710 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 18:34:09.011712 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008713 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 18:34:09.012205 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008715 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 18:34:09.012205 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008718 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 18:34:09.012205 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008721 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 18:34:09.012205 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008724 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 18:34:09.012205 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008727 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 18:34:09.012205 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008729 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 18:34:09.012205 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008732 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 18:34:09.012205 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008735 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 18:34:09.012205 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008737 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 18:34:09.012205 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008740 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 18:34:09.012205 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008744 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 18:34:09.012205 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008746 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 18:34:09.012205 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008749 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 18:34:09.012205 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008752 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 18:34:09.012205 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008755 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 18:34:09.012205 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008758 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 18:34:09.012205 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008760 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 18:34:09.012205 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.008763 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 18:34:09.012205 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009169 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 18:34:09.012718 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009173 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 18:34:09.012718 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009176 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 18:34:09.012718 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009180 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 18:34:09.012718 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009183 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 18:34:09.012718 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009186 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 18:34:09.012718 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009189 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 18:34:09.012718 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009191 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 18:34:09.012718 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009194 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 18:34:09.012718 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009197 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 18:34:09.012718 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009200 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 18:34:09.012718 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009203 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 18:34:09.012718 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009206 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 18:34:09.012718 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009209 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 18:34:09.012718 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009212 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 18:34:09.012718 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009229 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 18:34:09.012718 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009233 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 18:34:09.012718 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009236 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 18:34:09.012718 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009239 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 18:34:09.012718 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009242 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 18:34:09.013211 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009245 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 18:34:09.013211 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009248 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 18:34:09.013211 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009251 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 18:34:09.013211 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009254 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 18:34:09.013211 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009257 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 18:34:09.013211 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009260 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 18:34:09.013211 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009263 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 18:34:09.013211 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009266 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 18:34:09.013211 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009271 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 18:34:09.013211 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009274 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 18:34:09.013211 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009277 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 18:34:09.013211 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009280 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 18:34:09.013211 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009283 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 18:34:09.013211 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009286 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 18:34:09.013211 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009289 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 18:34:09.013211 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009292 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 18:34:09.013211 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009294 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 18:34:09.013211 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009298 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 18:34:09.013211 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009302 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 18:34:09.013748 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009305 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 18:34:09.013748 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009308 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 18:34:09.013748 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009311 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 18:34:09.013748 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009314 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 18:34:09.013748 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009318 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 18:34:09.013748 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009320 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 18:34:09.013748 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009324 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 18:34:09.013748 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009326 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 18:34:09.013748 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009329 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 18:34:09.013748 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009332 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 18:34:09.013748 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009337 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 18:34:09.013748 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009340 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 18:34:09.013748 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009343 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 18:34:09.013748 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009347 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 18:34:09.013748 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009350 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 18:34:09.013748 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009354 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 18:34:09.013748 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009359 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 18:34:09.013748 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009362 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 18:34:09.013748 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009365 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 18:34:09.014245 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009370 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 18:34:09.014245 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009373 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 18:34:09.014245 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009376 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 18:34:09.014245 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009378 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 18:34:09.014245 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009381 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 18:34:09.014245 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009384 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 18:34:09.014245 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009387 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 18:34:09.014245 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009390 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 18:34:09.014245 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009392 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 18:34:09.014245 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009395 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 18:34:09.014245 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009398 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 18:34:09.014245 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009401 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 18:34:09.014245 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009403 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 18:34:09.014245 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009406 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 18:34:09.014245 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009409 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 18:34:09.014245 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009412 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 18:34:09.014245 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009415 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 18:34:09.014245 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009417 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 18:34:09.014245 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009421 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 18:34:09.014245 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009423 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 18:34:09.014780 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009426 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 18:34:09.014780 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009429 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 18:34:09.014780 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009431 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 18:34:09.014780 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009436 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 18:34:09.014780 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009439 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 18:34:09.014780 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009442 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 18:34:09.014780 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009445 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 29 18:34:09.014780 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009448 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 18:34:09.014780 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009450 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 18:34:09.014780 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009455 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 18:34:09.014780 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009458 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 18:34:09.014780 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009460 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 18:34:09.014780 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009463 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 18:34:09.014780 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009466 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 18:34:09.014780 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009469 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 18:34:09.014780 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009471 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 18:34:09.014780 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009474 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 18:34:09.014780 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009477 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 18:34:09.014780 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009480 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 18:34:09.014780 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009483 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 18:34:09.015329 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.009485 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 18:34:09.015329 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009560 2560 flags.go:64] FLAG: --address="0.0.0.0" Jul 29 18:34:09.015329 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009572 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 29 18:34:09.015329 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009578 2560 flags.go:64] FLAG: --anonymous-auth="true" Jul 29 18:34:09.015329 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009582 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 29 18:34:09.015329 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009587 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 29 18:34:09.015329 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009590 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 29 18:34:09.015329 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009595 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 29 18:34:09.015329 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009600 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 29 18:34:09.015329 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009604 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 29 18:34:09.015329 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009608 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 29 18:34:09.015329 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009617 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 29 18:34:09.015329 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009621 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 29 18:34:09.015329 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009624 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 29 18:34:09.015329 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009628 2560 flags.go:64] FLAG: --cgroup-root="" Jul 29 18:34:09.015329 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009645 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 29 18:34:09.015329 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009649 2560 flags.go:64] FLAG: --client-ca-file="" Jul 29 18:34:09.015329 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009652 2560 flags.go:64] FLAG: --cloud-provider="external" Jul 29 18:34:09.015329 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009655 2560 flags.go:64] FLAG: --cluster-dns="[]" Jul 29 18:34:09.015329 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009660 2560 flags.go:64] FLAG: --cluster-domain="" Jul 29 18:34:09.015329 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009663 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 29 18:34:09.015329 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009667 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 29 18:34:09.015329 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009671 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 29 18:34:09.015329 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009675 2560 flags.go:64] FLAG: --container-log-max-files="5" Jul 29 18:34:09.015985 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009679 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 29 18:34:09.015985 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009682 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 29 18:34:09.015985 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009685 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 29 18:34:09.015985 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009689 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 29 18:34:09.015985 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009692 2560 flags.go:64] FLAG: --contention-profiling="false" Jul 29 18:34:09.015985 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009695 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 29 18:34:09.015985 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009698 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 29 18:34:09.015985 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009702 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 29 18:34:09.015985 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009705 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 29 18:34:09.015985 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009709 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 29 18:34:09.015985 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009713 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 29 18:34:09.015985 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009716 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 29 18:34:09.015985 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009719 2560 flags.go:64] FLAG: --enable-load-reader="false" Jul 29 18:34:09.015985 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009722 2560 flags.go:64] FLAG: --enable-server="true" Jul 29 18:34:09.015985 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009725 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 29 18:34:09.015985 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009729 2560 flags.go:64] FLAG: --event-burst="100" Jul 29 18:34:09.015985 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009732 2560 flags.go:64] FLAG: --event-qps="50" Jul 29 18:34:09.015985 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009736 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 29 18:34:09.015985 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009739 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 29 18:34:09.015985 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009742 2560 flags.go:64] FLAG: --eviction-hard="" Jul 29 18:34:09.015985 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009746 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 29 18:34:09.015985 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009749 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 29 18:34:09.015985 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009752 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 29 18:34:09.015985 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009756 2560 flags.go:64] FLAG: --eviction-soft="" Jul 29 18:34:09.015985 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009759 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 29 18:34:09.016767 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009762 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 29 18:34:09.016767 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009766 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 29 18:34:09.016767 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009769 2560 flags.go:64] FLAG: --experimental-mounter-path="" Jul 29 18:34:09.016767 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009772 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 29 18:34:09.016767 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009775 2560 flags.go:64] FLAG: --fail-swap-on="true" Jul 29 18:34:09.016767 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009779 2560 flags.go:64] FLAG: --feature-gates="" Jul 29 18:34:09.016767 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009783 2560 flags.go:64] FLAG: --file-check-frequency="20s" Jul 29 18:34:09.016767 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009786 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 29 18:34:09.016767 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009789 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 29 18:34:09.016767 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009792 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 29 18:34:09.016767 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009796 2560 flags.go:64] FLAG: --healthz-port="10248" Jul 29 18:34:09.016767 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009799 2560 flags.go:64] FLAG: --help="false" Jul 29 18:34:09.016767 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009802 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-132-135.ec2.internal" Jul 29 18:34:09.016767 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009805 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 29 18:34:09.016767 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009809 2560 flags.go:64] FLAG: --http-check-frequency="20s" Jul 29 18:34:09.016767 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009812 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 29 18:34:09.016767 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009815 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 29 18:34:09.016767 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009819 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 29 18:34:09.016767 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009822 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 29 18:34:09.016767 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009825 2560 flags.go:64] FLAG: --image-service-endpoint="" Jul 29 18:34:09.016767 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009828 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 29 18:34:09.016767 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009831 2560 flags.go:64] FLAG: --kube-api-burst="100" Jul 29 18:34:09.016767 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009834 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 29 18:34:09.017402 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009837 2560 flags.go:64] FLAG: --kube-api-qps="50" Jul 29 18:34:09.017402 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009840 2560 flags.go:64] FLAG: --kube-reserved="" Jul 29 18:34:09.017402 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009844 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 29 18:34:09.017402 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009847 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 29 18:34:09.017402 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009850 2560 flags.go:64] FLAG: --kubelet-cgroups="" Jul 29 18:34:09.017402 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009854 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 29 18:34:09.017402 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009857 2560 flags.go:64] FLAG: --lock-file="" Jul 29 18:34:09.017402 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009860 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 29 18:34:09.017402 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009863 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 29 18:34:09.017402 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009866 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 29 18:34:09.017402 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009872 2560 flags.go:64] FLAG: --log-json-split-stream="false" Jul 29 18:34:09.017402 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009875 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 29 18:34:09.017402 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009878 2560 flags.go:64] FLAG: --log-text-split-stream="false" Jul 29 18:34:09.017402 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009881 2560 flags.go:64] FLAG: --logging-format="text" Jul 29 18:34:09.017402 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009884 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 29 18:34:09.017402 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009887 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 29 18:34:09.017402 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009890 2560 flags.go:64] FLAG: --manifest-url="" Jul 29 18:34:09.017402 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009893 2560 flags.go:64] FLAG: --manifest-url-header="" Jul 29 18:34:09.017402 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009898 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 29 18:34:09.017402 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009901 2560 flags.go:64] FLAG: --max-open-files="1000000" Jul 29 18:34:09.017402 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009905 2560 flags.go:64] FLAG: --max-pods="110" Jul 29 18:34:09.017402 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009908 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 29 18:34:09.017402 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009912 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 29 18:34:09.017402 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009915 2560 flags.go:64] FLAG: --memory-manager-policy="None" Jul 29 18:34:09.017402 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009918 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 29 18:34:09.018058 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009921 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 29 18:34:09.018058 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009924 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 29 18:34:09.018058 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009927 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 29 18:34:09.018058 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009936 2560 flags.go:64] FLAG: --node-status-max-images="50" Jul 29 18:34:09.018058 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009939 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 29 18:34:09.018058 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009942 2560 flags.go:64] FLAG: --oom-score-adj="-999" Jul 29 18:34:09.018058 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009945 2560 flags.go:64] FLAG: --pod-cidr="" Jul 29 18:34:09.018058 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009948 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 29 18:34:09.018058 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009954 2560 flags.go:64] FLAG: --pod-manifest-path="" Jul 29 18:34:09.018058 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009957 2560 flags.go:64] FLAG: --pod-max-pids="-1" Jul 29 18:34:09.018058 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009961 2560 flags.go:64] FLAG: --pods-per-core="0" Jul 29 18:34:09.018058 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009964 2560 flags.go:64] FLAG: --port="10250" Jul 29 18:34:09.018058 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009967 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 29 18:34:09.018058 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009970 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d1022e25d6199194" Jul 29 18:34:09.018058 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009973 2560 flags.go:64] FLAG: --qos-reserved="" Jul 29 18:34:09.018058 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009977 2560 flags.go:64] FLAG: --read-only-port="10255" Jul 29 18:34:09.018058 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009980 2560 flags.go:64] FLAG: --register-node="true" Jul 29 18:34:09.018058 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009983 2560 flags.go:64] FLAG: --register-with-taints="" Jul 29 18:34:09.018058 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009987 2560 flags.go:64] FLAG: --registry-burst="10" Jul 29 18:34:09.018058 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009990 2560 flags.go:64] FLAG: --registry-qps="5" Jul 29 18:34:09.018058 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009993 2560 flags.go:64] FLAG: --reserved-cpus="" Jul 29 18:34:09.018058 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.009996 2560 flags.go:64] FLAG: --reserved-memory="" Jul 29 18:34:09.018058 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010000 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 29 18:34:09.018058 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010004 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 29 18:34:09.018058 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010007 2560 flags.go:64] FLAG: --rotate-certificates="false" Jul 29 18:34:09.018720 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010010 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 29 18:34:09.018720 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010013 2560 flags.go:64] FLAG: --runonce="false" Jul 29 18:34:09.018720 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010016 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 29 18:34:09.018720 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010020 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 29 18:34:09.018720 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010023 2560 flags.go:64] FLAG: --seccomp-default="false" Jul 29 18:34:09.018720 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010026 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 29 18:34:09.018720 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010029 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 29 18:34:09.018720 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010032 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 29 18:34:09.018720 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010036 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 29 18:34:09.018720 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010039 2560 flags.go:64] FLAG: --storage-driver-password="root" Jul 29 18:34:09.018720 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010042 2560 flags.go:64] FLAG: --storage-driver-secure="false" Jul 29 18:34:09.018720 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010046 2560 flags.go:64] FLAG: --storage-driver-table="stats" Jul 29 18:34:09.018720 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010049 2560 flags.go:64] FLAG: --storage-driver-user="root" Jul 29 18:34:09.018720 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010052 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 29 18:34:09.018720 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010055 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 29 18:34:09.018720 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010058 2560 flags.go:64] FLAG: --system-cgroups="" Jul 29 18:34:09.018720 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010061 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 29 18:34:09.018720 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010067 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 29 18:34:09.018720 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010070 2560 flags.go:64] FLAG: --tls-cert-file="" Jul 29 18:34:09.018720 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010073 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 29 18:34:09.018720 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010077 2560 flags.go:64] FLAG: --tls-min-version="" Jul 29 18:34:09.018720 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010081 2560 flags.go:64] FLAG: --tls-private-key-file="" Jul 29 18:34:09.018720 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010086 2560 flags.go:64] FLAG: --topology-manager-policy="none" Jul 29 18:34:09.018720 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010089 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 29 18:34:09.018720 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010092 2560 flags.go:64] FLAG: --topology-manager-scope="container" Jul 29 18:34:09.019401 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010095 2560 flags.go:64] FLAG: --v="2" Jul 29 18:34:09.019401 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010099 2560 flags.go:64] FLAG: --version="false" Jul 29 18:34:09.019401 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010105 2560 flags.go:64] FLAG: --vmodule="" Jul 29 18:34:09.019401 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010109 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 29 18:34:09.019401 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010113 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 29 18:34:09.019401 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010241 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 18:34:09.019401 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010246 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 18:34:09.019401 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010250 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 18:34:09.019401 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010253 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 18:34:09.019401 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010256 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 18:34:09.019401 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010259 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 18:34:09.019401 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010262 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 18:34:09.019401 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010265 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 18:34:09.019401 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010269 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 18:34:09.019401 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010272 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 18:34:09.019401 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010275 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 18:34:09.019401 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010277 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 18:34:09.019401 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010280 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 18:34:09.019401 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010283 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 18:34:09.019401 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010286 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 18:34:09.019401 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010289 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 18:34:09.020021 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010293 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 18:34:09.020021 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010296 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 18:34:09.020021 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010300 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 18:34:09.020021 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010303 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 18:34:09.020021 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010306 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 29 18:34:09.020021 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010309 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 18:34:09.020021 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010312 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 18:34:09.020021 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010315 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 18:34:09.020021 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010326 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 18:34:09.020021 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010329 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 18:34:09.020021 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010332 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 18:34:09.020021 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010335 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 18:34:09.020021 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010339 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 18:34:09.020021 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010342 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 18:34:09.020021 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010345 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 18:34:09.020021 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010348 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 18:34:09.020021 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010351 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 18:34:09.020021 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010353 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 18:34:09.020021 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010356 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 18:34:09.020530 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010359 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 18:34:09.020530 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010362 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 18:34:09.020530 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010364 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 18:34:09.020530 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010367 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 18:34:09.020530 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010370 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 18:34:09.020530 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010372 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 18:34:09.020530 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010375 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 18:34:09.020530 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010378 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 18:34:09.020530 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010381 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 18:34:09.020530 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010383 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 18:34:09.020530 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010386 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 18:34:09.020530 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010388 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 18:34:09.020530 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010391 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 18:34:09.020530 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010394 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 18:34:09.020530 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010397 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 18:34:09.020530 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010399 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 18:34:09.020530 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010402 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 18:34:09.020530 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010405 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 18:34:09.020530 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010408 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 18:34:09.020530 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010411 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 18:34:09.021058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010413 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 18:34:09.021058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010418 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 18:34:09.021058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010427 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 18:34:09.021058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010430 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 18:34:09.021058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010433 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 18:34:09.021058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010435 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 18:34:09.021058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010440 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 18:34:09.021058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010442 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 18:34:09.021058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010445 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 18:34:09.021058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010448 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 18:34:09.021058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010450 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 18:34:09.021058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010453 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 18:34:09.021058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010456 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 18:34:09.021058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010458 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 18:34:09.021058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010461 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 18:34:09.021058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010464 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 18:34:09.021058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010466 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 18:34:09.021058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010469 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 18:34:09.021058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010472 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 18:34:09.021058 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010475 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 18:34:09.021589 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010477 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 18:34:09.021589 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010480 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 18:34:09.021589 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010482 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 18:34:09.021589 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010485 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 18:34:09.021589 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010488 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 18:34:09.021589 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010490 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 18:34:09.021589 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010493 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 18:34:09.021589 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010495 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 18:34:09.021589 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010498 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 18:34:09.021589 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010501 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 18:34:09.021589 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010504 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 18:34:09.021589 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010507 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 18:34:09.021589 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010510 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 18:34:09.021589 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010514 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 18:34:09.021589 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010517 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 18:34:09.021589 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010526 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 18:34:09.021589 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010528 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 18:34:09.021589 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010531 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 18:34:09.021589 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010536 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 18:34:09.021589 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010538 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 18:34:09.022132 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010541 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 18:34:09.022132 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010543 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 18:34:09.022132 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010547 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 18:34:09.022132 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.010551 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 18:34:09.022132 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.010557 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 18:34:09.022132 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.018149 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 29 18:34:09.022132 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.018164 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 29 18:34:09.022132 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.018803 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 29 18:34:09.022132 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.018814 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 29 18:34:09.022132 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018880 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 18:34:09.022132 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018888 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 18:34:09.022132 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018892 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 18:34:09.022132 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018895 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 18:34:09.022132 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018898 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 18:34:09.022510 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018901 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 18:34:09.022510 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018905 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 18:34:09.022510 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018908 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 18:34:09.022510 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018911 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 18:34:09.022510 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018914 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 18:34:09.022510 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018917 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 18:34:09.022510 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018920 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 18:34:09.022510 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018923 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 18:34:09.022510 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018926 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 18:34:09.022510 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018929 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 18:34:09.022510 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018931 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 18:34:09.022510 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018934 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 18:34:09.022510 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018937 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 18:34:09.022510 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018941 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 18:34:09.022510 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018943 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 18:34:09.022510 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018946 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 18:34:09.022510 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018949 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 18:34:09.022510 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018952 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 18:34:09.022510 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018955 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 18:34:09.022510 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018958 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 18:34:09.023040 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018960 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 18:34:09.023040 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018964 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 18:34:09.023040 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018967 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 18:34:09.023040 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018969 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 18:34:09.023040 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018972 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 18:34:09.023040 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018975 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 18:34:09.023040 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018978 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 18:34:09.023040 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018984 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 18:34:09.023040 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018989 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 18:34:09.023040 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018992 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 18:34:09.023040 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.018996 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 18:34:09.023040 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019000 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 18:34:09.023040 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019003 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 18:34:09.023040 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019007 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 18:34:09.023040 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019010 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 18:34:09.023040 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019013 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 18:34:09.023040 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019015 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 18:34:09.023040 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019020 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 18:34:09.023040 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019022 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 18:34:09.023532 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019025 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 18:34:09.023532 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019028 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 18:34:09.023532 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019048 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 18:34:09.023532 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019052 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 18:34:09.023532 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019055 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 18:34:09.023532 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019059 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 18:34:09.023532 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019062 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 18:34:09.023532 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019066 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 18:34:09.023532 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019069 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 18:34:09.023532 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019072 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 18:34:09.023532 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019075 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 18:34:09.023532 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019078 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 18:34:09.023532 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019081 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 18:34:09.023532 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019084 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 18:34:09.023532 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019088 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 18:34:09.023532 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019090 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 18:34:09.023532 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019093 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 18:34:09.023532 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019097 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 18:34:09.023532 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019100 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 18:34:09.023532 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019103 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 18:34:09.024175 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019106 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 18:34:09.024175 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019109 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 18:34:09.024175 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019111 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 18:34:09.024175 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019114 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 18:34:09.024175 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019117 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 18:34:09.024175 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019120 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 18:34:09.024175 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019123 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 18:34:09.024175 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019127 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 18:34:09.024175 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019132 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 18:34:09.024175 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019135 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 18:34:09.024175 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019137 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 18:34:09.024175 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019140 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 18:34:09.024175 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019143 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 18:34:09.024175 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019146 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 18:34:09.024175 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019149 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 18:34:09.024175 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019151 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 18:34:09.024175 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019154 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 18:34:09.024175 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019157 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 18:34:09.024175 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019159 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 18:34:09.024692 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019162 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 18:34:09.024692 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019165 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 18:34:09.024692 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019168 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 18:34:09.024692 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019170 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 18:34:09.024692 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019173 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 18:34:09.024692 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019176 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 18:34:09.024692 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019178 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 18:34:09.024692 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019181 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 18:34:09.024692 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019184 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 18:34:09.024692 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019187 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 18:34:09.024692 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019190 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 18:34:09.024692 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019193 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 18:34:09.024692 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019196 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 18:34:09.024692 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019199 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 29 18:34:09.024692 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019201 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 18:34:09.024692 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019205 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 18:34:09.025112 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.019210 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 18:34:09.025112 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019338 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 29 18:34:09.025112 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019343 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 18:34:09.025112 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019346 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 18:34:09.025112 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019350 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 18:34:09.025112 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019353 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 18:34:09.025112 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019356 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 18:34:09.025112 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019358 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 18:34:09.025112 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019361 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 18:34:09.025112 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019364 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 18:34:09.025112 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019366 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 18:34:09.025112 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019369 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 18:34:09.025112 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019372 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 18:34:09.025112 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019375 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 18:34:09.025112 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019377 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 18:34:09.025512 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019380 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 18:34:09.025512 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019383 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 18:34:09.025512 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019386 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 18:34:09.025512 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019389 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 18:34:09.025512 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019392 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 18:34:09.025512 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019394 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 18:34:09.025512 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019397 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 18:34:09.025512 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019400 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 18:34:09.025512 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019403 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 18:34:09.025512 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019405 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 18:34:09.025512 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019408 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 18:34:09.025512 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019412 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 18:34:09.025512 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019415 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 18:34:09.025512 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019418 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 18:34:09.025512 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019421 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 18:34:09.025512 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019423 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 18:34:09.025512 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019426 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 18:34:09.025512 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019431 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 18:34:09.025512 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019435 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 18:34:09.025512 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019438 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 18:34:09.026027 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019441 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 18:34:09.026027 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019444 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 18:34:09.026027 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019447 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 18:34:09.026027 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019450 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 18:34:09.026027 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019453 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 18:34:09.026027 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019455 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 18:34:09.026027 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019458 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 18:34:09.026027 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019461 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 18:34:09.026027 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019464 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 18:34:09.026027 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019467 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 18:34:09.026027 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019470 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 18:34:09.026027 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019472 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 18:34:09.026027 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019475 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 18:34:09.026027 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019478 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 18:34:09.026027 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019480 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 18:34:09.026027 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019483 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 18:34:09.026027 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019486 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 18:34:09.026027 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019489 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 18:34:09.026027 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019492 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 18:34:09.026027 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019494 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 18:34:09.026525 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019497 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 18:34:09.026525 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019500 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 18:34:09.026525 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019503 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 18:34:09.026525 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019506 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 18:34:09.026525 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019508 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 18:34:09.026525 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019511 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 18:34:09.026525 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019514 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 18:34:09.026525 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019517 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 18:34:09.026525 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019519 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 18:34:09.026525 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019522 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 18:34:09.026525 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019525 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 18:34:09.026525 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019527 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 18:34:09.026525 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019530 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 18:34:09.026525 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019533 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 18:34:09.026525 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019536 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 18:34:09.026525 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019538 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 18:34:09.026525 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019541 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 18:34:09.026525 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019543 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 18:34:09.026525 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019546 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 18:34:09.027026 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019549 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 18:34:09.027026 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019551 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 18:34:09.027026 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019554 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 18:34:09.027026 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019557 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 18:34:09.027026 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019560 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 18:34:09.027026 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019562 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 18:34:09.027026 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019565 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 18:34:09.027026 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019568 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 18:34:09.027026 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019570 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 18:34:09.027026 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019573 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 18:34:09.027026 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019577 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 18:34:09.027026 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019579 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 18:34:09.027026 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019584 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 18:34:09.027026 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019587 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 18:34:09.027026 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019590 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 18:34:09.027026 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019593 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 18:34:09.027026 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019596 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 18:34:09.027026 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019599 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 18:34:09.027026 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019602 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 18:34:09.027516 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019605 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 18:34:09.027516 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019609 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 18:34:09.027516 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019613 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 18:34:09.027516 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019632 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 18:34:09.027516 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019638 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 18:34:09.027516 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019643 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 18:34:09.027516 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:09.019647 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 18:34:09.027516 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.019656 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 18:34:09.027516 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.019768 2560 server.go:962] "Client rotation is on, will bootstrap in background" Jul 29 18:34:09.027516 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.021963 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 29 18:34:09.027516 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.024401 2560 server.go:1019] "Starting client certificate rotation" Jul 29 18:34:09.027516 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.024518 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 18:34:09.027516 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.024555 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 18:34:09.027927 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.027912 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 18:34:09.031884 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.031860 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 18:34:09.043186 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.043166 2560 log.go:25] "Validated CRI v1 runtime API" Jul 29 18:34:09.045430 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.045411 2560 log.go:25] "Validated CRI v1 image API" Jul 29 18:34:09.047076 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.047061 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 29 18:34:09.052514 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.052488 2560 fs.go:135] Filesystem UUIDs: map[0af982dd-8fe4-4eb0-8e03-27860e9e0c41:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 95d65bbc-6165-47c3-a459-969c8e3b5843:/dev/nvme0n1p3] Jul 29 18:34:09.052599 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.052514 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 29 18:34:09.057168 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.057047 2560 manager.go:216] Machine: {Timestamp:2026-07-29 18:34:09.056525543 +0000 UTC m=+0.396632283 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100822 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec266139d49cf5a923dc4752b58ff1df SystemUUID:ec266139-d49c-f5a9-23dc-4752b58ff1df BootID:f99471b7-0a9b-41b0-a13f-f34f32111a64 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c4:96:15:fd:43 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c4:96:15:fd:43 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:0c:db:c9:d0:a2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 29 18:34:09.057168 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.057155 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 29 18:34:09.057302 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.057235 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 29 18:34:09.058349 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.058333 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 18:34:09.060901 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.060864 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 29 18:34:09.061047 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.060905 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-135.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 29 18:34:09.061674 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.061663 2560 topology_manager.go:138] "Creating topology manager with none policy" Jul 29 18:34:09.061712 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.061676 2560 container_manager_linux.go:309] "Creating device plugin manager" Jul 29 18:34:09.061712 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.061684 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 18:34:09.062679 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.062668 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 18:34:09.064067 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.064055 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 29 18:34:09.068569 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.068556 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 29 18:34:09.068725 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.068714 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 29 18:34:09.068766 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.068747 2560 kubelet.go:486] "Attempting to sync node with API server" Jul 29 18:34:09.068766 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.068758 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 29 18:34:09.068829 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.068774 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 29 18:34:09.068829 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.068787 2560 kubelet.go:398] "Adding apiserver pod source" Jul 29 18:34:09.068829 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.068796 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 29 18:34:09.069272 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.069246 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 18:34:09.069272 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.069276 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 18:34:09.071999 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.071973 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 29 18:34:09.073761 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.073747 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 29 18:34:09.073848 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.073779 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 29 18:34:09.074545 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.074526 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 29 18:34:09.074545 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.074544 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 29 18:34:09.074545 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.074551 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 29 18:34:09.074777 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.074557 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 29 18:34:09.074777 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.074571 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 29 18:34:09.074777 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.074580 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 29 18:34:09.074777 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.074592 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 29 18:34:09.074777 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.074597 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 29 18:34:09.074777 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.074605 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 29 18:34:09.074777 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.074611 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 29 18:34:09.074777 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.074620 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 29 18:34:09.074777 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.074625 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 29 18:34:09.076050 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.076034 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 29 18:34:09.076110 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.076073 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 29 18:34:09.080746 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.080719 2560 server.go:1268] "Started kubelet" Jul 29 18:34:09.080908 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.080866 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 29 18:34:09.081070 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.081011 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 29 18:34:09.081167 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.081102 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 29 18:34:09.081401 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.081380 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-135.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 29 18:34:09.081502 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:09.081475 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 29 18:34:09.081641 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:09.081610 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-135.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 29 18:34:09.081976 ip-10-0-132-135 systemd[1]: Started Kubernetes Kubelet. Jul 29 18:34:09.082985 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.082967 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 29 18:34:09.084746 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.084727 2560 server.go:310] "Adding debug handlers to kubelet server" Jul 29 18:34:09.086759 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:09.086736 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 29 18:34:09.092298 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.092280 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 29 18:34:09.092398 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.092302 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 29 18:34:09.092485 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:09.092444 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-135.ec2.internal\" not found" Jul 29 18:34:09.093066 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.093049 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 29 18:34:09.093156 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.093088 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 29 18:34:09.093156 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.093108 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 29 18:34:09.093268 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.093246 2560 reconstruct.go:97] "Volume reconstruction finished" Jul 29 18:34:09.093268 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.093257 2560 reconciler.go:29] "Reconciler: start to sync state" Jul 29 18:34:09.093356 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.093286 2560 factory.go:55] Registering systemd factory Jul 29 18:34:09.093356 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.093313 2560 factory.go:223] Registration of the systemd container factory successfully Jul 29 18:34:09.093532 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.093518 2560 factory.go:153] Registering CRI-O factory Jul 29 18:34:09.093532 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.093533 2560 factory.go:223] Registration of the crio container factory successfully Jul 29 18:34:09.093674 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.093606 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 29 18:34:09.093674 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.093630 2560 factory.go:103] Registering Raw factory Jul 29 18:34:09.093674 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.093650 2560 manager.go:1196] Started watching for new ooms in manager Jul 29 18:34:09.094153 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:09.092999 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-135.ec2.internal.18c6d669132e0d3a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-135.ec2.internal,UID:ip-10-0-132-135.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-135.ec2.internal,},FirstTimestamp:2026-07-29 18:34:09.080675642 +0000 UTC m=+0.420782382,LastTimestamp:2026-07-29 18:34:09.080675642 +0000 UTC m=+0.420782382,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-135.ec2.internal,}" Jul 29 18:34:09.094376 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.094364 2560 manager.go:349] Starting recovery of all containers Jul 29 18:34:09.097098 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:09.097067 2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-135.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 29 18:34:09.097237 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:09.097205 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 29 18:34:09.106397 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.106378 2560 manager.go:354] Recovery completed Jul 29 18:34:09.111748 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.111539 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 18:34:09.113985 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.113947 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-135.ec2.internal" event="NodeHasSufficientMemory" Jul 29 18:34:09.113985 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.113987 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-135.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 18:34:09.114135 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.113998 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-135.ec2.internal" event="NodeHasSufficientPID" Jul 29 18:34:09.114455 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.114429 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lrxzf" Jul 29 18:34:09.114679 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.114662 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 29 18:34:09.114754 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.114694 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 29 18:34:09.114754 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.114713 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 29 18:34:09.114861 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.114679 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 18:34:09.115624 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.115586 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-135.ec2.internal" event="NodeHasSufficientMemory" Jul 29 18:34:09.115624 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.115624 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-135.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 18:34:09.115737 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.115657 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-135.ec2.internal" event="NodeHasSufficientPID" Jul 29 18:34:09.116175 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:09.116105 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-135.ec2.internal.18c6d669152a2507 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-135.ec2.internal,UID:ip-10-0-132-135.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-135.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-135.ec2.internal,},FirstTimestamp:2026-07-29 18:34:09.113974023 +0000 UTC m=+0.454080764,LastTimestamp:2026-07-29 18:34:09.113974023 +0000 UTC m=+0.454080764,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-135.ec2.internal,}" Jul 29 18:34:09.117029 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.117016 2560 policy_none.go:49] "None policy: Start" Jul 29 18:34:09.117095 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.117034 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 29 18:34:09.117095 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.117045 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 29 18:34:09.118188 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.118176 2560 policy_none.go:47] "Start" Jul 29 18:34:09.123261 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.123240 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lrxzf" Jul 29 18:34:09.125441 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:09.125375 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-135.ec2.internal.18c6d669152a6f84 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-135.ec2.internal,UID:ip-10-0-132-135.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-135.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-135.ec2.internal,},FirstTimestamp:2026-07-29 18:34:09.113993092 +0000 UTC m=+0.454099831,LastTimestamp:2026-07-29 18:34:09.113993092 +0000 UTC m=+0.454099831,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-135.ec2.internal,}" Jul 29 18:34:09.154201 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.154186 2560 manager.go:337] "Starting Device Plugin manager" Jul 29 18:34:09.154301 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:09.154217 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 29 18:34:09.154301 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.154228 2560 server.go:87] "Starting device plugin registration server" Jul 29 18:34:09.154482 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.154470 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 29 18:34:09.154545 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.154485 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 29 18:34:09.154688 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.154671 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 29 18:34:09.154772 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.154765 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 29 18:34:09.154825 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.154776 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 29 18:34:09.155283 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:09.155259 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 29 18:34:09.155356 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:09.155313 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-135.ec2.internal\" not found" Jul 29 18:34:09.255612 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.255519 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 18:34:09.256689 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.256661 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-135.ec2.internal" event="NodeHasSufficientMemory" Jul 29 18:34:09.256757 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.256694 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-135.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 18:34:09.256757 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.256707 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-135.ec2.internal" event="NodeHasSufficientPID" Jul 29 18:34:09.256757 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.256737 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-135.ec2.internal" Jul 29 18:34:09.259529 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.259497 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 29 18:34:09.260875 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.260856 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 29 18:34:09.260952 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.260892 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 29 18:34:09.260952 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.260937 2560 kubelet.go:2448] "Starting kubelet main sync loop" Jul 29 18:34:09.261045 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:09.260970 2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 29 18:34:09.262941 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.262920 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 18:34:09.266318 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.266304 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-135.ec2.internal" Jul 29 18:34:09.266424 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:09.266325 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-135.ec2.internal\": node \"ip-10-0-132-135.ec2.internal\" not found" Jul 29 18:34:09.297385 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:09.297366 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-135.ec2.internal\" not found" Jul 29 18:34:09.362535 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.362494 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-135.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-135.ec2.internal"] Jul 29 18:34:09.362702 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.362596 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 18:34:09.364579 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.364548 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-135.ec2.internal" event="NodeHasSufficientMemory" Jul 29 18:34:09.364673 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.364600 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-135.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 18:34:09.364673 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.364616 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-135.ec2.internal" event="NodeHasSufficientPID" Jul 29 18:34:09.365874 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.365858 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 18:34:09.365991 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.365975 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-135.ec2.internal" Jul 29 18:34:09.366040 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.366007 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 18:34:09.366632 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.366614 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-135.ec2.internal" event="NodeHasSufficientMemory" Jul 29 18:34:09.366632 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.366628 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-135.ec2.internal" event="NodeHasSufficientMemory" Jul 29 18:34:09.366780 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.366643 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-135.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 18:34:09.366780 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.366647 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-135.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 18:34:09.366780 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.366656 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-135.ec2.internal" event="NodeHasSufficientPID" Jul 29 18:34:09.366780 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.366657 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-135.ec2.internal" event="NodeHasSufficientPID" Jul 29 18:34:09.368762 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.368746 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-135.ec2.internal" Jul 29 18:34:09.368814 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.368781 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 18:34:09.369499 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.369481 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-135.ec2.internal" event="NodeHasSufficientMemory" Jul 29 18:34:09.369610 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.369509 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-135.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 18:34:09.369610 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.369526 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-135.ec2.internal" event="NodeHasSufficientPID" Jul 29 18:34:09.388384 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:09.388354 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-135.ec2.internal\" not found" node="ip-10-0-132-135.ec2.internal" Jul 29 18:34:09.393154 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:09.393134 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-135.ec2.internal\" not found" node="ip-10-0-132-135.ec2.internal" Jul 29 18:34:09.394294 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.394277 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ca2bdc6067477bf48ef1a76df789af47-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-135.ec2.internal\" (UID: \"ca2bdc6067477bf48ef1a76df789af47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-135.ec2.internal" Jul 29 18:34:09.394348 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.394304 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca2bdc6067477bf48ef1a76df789af47-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-135.ec2.internal\" (UID: \"ca2bdc6067477bf48ef1a76df789af47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-135.ec2.internal" Jul 29 18:34:09.394348 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.394321 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/12e8f3118c4c6824b49f49c364fe735b-config\") pod \"kube-apiserver-proxy-ip-10-0-132-135.ec2.internal\" (UID: \"12e8f3118c4c6824b49f49c364fe735b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-135.ec2.internal" Jul 29 18:34:09.397822 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:09.397805 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-135.ec2.internal\" not found" Jul 29 18:34:09.494747 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.494690 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ca2bdc6067477bf48ef1a76df789af47-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-135.ec2.internal\" (UID: \"ca2bdc6067477bf48ef1a76df789af47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-135.ec2.internal" Jul 29 18:34:09.494747 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.494738 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca2bdc6067477bf48ef1a76df789af47-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-135.ec2.internal\" (UID: \"ca2bdc6067477bf48ef1a76df789af47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-135.ec2.internal" Jul 29 18:34:09.494747 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.494757 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/12e8f3118c4c6824b49f49c364fe735b-config\") pod \"kube-apiserver-proxy-ip-10-0-132-135.ec2.internal\" (UID: \"12e8f3118c4c6824b49f49c364fe735b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-135.ec2.internal" Jul 29 18:34:09.494995 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.494785 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ca2bdc6067477bf48ef1a76df789af47-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-135.ec2.internal\" (UID: \"ca2bdc6067477bf48ef1a76df789af47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-135.ec2.internal" Jul 29 18:34:09.494995 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.494829 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca2bdc6067477bf48ef1a76df789af47-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-135.ec2.internal\" (UID: \"ca2bdc6067477bf48ef1a76df789af47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-135.ec2.internal" Jul 29 18:34:09.494995 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.494795 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/12e8f3118c4c6824b49f49c364fe735b-config\") pod \"kube-apiserver-proxy-ip-10-0-132-135.ec2.internal\" (UID: \"12e8f3118c4c6824b49f49c364fe735b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-135.ec2.internal" Jul 29 18:34:09.498270 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:09.498255 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-135.ec2.internal\" not found" Jul 29 18:34:09.599406 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:09.599321 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-135.ec2.internal\" not found" Jul 29 18:34:09.698120 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.698087 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-135.ec2.internal" Jul 29 18:34:09.698208 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.698098 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-135.ec2.internal" Jul 29 18:34:09.699978 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:09.699963 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-135.ec2.internal\" not found" Jul 29 18:34:09.800857 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:09.800816 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-135.ec2.internal\" not found" Jul 29 18:34:09.901879 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:09.901819 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-135.ec2.internal\" not found" Jul 29 18:34:09.931388 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:09.931368 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 18:34:10.002307 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:10.002271 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-135.ec2.internal\" not found" Jul 29 18:34:10.022979 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:10.022951 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 29 18:34:10.023117 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:10.023099 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 18:34:10.023159 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:10.023104 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 18:34:10.103278 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:10.103252 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-135.ec2.internal\" not found" Jul 29 18:34:10.127616 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:10.127576 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 18:29:09 +0000 UTC" deadline="2028-03-06 11:00:56.462955105 +0000 UTC" Jul 29 18:34:10.127616 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:10.127607 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14056h26m46.335351322s" Jul 29 18:34:10.204131 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:10.204051 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-135.ec2.internal\" not found" Jul 29 18:34:10.243022 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:10.242983 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca2bdc6067477bf48ef1a76df789af47.slice/crio-824f23bc1838dd6f6103beb2fa9fa9bf7c45881ab7ca1a223e89d0979146d640 WatchSource:0}: Error finding container 824f23bc1838dd6f6103beb2fa9fa9bf7c45881ab7ca1a223e89d0979146d640: Status 404 returned error can't find the container with id 824f23bc1838dd6f6103beb2fa9fa9bf7c45881ab7ca1a223e89d0979146d640 Jul 29 18:34:10.247589 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:10.247569 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 18:34:10.255469 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:10.255453 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 18:34:10.256460 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:10.256442 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-135.ec2.internal" event="NodeHasSufficientMemory" Jul 29 18:34:10.256538 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:10.256474 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-135.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 18:34:10.256538 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:10.256485 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-135.ec2.internal" event="NodeHasSufficientPID" Jul 29 18:34:10.264548 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:10.264505 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-135.ec2.internal" event={"ID":"ca2bdc6067477bf48ef1a76df789af47","Type":"ContainerStarted","Data":"824f23bc1838dd6f6103beb2fa9fa9bf7c45881ab7ca1a223e89d0979146d640"} Jul 29 18:34:10.304205 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:10.304170 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-135.ec2.internal\" not found" Jul 29 18:34:10.337453 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:10.337414 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12e8f3118c4c6824b49f49c364fe735b.slice/crio-532503b087f75bd20f918fbac0b2f0eccc9f36abb53c015edfae1fd2b8c483bb WatchSource:0}: Error finding container 532503b087f75bd20f918fbac0b2f0eccc9f36abb53c015edfae1fd2b8c483bb: Status 404 returned error can't find the container with id 532503b087f75bd20f918fbac0b2f0eccc9f36abb53c015edfae1fd2b8c483bb Jul 29 18:34:10.404578 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:10.404523 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-135.ec2.internal\" not found" Jul 29 18:34:10.505612 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:10.505532 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-135.ec2.internal\" not found" Jul 29 18:34:10.584922 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:10.584898 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 18:34:10.593401 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:10.593368 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-135.ec2.internal" Jul 29 18:34:10.604458 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:10.604437 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 18:34:10.606402 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:10.606388 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-135.ec2.internal" Jul 29 18:34:10.618435 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:10.618416 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 18:34:10.652354 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:10.652326 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 18:34:11.069910 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.069874 2560 apiserver.go:52] "Watching apiserver" Jul 29 18:34:11.083626 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.083579 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 29 18:34:11.084044 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.084016 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-bn2mn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-135.ec2.internal","openshift-multus/multus-bnb6z","openshift-network-diagnostics/network-check-target-rsmkr","kube-system/global-pull-secret-syncer-txtcd","kube-system/konnectivity-agent-p2gzm","openshift-cluster-node-tuning-operator/tuned-2k7fr","openshift-multus/multus-additional-cni-plugins-f8qxk","openshift-multus/network-metrics-daemon-94h2v","openshift-network-operator/iptables-alerter-w6ng5","openshift-ovn-kubernetes/ovnkube-node-nldtg","kube-system/kube-apiserver-proxy-ip-10-0-132-135.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5xpww","openshift-dns/node-resolver-7zxz4"] Jul 29 18:34:11.085712 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.085683 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.086848 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.086828 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5xpww" Jul 29 18:34:11.088004 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.087983 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.088737 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.088716 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 29 18:34:11.088835 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.088757 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qkxfm\"" Jul 29 18:34:11.088835 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.088718 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 29 18:34:11.089339 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.089320 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:34:11.089424 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:11.089394 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rsmkr" podUID="0bd004cf-695f-4759-ad1a-daa6563fbc3a" Jul 29 18:34:11.089652 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.089633 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 29 18:34:11.089872 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.089844 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 29 18:34:11.089947 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.089882 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7zlkp\"" Jul 29 18:34:11.089947 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.089930 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 29 18:34:11.090478 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.090463 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 29 18:34:11.091594 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.091181 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 29 18:34:11.091594 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.091399 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:11.091594 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.091410 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 29 18:34:11.091594 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.091433 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 29 18:34:11.091594 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:11.091478 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-txtcd" podUID="eae5d913-e185-42ae-9bf9-beabffd3d865" Jul 29 18:34:11.091905 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.091738 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-h4kjn\"" Jul 29 18:34:11.092762 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.092731 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p2gzm" Jul 29 18:34:11.093540 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.093518 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 29 18:34:11.095357 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.095336 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7976d\"" Jul 29 18:34:11.095514 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.095496 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 29 18:34:11.095570 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.095500 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 29 18:34:11.095959 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.095945 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:34:11.096023 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:11.096002 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94h2v" podUID="1e43e1c7-433e-4559-8fa2-2c818770dc36" Jul 29 18:34:11.097379 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.097360 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bn2mn" Jul 29 18:34:11.098719 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.098693 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7zxz4" Jul 29 18:34:11.100285 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.100229 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 29 18:34:11.100382 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.100337 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 29 18:34:11.100915 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.100559 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 29 18:34:11.100915 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.100608 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w6ng5" Jul 29 18:34:11.102085 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.102063 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 29 18:34:11.102085 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.102077 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lnsqz\"" Jul 29 18:34:11.102234 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.102212 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 29 18:34:11.102495 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.102479 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9q5zb\"" Jul 29 18:34:11.103460 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.103438 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vzfjv\"" Jul 29 18:34:11.103672 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.103648 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 29 18:34:11.104830 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.104179 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 29 18:34:11.104830 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.104307 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 29 18:34:11.106428 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.106174 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.108719 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.108650 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eae5d913-e185-42ae-9bf9-beabffd3d865-kubelet-config\") pod \"global-pull-secret-syncer-txtcd\" (UID: \"eae5d913-e185-42ae-9bf9-beabffd3d865\") " pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:11.108719 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.108683 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f8qxk" Jul 29 18:34:11.108719 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.108701 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c32d54e9-555f-4f8b-9157-09e3fb9ab5e6-registration-dir\") pod \"aws-ebs-csi-driver-node-5xpww\" (UID: \"c32d54e9-555f-4f8b-9157-09e3fb9ab5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5xpww" Jul 29 18:34:11.108935 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.108731 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3f7153c-aca1-4eae-8b30-d47df7715005-cni-binary-copy\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.108935 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.108763 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-host\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.108935 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.108788 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-etc-sysctl-d\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.108935 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.108812 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-etc-sysctl-conf\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.108935 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.108843 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-etc-systemd\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.108935 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.108865 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-run\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.108935 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.108891 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c32d54e9-555f-4f8b-9157-09e3fb9ab5e6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5xpww\" (UID: \"c32d54e9-555f-4f8b-9157-09e3fb9ab5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5xpww" Jul 29 18:34:11.109301 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.108949 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-multus-cni-dir\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.109301 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.108965 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tzz9g\"" Jul 29 18:34:11.109301 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.108983 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-etc-kubernetes\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.109301 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.109007 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-lib-modules\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.109301 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.109031 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c32d54e9-555f-4f8b-9157-09e3fb9ab5e6-device-dir\") pod \"aws-ebs-csi-driver-node-5xpww\" (UID: \"c32d54e9-555f-4f8b-9157-09e3fb9ab5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5xpww" Jul 29 18:34:11.109301 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.109061 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-system-cni-dir\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.109301 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.109084 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-host-var-lib-cni-multus\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.109301 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.109109 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-host-run-multus-certs\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.109301 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.109139 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-var-lib-kubelet\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.109301 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.109162 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dbb024f4-9e95-49a4-968b-f161254485e2-etc-tuned\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.109301 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.109200 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-multus-socket-dir-parent\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.109301 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.109248 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-etc-kubernetes\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.109301 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.109284 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hvt2\" (UniqueName: \"kubernetes.io/projected/dbb024f4-9e95-49a4-968b-f161254485e2-kube-api-access-2hvt2\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.109984 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.109320 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c3013e3c-44c1-49d0-be60-1a54f6b9d891-konnectivity-ca\") pod \"konnectivity-agent-p2gzm\" (UID: \"c3013e3c-44c1-49d0-be60-1a54f6b9d891\") " pod="kube-system/konnectivity-agent-p2gzm" Jul 29 18:34:11.109984 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.109345 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs\") pod \"network-metrics-daemon-94h2v\" (UID: \"1e43e1c7-433e-4559-8fa2-2c818770dc36\") " pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:34:11.109984 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.109374 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c32d54e9-555f-4f8b-9157-09e3fb9ab5e6-sys-fs\") pod \"aws-ebs-csi-driver-node-5xpww\" (UID: \"c32d54e9-555f-4f8b-9157-09e3fb9ab5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5xpww" Jul 29 18:34:11.109984 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.109392 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-967kn\" (UniqueName: \"kubernetes.io/projected/c32d54e9-555f-4f8b-9157-09e3fb9ab5e6-kube-api-access-967kn\") pod \"aws-ebs-csi-driver-node-5xpww\" (UID: \"c32d54e9-555f-4f8b-9157-09e3fb9ab5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5xpww" Jul 29 18:34:11.109984 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.109408 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-os-release\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.109984 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.109427 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-etc-modprobe-d\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.109984 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.109455 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-sys\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.109984 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.109481 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eae5d913-e185-42ae-9bf9-beabffd3d865-original-pull-secret\") pod \"global-pull-secret-syncer-txtcd\" (UID: \"eae5d913-e185-42ae-9bf9-beabffd3d865\") " pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:11.109984 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.109497 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c32d54e9-555f-4f8b-9157-09e3fb9ab5e6-etc-selinux\") pod \"aws-ebs-csi-driver-node-5xpww\" (UID: \"c32d54e9-555f-4f8b-9157-09e3fb9ab5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5xpww" Jul 29 18:34:11.109984 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.109521 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 29 18:34:11.109984 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.109535 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-cnibin\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.109984 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.109556 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-host-var-lib-cni-bin\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.109984 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.109610 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-host-var-lib-kubelet\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.109984 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.109681 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c3013e3c-44c1-49d0-be60-1a54f6b9d891-agent-certs\") pod \"konnectivity-agent-p2gzm\" (UID: \"c3013e3c-44c1-49d0-be60-1a54f6b9d891\") " pod="kube-system/konnectivity-agent-p2gzm" Jul 29 18:34:11.109984 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.109726 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-796rn\" (UniqueName: \"kubernetes.io/projected/1e43e1c7-433e-4559-8fa2-2c818770dc36-kube-api-access-796rn\") pod \"network-metrics-daemon-94h2v\" (UID: \"1e43e1c7-433e-4559-8fa2-2c818770dc36\") " pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:34:11.109984 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.109701 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 29 18:34:11.109984 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.109776 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 29 18:34:11.109984 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.109800 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 29 18:34:11.110821 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.110009 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c32d54e9-555f-4f8b-9157-09e3fb9ab5e6-socket-dir\") pod \"aws-ebs-csi-driver-node-5xpww\" (UID: \"c32d54e9-555f-4f8b-9157-09e3fb9ab5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5xpww" Jul 29 18:34:11.110821 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.110033 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 29 18:34:11.110821 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.110069 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 29 18:34:11.110821 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.110074 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e3f7153c-aca1-4eae-8b30-d47df7715005-multus-daemon-config\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.110821 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.110111 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdk8f\" (UniqueName: \"kubernetes.io/projected/0bd004cf-695f-4759-ad1a-daa6563fbc3a-kube-api-access-fdk8f\") pod \"network-check-target-rsmkr\" (UID: \"0bd004cf-695f-4759-ad1a-daa6563fbc3a\") " pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:34:11.110821 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.110141 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-etc-sysconfig\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.110821 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.110166 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dbb024f4-9e95-49a4-968b-f161254485e2-tmp\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.110821 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.110190 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eae5d913-e185-42ae-9bf9-beabffd3d865-dbus\") pod \"global-pull-secret-syncer-txtcd\" (UID: \"eae5d913-e185-42ae-9bf9-beabffd3d865\") " pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:11.110821 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.110213 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-host-run-k8s-cni-cncf-io\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.110821 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.110237 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-host-run-netns\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.110821 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.110261 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-hostroot\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.110821 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.110292 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-multus-conf-dir\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.110821 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.110316 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfqtw\" (UniqueName: \"kubernetes.io/projected/e3f7153c-aca1-4eae-8b30-d47df7715005-kube-api-access-rfqtw\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.111539 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.111297 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 29 18:34:11.112190 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.112174 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 29 18:34:11.112630 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.112606 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m5s47\"" Jul 29 18:34:11.116497 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.116480 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 18:34:11.138344 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.138319 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8srsn" Jul 29 18:34:11.149154 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.149130 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8srsn" Jul 29 18:34:11.194399 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.194377 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 29 18:34:11.211011 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.210988 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-run-systemd\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.211143 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211022 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d908e5bd-1d3b-4142-a730-c1993b33b31f-ovnkube-script-lib\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.211143 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211048 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64c334b9-60b0-4b1b-96b3-c8caaf87f3fc-tmp-dir\") pod \"node-resolver-7zxz4\" (UID: \"64c334b9-60b0-4b1b-96b3-c8caaf87f3fc\") " pod="openshift-dns/node-resolver-7zxz4" Jul 29 18:34:11.211143 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211080 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c3013e3c-44c1-49d0-be60-1a54f6b9d891-agent-certs\") pod \"konnectivity-agent-p2gzm\" (UID: \"c3013e3c-44c1-49d0-be60-1a54f6b9d891\") " pod="kube-system/konnectivity-agent-p2gzm" Jul 29 18:34:11.211289 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211222 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-host-slash\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.211289 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211260 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-log-socket\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.211409 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211289 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-etc-sysconfig\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.211409 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211316 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-host-run-k8s-cni-cncf-io\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.211409 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211343 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-multus-conf-dir\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.211409 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211368 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfqtw\" (UniqueName: \"kubernetes.io/projected/e3f7153c-aca1-4eae-8b30-d47df7715005-kube-api-access-rfqtw\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.211409 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211393 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-host-run-k8s-cni-cncf-io\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.211665 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211401 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-etc-sysconfig\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.211665 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211417 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-systemd-units\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.211665 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211452 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eae5d913-e185-42ae-9bf9-beabffd3d865-kubelet-config\") pod \"global-pull-secret-syncer-txtcd\" (UID: \"eae5d913-e185-42ae-9bf9-beabffd3d865\") " pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:11.211665 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211460 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-multus-conf-dir\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.211665 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211476 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3f7153c-aca1-4eae-8b30-d47df7715005-cni-binary-copy\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.211665 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211529 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 29 18:34:11.211665 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211534 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/621948c8-2ee5-4e82-b91b-b316e662af37-system-cni-dir\") pod \"multus-additional-cni-plugins-f8qxk\" (UID: \"621948c8-2ee5-4e82-b91b-b316e662af37\") " pod="openshift-multus/multus-additional-cni-plugins-f8qxk" Jul 29 18:34:11.211665 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211540 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eae5d913-e185-42ae-9bf9-beabffd3d865-kubelet-config\") pod \"global-pull-secret-syncer-txtcd\" (UID: \"eae5d913-e185-42ae-9bf9-beabffd3d865\") " pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:11.211665 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211601 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d908e5bd-1d3b-4142-a730-c1993b33b31f-env-overrides\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.211665 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211634 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ac39ef91-ebd7-46e9-8001-55b544a7dcea-serviceca\") pod \"node-ca-bn2mn\" (UID: \"ac39ef91-ebd7-46e9-8001-55b544a7dcea\") " pod="openshift-image-registry/node-ca-bn2mn" Jul 29 18:34:11.212143 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211666 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-host\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.212143 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211714 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-etc-sysctl-conf\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.212143 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211744 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-run\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.212143 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211783 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-host\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.212143 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211801 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-run\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.212143 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211820 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-etc-kubernetes\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.212143 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211854 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-run-ovn\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.212143 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211884 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-etc-sysctl-conf\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.212143 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211887 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c32d54e9-555f-4f8b-9157-09e3fb9ab5e6-device-dir\") pod \"aws-ebs-csi-driver-node-5xpww\" (UID: \"c32d54e9-555f-4f8b-9157-09e3fb9ab5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5xpww" Jul 29 18:34:11.212143 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211920 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-etc-kubernetes\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.212143 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211924 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/621948c8-2ee5-4e82-b91b-b316e662af37-os-release\") pod \"multus-additional-cni-plugins-f8qxk\" (UID: \"621948c8-2ee5-4e82-b91b-b316e662af37\") " pod="openshift-multus/multus-additional-cni-plugins-f8qxk" Jul 29 18:34:11.212143 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211964 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c32d54e9-555f-4f8b-9157-09e3fb9ab5e6-device-dir\") pod \"aws-ebs-csi-driver-node-5xpww\" (UID: \"c32d54e9-555f-4f8b-9157-09e3fb9ab5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5xpww" Jul 29 18:34:11.212143 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.211966 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-var-lib-kubelet\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.212143 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212007 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dbb024f4-9e95-49a4-968b-f161254485e2-etc-tuned\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.212143 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212018 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-var-lib-kubelet\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.212143 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212035 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-multus-socket-dir-parent\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.212143 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212088 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/621948c8-2ee5-4e82-b91b-b316e662af37-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f8qxk\" (UID: \"621948c8-2ee5-4e82-b91b-b316e662af37\") " pod="openshift-multus/multus-additional-cni-plugins-f8qxk" Jul 29 18:34:11.213008 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212118 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2be38e75-d5f3-48a1-a3eb-705b9ac9b7ae-host-slash\") pod \"iptables-alerter-w6ng5\" (UID: \"2be38e75-d5f3-48a1-a3eb-705b9ac9b7ae\") " pod="openshift-network-operator/iptables-alerter-w6ng5" Jul 29 18:34:11.213008 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212144 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-host-run-ovn-kubernetes\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.213008 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212170 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcp6x\" (UniqueName: \"kubernetes.io/projected/64c334b9-60b0-4b1b-96b3-c8caaf87f3fc-kube-api-access-pcp6x\") pod \"node-resolver-7zxz4\" (UID: \"64c334b9-60b0-4b1b-96b3-c8caaf87f3fc\") " pod="openshift-dns/node-resolver-7zxz4" Jul 29 18:34:11.213008 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212200 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/621948c8-2ee5-4e82-b91b-b316e662af37-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f8qxk\" (UID: \"621948c8-2ee5-4e82-b91b-b316e662af37\") " pod="openshift-multus/multus-additional-cni-plugins-f8qxk" Jul 29 18:34:11.213008 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212200 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-multus-socket-dir-parent\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.213008 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212233 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs\") pod \"network-metrics-daemon-94h2v\" (UID: \"1e43e1c7-433e-4559-8fa2-2c818770dc36\") " pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:34:11.213008 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212274 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c32d54e9-555f-4f8b-9157-09e3fb9ab5e6-sys-fs\") pod \"aws-ebs-csi-driver-node-5xpww\" (UID: \"c32d54e9-555f-4f8b-9157-09e3fb9ab5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5xpww" Jul 29 18:34:11.213008 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212303 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-967kn\" (UniqueName: \"kubernetes.io/projected/c32d54e9-555f-4f8b-9157-09e3fb9ab5e6-kube-api-access-967kn\") pod \"aws-ebs-csi-driver-node-5xpww\" (UID: \"c32d54e9-555f-4f8b-9157-09e3fb9ab5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5xpww" Jul 29 18:34:11.213008 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212273 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3f7153c-aca1-4eae-8b30-d47df7715005-cni-binary-copy\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.213008 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212364 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c32d54e9-555f-4f8b-9157-09e3fb9ab5e6-sys-fs\") pod \"aws-ebs-csi-driver-node-5xpww\" (UID: \"c32d54e9-555f-4f8b-9157-09e3fb9ab5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5xpww" Jul 29 18:34:11.213008 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212330 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-os-release\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.213008 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212416 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-host-var-lib-cni-bin\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.213008 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212468 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-os-release\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.213008 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212479 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-host-var-lib-kubelet\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.213008 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212489 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-host-var-lib-cni-bin\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.213008 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:11.212450 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:11.213008 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212511 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-host-var-lib-kubelet\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.213008 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212505 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c32d54e9-555f-4f8b-9157-09e3fb9ab5e6-etc-selinux\") pod \"aws-ebs-csi-driver-node-5xpww\" (UID: \"c32d54e9-555f-4f8b-9157-09e3fb9ab5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5xpww" Jul 29 18:34:11.213835 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212565 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-hostroot\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.213835 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212616 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-host-run-netns\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.213835 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212641 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-etc-openvswitch\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.213835 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212666 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-hostroot\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.213835 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212676 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-node-log\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.213835 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212678 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c32d54e9-555f-4f8b-9157-09e3fb9ab5e6-etc-selinux\") pod \"aws-ebs-csi-driver-node-5xpww\" (UID: \"c32d54e9-555f-4f8b-9157-09e3fb9ab5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5xpww" Jul 29 18:34:11.213835 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:11.212736 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs podName:1e43e1c7-433e-4559-8fa2-2c818770dc36 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:11.7126865 +0000 UTC m=+3.052793246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs") pod "network-metrics-daemon-94h2v" (UID: "1e43e1c7-433e-4559-8fa2-2c818770dc36") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:11.213835 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212767 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-host-cni-netd\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.213835 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212796 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d908e5bd-1d3b-4142-a730-c1993b33b31f-ovnkube-config\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.213835 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212821 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfcvm\" (UniqueName: \"kubernetes.io/projected/ac39ef91-ebd7-46e9-8001-55b544a7dcea-kube-api-access-qfcvm\") pod \"node-ca-bn2mn\" (UID: \"ac39ef91-ebd7-46e9-8001-55b544a7dcea\") " pod="openshift-image-registry/node-ca-bn2mn" Jul 29 18:34:11.213835 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212851 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-796rn\" (UniqueName: \"kubernetes.io/projected/1e43e1c7-433e-4559-8fa2-2c818770dc36-kube-api-access-796rn\") pod \"network-metrics-daemon-94h2v\" (UID: \"1e43e1c7-433e-4559-8fa2-2c818770dc36\") " pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:34:11.213835 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212887 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c32d54e9-555f-4f8b-9157-09e3fb9ab5e6-socket-dir\") pod \"aws-ebs-csi-driver-node-5xpww\" (UID: \"c32d54e9-555f-4f8b-9157-09e3fb9ab5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5xpww" Jul 29 18:34:11.213835 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212939 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e3f7153c-aca1-4eae-8b30-d47df7715005-multus-daemon-config\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.213835 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.212972 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdk8f\" (UniqueName: \"kubernetes.io/projected/0bd004cf-695f-4759-ad1a-daa6563fbc3a-kube-api-access-fdk8f\") pod \"network-check-target-rsmkr\" (UID: \"0bd004cf-695f-4759-ad1a-daa6563fbc3a\") " pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:34:11.213835 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.213005 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/621948c8-2ee5-4e82-b91b-b316e662af37-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f8qxk\" (UID: \"621948c8-2ee5-4e82-b91b-b316e662af37\") " pod="openshift-multus/multus-additional-cni-plugins-f8qxk" Jul 29 18:34:11.213835 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.213034 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2be38e75-d5f3-48a1-a3eb-705b9ac9b7ae-iptables-alerter-script\") pod \"iptables-alerter-w6ng5\" (UID: \"2be38e75-d5f3-48a1-a3eb-705b9ac9b7ae\") " pod="openshift-network-operator/iptables-alerter-w6ng5" Jul 29 18:34:11.214423 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.213035 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c32d54e9-555f-4f8b-9157-09e3fb9ab5e6-socket-dir\") pod \"aws-ebs-csi-driver-node-5xpww\" (UID: \"c32d54e9-555f-4f8b-9157-09e3fb9ab5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5xpww" Jul 29 18:34:11.214423 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.213100 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dbb024f4-9e95-49a4-968b-f161254485e2-tmp\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.214423 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.213130 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eae5d913-e185-42ae-9bf9-beabffd3d865-dbus\") pod \"global-pull-secret-syncer-txtcd\" (UID: \"eae5d913-e185-42ae-9bf9-beabffd3d865\") " pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:11.214423 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.213158 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-host-run-netns\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.214423 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.213188 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac39ef91-ebd7-46e9-8001-55b544a7dcea-host\") pod \"node-ca-bn2mn\" (UID: \"ac39ef91-ebd7-46e9-8001-55b544a7dcea\") " pod="openshift-image-registry/node-ca-bn2mn" Jul 29 18:34:11.214423 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.213221 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c32d54e9-555f-4f8b-9157-09e3fb9ab5e6-registration-dir\") pod \"aws-ebs-csi-driver-node-5xpww\" (UID: \"c32d54e9-555f-4f8b-9157-09e3fb9ab5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5xpww" Jul 29 18:34:11.214423 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.213252 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-etc-sysctl-d\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.214423 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.213268 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-host-run-netns\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.214423 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.213282 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-etc-systemd\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.214423 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.213310 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c32d54e9-555f-4f8b-9157-09e3fb9ab5e6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5xpww\" (UID: \"c32d54e9-555f-4f8b-9157-09e3fb9ab5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5xpww" Jul 29 18:34:11.214423 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.213336 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-multus-cni-dir\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.214423 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.213364 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/621948c8-2ee5-4e82-b91b-b316e662af37-cnibin\") pod \"multus-additional-cni-plugins-f8qxk\" (UID: \"621948c8-2ee5-4e82-b91b-b316e662af37\") " pod="openshift-multus/multus-additional-cni-plugins-f8qxk" Jul 29 18:34:11.214423 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.213393 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqptr\" (UniqueName: \"kubernetes.io/projected/2be38e75-d5f3-48a1-a3eb-705b9ac9b7ae-kube-api-access-sqptr\") pod \"iptables-alerter-w6ng5\" (UID: \"2be38e75-d5f3-48a1-a3eb-705b9ac9b7ae\") " pod="openshift-network-operator/iptables-alerter-w6ng5" Jul 29 18:34:11.214423 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.213408 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-etc-sysctl-d\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.214423 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.213423 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-host-kubelet\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.214423 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.213450 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr9mg\" (UniqueName: \"kubernetes.io/projected/d908e5bd-1d3b-4142-a730-c1993b33b31f-kube-api-access-nr9mg\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.214423 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.213473 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eae5d913-e185-42ae-9bf9-beabffd3d865-dbus\") pod \"global-pull-secret-syncer-txtcd\" (UID: \"eae5d913-e185-42ae-9bf9-beabffd3d865\") " pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:11.215013 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.213476 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-multus-cni-dir\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.215013 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.213476 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-lib-modules\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.215013 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.213514 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e3f7153c-aca1-4eae-8b30-d47df7715005-multus-daemon-config\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.215013 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.213535 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-etc-systemd\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.215013 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.213520 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-system-cni-dir\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.215013 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.213558 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-system-cni-dir\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.215013 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.213354 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c32d54e9-555f-4f8b-9157-09e3fb9ab5e6-registration-dir\") pod \"aws-ebs-csi-driver-node-5xpww\" (UID: \"c32d54e9-555f-4f8b-9157-09e3fb9ab5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5xpww" Jul 29 18:34:11.215013 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.213589 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-lib-modules\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.215013 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.213574 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-host-var-lib-cni-multus\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.215013 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.213605 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c32d54e9-555f-4f8b-9157-09e3fb9ab5e6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5xpww\" (UID: \"c32d54e9-555f-4f8b-9157-09e3fb9ab5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5xpww" Jul 29 18:34:11.215013 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.214106 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-host-var-lib-cni-multus\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.215013 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.214166 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-host-run-multus-certs\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.215013 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.214196 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/621948c8-2ee5-4e82-b91b-b316e662af37-cni-binary-copy\") pod \"multus-additional-cni-plugins-f8qxk\" (UID: \"621948c8-2ee5-4e82-b91b-b316e662af37\") " pod="openshift-multus/multus-additional-cni-plugins-f8qxk" Jul 29 18:34:11.215013 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.214225 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-var-lib-openvswitch\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.215013 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.214266 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-host-run-multus-certs\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.215013 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.214261 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-run-openvswitch\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.215013 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.214315 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.215760 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.214373 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d908e5bd-1d3b-4142-a730-c1993b33b31f-ovn-node-metrics-cert\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.215760 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.214419 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-etc-kubernetes\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.215760 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.214444 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hvt2\" (UniqueName: \"kubernetes.io/projected/dbb024f4-9e95-49a4-968b-f161254485e2-kube-api-access-2hvt2\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.215760 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.214493 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c3013e3c-44c1-49d0-be60-1a54f6b9d891-konnectivity-ca\") pod \"konnectivity-agent-p2gzm\" (UID: \"c3013e3c-44c1-49d0-be60-1a54f6b9d891\") " pod="kube-system/konnectivity-agent-p2gzm" Jul 29 18:34:11.215760 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.214525 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sfr6\" (UniqueName: \"kubernetes.io/projected/621948c8-2ee5-4e82-b91b-b316e662af37-kube-api-access-2sfr6\") pod \"multus-additional-cni-plugins-f8qxk\" (UID: \"621948c8-2ee5-4e82-b91b-b316e662af37\") " pod="openshift-multus/multus-additional-cni-plugins-f8qxk" Jul 29 18:34:11.215760 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.214609 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-host-cni-bin\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.215760 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.214636 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/64c334b9-60b0-4b1b-96b3-c8caaf87f3fc-hosts-file\") pod \"node-resolver-7zxz4\" (UID: \"64c334b9-60b0-4b1b-96b3-c8caaf87f3fc\") " pod="openshift-dns/node-resolver-7zxz4" Jul 29 18:34:11.215760 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.214663 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-etc-modprobe-d\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.215760 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.214689 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-sys\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.215760 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.214729 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eae5d913-e185-42ae-9bf9-beabffd3d865-original-pull-secret\") pod \"global-pull-secret-syncer-txtcd\" (UID: \"eae5d913-e185-42ae-9bf9-beabffd3d865\") " pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:11.215760 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.214754 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-cnibin\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.215760 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.214495 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-etc-kubernetes\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.215760 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.214882 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3f7153c-aca1-4eae-8b30-d47df7715005-cnibin\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.215760 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:11.214980 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:11.215760 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.215002 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-etc-modprobe-d\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.215760 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:11.215036 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae5d913-e185-42ae-9bf9-beabffd3d865-original-pull-secret podName:eae5d913-e185-42ae-9bf9-beabffd3d865 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:11.715017831 +0000 UTC m=+3.055124559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eae5d913-e185-42ae-9bf9-beabffd3d865-original-pull-secret") pod "global-pull-secret-syncer-txtcd" (UID: "eae5d913-e185-42ae-9bf9-beabffd3d865") : object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:11.215760 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.215080 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbb024f4-9e95-49a4-968b-f161254485e2-sys\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.216506 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.215200 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c3013e3c-44c1-49d0-be60-1a54f6b9d891-konnectivity-ca\") pod \"konnectivity-agent-p2gzm\" (UID: \"c3013e3c-44c1-49d0-be60-1a54f6b9d891\") " pod="kube-system/konnectivity-agent-p2gzm" Jul 29 18:34:11.216506 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.215727 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dbb024f4-9e95-49a4-968b-f161254485e2-tmp\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.216506 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.215829 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dbb024f4-9e95-49a4-968b-f161254485e2-etc-tuned\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.216506 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.215902 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c3013e3c-44c1-49d0-be60-1a54f6b9d891-agent-certs\") pod \"konnectivity-agent-p2gzm\" (UID: \"c3013e3c-44c1-49d0-be60-1a54f6b9d891\") " pod="kube-system/konnectivity-agent-p2gzm" Jul 29 18:34:11.224474 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:11.224444 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 18:34:11.224474 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:11.224467 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 18:34:11.224739 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:11.224488 2560 projected.go:196] Error preparing data for projected volume kube-api-access-fdk8f for pod openshift-network-diagnostics/network-check-target-rsmkr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:11.224739 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:11.224545 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0bd004cf-695f-4759-ad1a-daa6563fbc3a-kube-api-access-fdk8f podName:0bd004cf-695f-4759-ad1a-daa6563fbc3a nodeName:}" failed. No retries permitted until 2026-07-29 18:34:11.72452932 +0000 UTC m=+3.064636068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fdk8f" (UniqueName: "kubernetes.io/projected/0bd004cf-695f-4759-ad1a-daa6563fbc3a-kube-api-access-fdk8f") pod "network-check-target-rsmkr" (UID: "0bd004cf-695f-4759-ad1a-daa6563fbc3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:11.226980 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.226959 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfqtw\" (UniqueName: \"kubernetes.io/projected/e3f7153c-aca1-4eae-8b30-d47df7715005-kube-api-access-rfqtw\") pod \"multus-bnb6z\" (UID: \"e3f7153c-aca1-4eae-8b30-d47df7715005\") " pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.227102 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.227048 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-796rn\" (UniqueName: \"kubernetes.io/projected/1e43e1c7-433e-4559-8fa2-2c818770dc36-kube-api-access-796rn\") pod \"network-metrics-daemon-94h2v\" (UID: \"1e43e1c7-433e-4559-8fa2-2c818770dc36\") " pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:34:11.227102 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.227066 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-967kn\" (UniqueName: \"kubernetes.io/projected/c32d54e9-555f-4f8b-9157-09e3fb9ab5e6-kube-api-access-967kn\") pod \"aws-ebs-csi-driver-node-5xpww\" (UID: \"c32d54e9-555f-4f8b-9157-09e3fb9ab5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5xpww" Jul 29 18:34:11.227415 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.227397 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hvt2\" (UniqueName: \"kubernetes.io/projected/dbb024f4-9e95-49a4-968b-f161254485e2-kube-api-access-2hvt2\") pod \"tuned-2k7fr\" (UID: \"dbb024f4-9e95-49a4-968b-f161254485e2\") " pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.266612 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.266557 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-135.ec2.internal" event={"ID":"12e8f3118c4c6824b49f49c364fe735b","Type":"ContainerStarted","Data":"532503b087f75bd20f918fbac0b2f0eccc9f36abb53c015edfae1fd2b8c483bb"} Jul 29 18:34:11.315080 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315041 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sfr6\" (UniqueName: \"kubernetes.io/projected/621948c8-2ee5-4e82-b91b-b316e662af37-kube-api-access-2sfr6\") pod \"multus-additional-cni-plugins-f8qxk\" (UID: \"621948c8-2ee5-4e82-b91b-b316e662af37\") " pod="openshift-multus/multus-additional-cni-plugins-f8qxk" Jul 29 18:34:11.315080 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315084 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-host-cni-bin\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.315311 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315106 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/64c334b9-60b0-4b1b-96b3-c8caaf87f3fc-hosts-file\") pod \"node-resolver-7zxz4\" (UID: \"64c334b9-60b0-4b1b-96b3-c8caaf87f3fc\") " pod="openshift-dns/node-resolver-7zxz4" Jul 29 18:34:11.315311 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315168 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-run-systemd\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.315311 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315180 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-host-cni-bin\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.315311 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315207 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d908e5bd-1d3b-4142-a730-c1993b33b31f-ovnkube-script-lib\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.315311 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315235 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64c334b9-60b0-4b1b-96b3-c8caaf87f3fc-tmp-dir\") pod \"node-resolver-7zxz4\" (UID: \"64c334b9-60b0-4b1b-96b3-c8caaf87f3fc\") " pod="openshift-dns/node-resolver-7zxz4" Jul 29 18:34:11.315311 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315239 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-run-systemd\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.315311 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315261 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-host-slash\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.315311 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315264 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/64c334b9-60b0-4b1b-96b3-c8caaf87f3fc-hosts-file\") pod \"node-resolver-7zxz4\" (UID: \"64c334b9-60b0-4b1b-96b3-c8caaf87f3fc\") " pod="openshift-dns/node-resolver-7zxz4" Jul 29 18:34:11.315311 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315285 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-log-socket\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.315795 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315324 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-log-socket\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.315795 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315325 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-systemd-units\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.315795 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315358 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/621948c8-2ee5-4e82-b91b-b316e662af37-system-cni-dir\") pod \"multus-additional-cni-plugins-f8qxk\" (UID: \"621948c8-2ee5-4e82-b91b-b316e662af37\") " pod="openshift-multus/multus-additional-cni-plugins-f8qxk" Jul 29 18:34:11.315795 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315364 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-host-slash\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.315795 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315384 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d908e5bd-1d3b-4142-a730-c1993b33b31f-env-overrides\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.315795 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315394 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/621948c8-2ee5-4e82-b91b-b316e662af37-system-cni-dir\") pod \"multus-additional-cni-plugins-f8qxk\" (UID: \"621948c8-2ee5-4e82-b91b-b316e662af37\") " pod="openshift-multus/multus-additional-cni-plugins-f8qxk" Jul 29 18:34:11.315795 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315361 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-systemd-units\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.315795 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315413 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ac39ef91-ebd7-46e9-8001-55b544a7dcea-serviceca\") pod \"node-ca-bn2mn\" (UID: \"ac39ef91-ebd7-46e9-8001-55b544a7dcea\") " pod="openshift-image-registry/node-ca-bn2mn" Jul 29 18:34:11.315795 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315435 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-run-ovn\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.315795 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315455 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/621948c8-2ee5-4e82-b91b-b316e662af37-os-release\") pod \"multus-additional-cni-plugins-f8qxk\" (UID: \"621948c8-2ee5-4e82-b91b-b316e662af37\") " pod="openshift-multus/multus-additional-cni-plugins-f8qxk" Jul 29 18:34:11.315795 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315491 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/621948c8-2ee5-4e82-b91b-b316e662af37-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f8qxk\" (UID: \"621948c8-2ee5-4e82-b91b-b316e662af37\") " pod="openshift-multus/multus-additional-cni-plugins-f8qxk" Jul 29 18:34:11.315795 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315523 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2be38e75-d5f3-48a1-a3eb-705b9ac9b7ae-host-slash\") pod \"iptables-alerter-w6ng5\" (UID: \"2be38e75-d5f3-48a1-a3eb-705b9ac9b7ae\") " pod="openshift-network-operator/iptables-alerter-w6ng5" Jul 29 18:34:11.315795 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315528 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-run-ovn\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.315795 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315547 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-host-run-ovn-kubernetes\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.315795 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315591 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcp6x\" (UniqueName: \"kubernetes.io/projected/64c334b9-60b0-4b1b-96b3-c8caaf87f3fc-kube-api-access-pcp6x\") pod \"node-resolver-7zxz4\" (UID: \"64c334b9-60b0-4b1b-96b3-c8caaf87f3fc\") " pod="openshift-dns/node-resolver-7zxz4" Jul 29 18:34:11.315795 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315610 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2be38e75-d5f3-48a1-a3eb-705b9ac9b7ae-host-slash\") pod \"iptables-alerter-w6ng5\" (UID: \"2be38e75-d5f3-48a1-a3eb-705b9ac9b7ae\") " pod="openshift-network-operator/iptables-alerter-w6ng5" Jul 29 18:34:11.315795 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315620 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/621948c8-2ee5-4e82-b91b-b316e662af37-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f8qxk\" (UID: \"621948c8-2ee5-4e82-b91b-b316e662af37\") " pod="openshift-multus/multus-additional-cni-plugins-f8qxk" Jul 29 18:34:11.316619 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315640 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-host-run-ovn-kubernetes\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.316619 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315666 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-host-run-netns\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.316619 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315680 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64c334b9-60b0-4b1b-96b3-c8caaf87f3fc-tmp-dir\") pod \"node-resolver-7zxz4\" (UID: \"64c334b9-60b0-4b1b-96b3-c8caaf87f3fc\") " pod="openshift-dns/node-resolver-7zxz4" Jul 29 18:34:11.316619 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315704 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-etc-openvswitch\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.316619 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315707 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/621948c8-2ee5-4e82-b91b-b316e662af37-os-release\") pod \"multus-additional-cni-plugins-f8qxk\" (UID: \"621948c8-2ee5-4e82-b91b-b316e662af37\") " pod="openshift-multus/multus-additional-cni-plugins-f8qxk" Jul 29 18:34:11.316619 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315754 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-etc-openvswitch\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.316619 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315761 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-host-run-netns\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.316619 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315782 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-node-log\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.316619 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315823 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-host-cni-netd\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.316619 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315842 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d908e5bd-1d3b-4142-a730-c1993b33b31f-ovnkube-config\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.316619 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315862 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfcvm\" (UniqueName: \"kubernetes.io/projected/ac39ef91-ebd7-46e9-8001-55b544a7dcea-kube-api-access-qfcvm\") pod \"node-ca-bn2mn\" (UID: \"ac39ef91-ebd7-46e9-8001-55b544a7dcea\") " pod="openshift-image-registry/node-ca-bn2mn" Jul 29 18:34:11.316619 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315908 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-host-cni-netd\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.316619 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315912 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/621948c8-2ee5-4e82-b91b-b316e662af37-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f8qxk\" (UID: \"621948c8-2ee5-4e82-b91b-b316e662af37\") " pod="openshift-multus/multus-additional-cni-plugins-f8qxk" Jul 29 18:34:11.316619 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315936 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ac39ef91-ebd7-46e9-8001-55b544a7dcea-serviceca\") pod \"node-ca-bn2mn\" (UID: \"ac39ef91-ebd7-46e9-8001-55b544a7dcea\") " pod="openshift-image-registry/node-ca-bn2mn" Jul 29 18:34:11.316619 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315961 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-node-log\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.316619 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315966 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d908e5bd-1d3b-4142-a730-c1993b33b31f-env-overrides\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.316619 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.315998 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/621948c8-2ee5-4e82-b91b-b316e662af37-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f8qxk\" (UID: \"621948c8-2ee5-4e82-b91b-b316e662af37\") " pod="openshift-multus/multus-additional-cni-plugins-f8qxk" Jul 29 18:34:11.317603 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.316000 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d908e5bd-1d3b-4142-a730-c1993b33b31f-ovnkube-script-lib\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.317603 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.316037 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2be38e75-d5f3-48a1-a3eb-705b9ac9b7ae-iptables-alerter-script\") pod \"iptables-alerter-w6ng5\" (UID: \"2be38e75-d5f3-48a1-a3eb-705b9ac9b7ae\") " pod="openshift-network-operator/iptables-alerter-w6ng5" Jul 29 18:34:11.317603 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.316101 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac39ef91-ebd7-46e9-8001-55b544a7dcea-host\") pod \"node-ca-bn2mn\" (UID: \"ac39ef91-ebd7-46e9-8001-55b544a7dcea\") " pod="openshift-image-registry/node-ca-bn2mn" Jul 29 18:34:11.317603 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.316143 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/621948c8-2ee5-4e82-b91b-b316e662af37-cnibin\") pod \"multus-additional-cni-plugins-f8qxk\" (UID: \"621948c8-2ee5-4e82-b91b-b316e662af37\") " pod="openshift-multus/multus-additional-cni-plugins-f8qxk" Jul 29 18:34:11.317603 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.316171 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqptr\" (UniqueName: \"kubernetes.io/projected/2be38e75-d5f3-48a1-a3eb-705b9ac9b7ae-kube-api-access-sqptr\") pod \"iptables-alerter-w6ng5\" (UID: \"2be38e75-d5f3-48a1-a3eb-705b9ac9b7ae\") " pod="openshift-network-operator/iptables-alerter-w6ng5" Jul 29 18:34:11.317603 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.316179 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac39ef91-ebd7-46e9-8001-55b544a7dcea-host\") pod \"node-ca-bn2mn\" (UID: \"ac39ef91-ebd7-46e9-8001-55b544a7dcea\") " pod="openshift-image-registry/node-ca-bn2mn" Jul 29 18:34:11.317603 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.316198 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-host-kubelet\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.317603 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.316223 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr9mg\" (UniqueName: \"kubernetes.io/projected/d908e5bd-1d3b-4142-a730-c1993b33b31f-kube-api-access-nr9mg\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.317603 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.316226 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/621948c8-2ee5-4e82-b91b-b316e662af37-cnibin\") pod \"multus-additional-cni-plugins-f8qxk\" (UID: \"621948c8-2ee5-4e82-b91b-b316e662af37\") " pod="openshift-multus/multus-additional-cni-plugins-f8qxk" Jul 29 18:34:11.317603 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.316254 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/621948c8-2ee5-4e82-b91b-b316e662af37-cni-binary-copy\") pod \"multus-additional-cni-plugins-f8qxk\" (UID: \"621948c8-2ee5-4e82-b91b-b316e662af37\") " pod="openshift-multus/multus-additional-cni-plugins-f8qxk" Jul 29 18:34:11.317603 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.316267 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-host-kubelet\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.317603 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.316280 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-var-lib-openvswitch\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.317603 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.316291 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/621948c8-2ee5-4e82-b91b-b316e662af37-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f8qxk\" (UID: \"621948c8-2ee5-4e82-b91b-b316e662af37\") " pod="openshift-multus/multus-additional-cni-plugins-f8qxk" Jul 29 18:34:11.317603 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.316306 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-run-openvswitch\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.317603 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.316331 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.317603 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.316359 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d908e5bd-1d3b-4142-a730-c1993b33b31f-ovn-node-metrics-cert\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.317603 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.316413 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d908e5bd-1d3b-4142-a730-c1993b33b31f-ovnkube-config\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.318470 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.316437 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-run-openvswitch\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.318470 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.316460 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.318470 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.316485 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d908e5bd-1d3b-4142-a730-c1993b33b31f-var-lib-openvswitch\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.318470 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.316638 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/621948c8-2ee5-4e82-b91b-b316e662af37-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f8qxk\" (UID: \"621948c8-2ee5-4e82-b91b-b316e662af37\") " pod="openshift-multus/multus-additional-cni-plugins-f8qxk" Jul 29 18:34:11.318470 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.316673 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2be38e75-d5f3-48a1-a3eb-705b9ac9b7ae-iptables-alerter-script\") pod \"iptables-alerter-w6ng5\" (UID: \"2be38e75-d5f3-48a1-a3eb-705b9ac9b7ae\") " pod="openshift-network-operator/iptables-alerter-w6ng5" Jul 29 18:34:11.318470 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.316801 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/621948c8-2ee5-4e82-b91b-b316e662af37-cni-binary-copy\") pod \"multus-additional-cni-plugins-f8qxk\" (UID: \"621948c8-2ee5-4e82-b91b-b316e662af37\") " pod="openshift-multus/multus-additional-cni-plugins-f8qxk" Jul 29 18:34:11.319007 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.318988 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d908e5bd-1d3b-4142-a730-c1993b33b31f-ovn-node-metrics-cert\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.330542 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.330466 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr9mg\" (UniqueName: \"kubernetes.io/projected/d908e5bd-1d3b-4142-a730-c1993b33b31f-kube-api-access-nr9mg\") pod \"ovnkube-node-nldtg\" (UID: \"d908e5bd-1d3b-4142-a730-c1993b33b31f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.330542 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.330468 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqptr\" (UniqueName: \"kubernetes.io/projected/2be38e75-d5f3-48a1-a3eb-705b9ac9b7ae-kube-api-access-sqptr\") pod \"iptables-alerter-w6ng5\" (UID: \"2be38e75-d5f3-48a1-a3eb-705b9ac9b7ae\") " pod="openshift-network-operator/iptables-alerter-w6ng5" Jul 29 18:34:11.330916 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.330895 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcp6x\" (UniqueName: \"kubernetes.io/projected/64c334b9-60b0-4b1b-96b3-c8caaf87f3fc-kube-api-access-pcp6x\") pod \"node-resolver-7zxz4\" (UID: \"64c334b9-60b0-4b1b-96b3-c8caaf87f3fc\") " pod="openshift-dns/node-resolver-7zxz4" Jul 29 18:34:11.330916 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.330910 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfcvm\" (UniqueName: \"kubernetes.io/projected/ac39ef91-ebd7-46e9-8001-55b544a7dcea-kube-api-access-qfcvm\") pod \"node-ca-bn2mn\" (UID: \"ac39ef91-ebd7-46e9-8001-55b544a7dcea\") " pod="openshift-image-registry/node-ca-bn2mn" Jul 29 18:34:11.331040 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.330910 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sfr6\" (UniqueName: \"kubernetes.io/projected/621948c8-2ee5-4e82-b91b-b316e662af37-kube-api-access-2sfr6\") pod \"multus-additional-cni-plugins-f8qxk\" (UID: \"621948c8-2ee5-4e82-b91b-b316e662af37\") " pod="openshift-multus/multus-additional-cni-plugins-f8qxk" Jul 29 18:34:11.398499 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.398465 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" Jul 29 18:34:11.408539 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.408514 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5xpww" Jul 29 18:34:11.415897 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.415872 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bnb6z" Jul 29 18:34:11.421757 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.421732 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p2gzm" Jul 29 18:34:11.431950 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.431904 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bn2mn" Jul 29 18:34:11.437687 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.437667 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7zxz4" Jul 29 18:34:11.444318 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.444297 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w6ng5" Jul 29 18:34:11.444422 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.444352 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 18:34:11.451953 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.451932 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:11.457009 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.456856 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f8qxk" Jul 29 18:34:11.479810 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:11.479787 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3f7153c_aca1_4eae_8b30_d47df7715005.slice/crio-0bb82c6fb23beb13e56cbb4adfc4cb75fab74d4f79bf9e12f86241895e8eacc6 WatchSource:0}: Error finding container 0bb82c6fb23beb13e56cbb4adfc4cb75fab74d4f79bf9e12f86241895e8eacc6: Status 404 returned error can't find the container with id 0bb82c6fb23beb13e56cbb4adfc4cb75fab74d4f79bf9e12f86241895e8eacc6 Jul 29 18:34:11.494122 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:11.494094 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod621948c8_2ee5_4e82_b91b_b316e662af37.slice/crio-0e3f9659a87b54b2e0596e2089f0cb1fb37094a7b3172141cf3788caaf9afbcf WatchSource:0}: Error finding container 0e3f9659a87b54b2e0596e2089f0cb1fb37094a7b3172141cf3788caaf9afbcf: Status 404 returned error can't find the container with id 0e3f9659a87b54b2e0596e2089f0cb1fb37094a7b3172141cf3788caaf9afbcf Jul 29 18:34:11.500467 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:11.500440 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64c334b9_60b0_4b1b_96b3_c8caaf87f3fc.slice/crio-3ac59608de4d0cef36c210218390af91ebecce6ef25ce0407eb617ce45feb5d1 WatchSource:0}: Error finding container 3ac59608de4d0cef36c210218390af91ebecce6ef25ce0407eb617ce45feb5d1: Status 404 returned error can't find the container with id 3ac59608de4d0cef36c210218390af91ebecce6ef25ce0407eb617ce45feb5d1 Jul 29 18:34:11.501095 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:11.501073 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc32d54e9_555f_4f8b_9157_09e3fb9ab5e6.slice/crio-5a248ff9f034df66e984ac1b5f8ed3dcd948b75827c0f92de7b42ab5434adf79 WatchSource:0}: Error finding container 5a248ff9f034df66e984ac1b5f8ed3dcd948b75827c0f92de7b42ab5434adf79: Status 404 returned error can't find the container with id 5a248ff9f034df66e984ac1b5f8ed3dcd948b75827c0f92de7b42ab5434adf79 Jul 29 18:34:11.502873 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:11.502832 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3013e3c_44c1_49d0_be60_1a54f6b9d891.slice/crio-0e1513f6b7bc4fab6cfe4f31a87a05906519eafcb1a371d46132157b4868629e WatchSource:0}: Error finding container 0e1513f6b7bc4fab6cfe4f31a87a05906519eafcb1a371d46132157b4868629e: Status 404 returned error can't find the container with id 0e1513f6b7bc4fab6cfe4f31a87a05906519eafcb1a371d46132157b4868629e Jul 29 18:34:11.505142 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:11.504963 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd908e5bd_1d3b_4142_a730_c1993b33b31f.slice/crio-764abfc74766e9e31475d23716c4661445aca2f9beb3420c21580fcbd5288b36 WatchSource:0}: Error finding container 764abfc74766e9e31475d23716c4661445aca2f9beb3420c21580fcbd5288b36: Status 404 returned error can't find the container with id 764abfc74766e9e31475d23716c4661445aca2f9beb3420c21580fcbd5288b36 Jul 29 18:34:11.505927 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:11.505347 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbb024f4_9e95_49a4_968b_f161254485e2.slice/crio-ecf4f6d2e2ca51b1bfcbd0661cf3db70d78df2d82702e64b6341706880d97d31 WatchSource:0}: Error finding container ecf4f6d2e2ca51b1bfcbd0661cf3db70d78df2d82702e64b6341706880d97d31: Status 404 returned error can't find the container with id ecf4f6d2e2ca51b1bfcbd0661cf3db70d78df2d82702e64b6341706880d97d31 Jul 29 18:34:11.507638 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:11.507603 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac39ef91_ebd7_46e9_8001_55b544a7dcea.slice/crio-253d3a02d057e5fba6eb577ae4975936f99efc94ad5dc6288997bf2bc9be0e72 WatchSource:0}: Error finding container 253d3a02d057e5fba6eb577ae4975936f99efc94ad5dc6288997bf2bc9be0e72: Status 404 returned error can't find the container with id 253d3a02d057e5fba6eb577ae4975936f99efc94ad5dc6288997bf2bc9be0e72 Jul 29 18:34:11.652532 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.652444 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 18:34:11.720534 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.720352 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs\") pod \"network-metrics-daemon-94h2v\" (UID: \"1e43e1c7-433e-4559-8fa2-2c818770dc36\") " pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:34:11.720687 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:11.720503 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:11.720687 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.720626 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eae5d913-e185-42ae-9bf9-beabffd3d865-original-pull-secret\") pod \"global-pull-secret-syncer-txtcd\" (UID: \"eae5d913-e185-42ae-9bf9-beabffd3d865\") " pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:11.720687 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:11.720676 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs podName:1e43e1c7-433e-4559-8fa2-2c818770dc36 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:12.720652137 +0000 UTC m=+4.060758876 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs") pod "network-metrics-daemon-94h2v" (UID: "1e43e1c7-433e-4559-8fa2-2c818770dc36") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:11.720852 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:11.720732 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:11.720852 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:11.720794 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae5d913-e185-42ae-9bf9-beabffd3d865-original-pull-secret podName:eae5d913-e185-42ae-9bf9-beabffd3d865 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:12.72077766 +0000 UTC m=+4.060884400 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eae5d913-e185-42ae-9bf9-beabffd3d865-original-pull-secret") pod "global-pull-secret-syncer-txtcd" (UID: "eae5d913-e185-42ae-9bf9-beabffd3d865") : object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:11.821455 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:11.821421 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdk8f\" (UniqueName: \"kubernetes.io/projected/0bd004cf-695f-4759-ad1a-daa6563fbc3a-kube-api-access-fdk8f\") pod \"network-check-target-rsmkr\" (UID: \"0bd004cf-695f-4759-ad1a-daa6563fbc3a\") " pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:34:11.821632 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:11.821613 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 18:34:11.821632 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:11.821638 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 18:34:11.821737 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:11.821648 2560 projected.go:196] Error preparing data for projected volume kube-api-access-fdk8f for pod openshift-network-diagnostics/network-check-target-rsmkr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:11.821737 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:11.821707 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0bd004cf-695f-4759-ad1a-daa6563fbc3a-kube-api-access-fdk8f podName:0bd004cf-695f-4759-ad1a-daa6563fbc3a nodeName:}" failed. No retries permitted until 2026-07-29 18:34:12.821693587 +0000 UTC m=+4.161800312 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fdk8f" (UniqueName: "kubernetes.io/projected/0bd004cf-695f-4759-ad1a-daa6563fbc3a-kube-api-access-fdk8f") pod "network-check-target-rsmkr" (UID: "0bd004cf-695f-4759-ad1a-daa6563fbc3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:12.151952 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:12.151760 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 18:29:11 +0000 UTC" deadline="2028-01-05 14:24:32.835404517 +0000 UTC" Jul 29 18:34:12.151952 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:12.151818 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12595h50m20.683590682s" Jul 29 18:34:12.261688 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:12.261654 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:34:12.261883 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:12.261799 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94h2v" podUID="1e43e1c7-433e-4559-8fa2-2c818770dc36" Jul 29 18:34:12.262259 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:12.262238 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:34:12.262367 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:12.262344 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rsmkr" podUID="0bd004cf-695f-4759-ad1a-daa6563fbc3a" Jul 29 18:34:12.289340 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:12.289249 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bn2mn" event={"ID":"ac39ef91-ebd7-46e9-8001-55b544a7dcea","Type":"ContainerStarted","Data":"253d3a02d057e5fba6eb577ae4975936f99efc94ad5dc6288997bf2bc9be0e72"} Jul 29 18:34:12.294150 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:12.294011 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" event={"ID":"dbb024f4-9e95-49a4-968b-f161254485e2","Type":"ContainerStarted","Data":"ecf4f6d2e2ca51b1bfcbd0661cf3db70d78df2d82702e64b6341706880d97d31"} Jul 29 18:34:12.304291 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:12.304131 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" event={"ID":"d908e5bd-1d3b-4142-a730-c1993b33b31f","Type":"ContainerStarted","Data":"764abfc74766e9e31475d23716c4661445aca2f9beb3420c21580fcbd5288b36"} Jul 29 18:34:12.309598 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:12.309561 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p2gzm" event={"ID":"c3013e3c-44c1-49d0-be60-1a54f6b9d891","Type":"ContainerStarted","Data":"0e1513f6b7bc4fab6cfe4f31a87a05906519eafcb1a371d46132157b4868629e"} Jul 29 18:34:12.316273 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:12.316182 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5xpww" event={"ID":"c32d54e9-555f-4f8b-9157-09e3fb9ab5e6","Type":"ContainerStarted","Data":"5a248ff9f034df66e984ac1b5f8ed3dcd948b75827c0f92de7b42ab5434adf79"} Jul 29 18:34:12.328869 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:12.328824 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7zxz4" event={"ID":"64c334b9-60b0-4b1b-96b3-c8caaf87f3fc","Type":"ContainerStarted","Data":"3ac59608de4d0cef36c210218390af91ebecce6ef25ce0407eb617ce45feb5d1"} Jul 29 18:34:12.338340 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:12.338279 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8qxk" event={"ID":"621948c8-2ee5-4e82-b91b-b316e662af37","Type":"ContainerStarted","Data":"0e3f9659a87b54b2e0596e2089f0cb1fb37094a7b3172141cf3788caaf9afbcf"} Jul 29 18:34:12.349799 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:12.349761 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-135.ec2.internal" event={"ID":"ca2bdc6067477bf48ef1a76df789af47","Type":"ContainerDied","Data":"db86e0bc02a4c011a09ce4484f832450108f60dbe8d3d0dc1568863d7d782cc6"} Jul 29 18:34:12.350272 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:12.350242 2560 generic.go:356] "Generic (PLEG): container finished" podID="ca2bdc6067477bf48ef1a76df789af47" containerID="db86e0bc02a4c011a09ce4484f832450108f60dbe8d3d0dc1568863d7d782cc6" exitCode=0 Jul 29 18:34:12.356765 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:12.356727 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w6ng5" event={"ID":"2be38e75-d5f3-48a1-a3eb-705b9ac9b7ae","Type":"ContainerStarted","Data":"32c9c6725849b7cc8715c35e1682c93060465b6d041b0cd6c8deff414d66c1f2"} Jul 29 18:34:12.392701 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:12.392189 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bnb6z" event={"ID":"e3f7153c-aca1-4eae-8b30-d47df7715005","Type":"ContainerStarted","Data":"0bb82c6fb23beb13e56cbb4adfc4cb75fab74d4f79bf9e12f86241895e8eacc6"} Jul 29 18:34:12.733201 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:12.732370 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eae5d913-e185-42ae-9bf9-beabffd3d865-original-pull-secret\") pod \"global-pull-secret-syncer-txtcd\" (UID: \"eae5d913-e185-42ae-9bf9-beabffd3d865\") " pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:12.733201 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:12.732443 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs\") pod \"network-metrics-daemon-94h2v\" (UID: \"1e43e1c7-433e-4559-8fa2-2c818770dc36\") " pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:34:12.733201 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:12.732628 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:12.733201 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:12.732697 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs podName:1e43e1c7-433e-4559-8fa2-2c818770dc36 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:14.732678843 +0000 UTC m=+6.072785584 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs") pod "network-metrics-daemon-94h2v" (UID: "1e43e1c7-433e-4559-8fa2-2c818770dc36") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:12.733201 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:12.733110 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:12.733201 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:12.733162 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae5d913-e185-42ae-9bf9-beabffd3d865-original-pull-secret podName:eae5d913-e185-42ae-9bf9-beabffd3d865 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:14.733145876 +0000 UTC m=+6.073252606 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eae5d913-e185-42ae-9bf9-beabffd3d865-original-pull-secret") pod "global-pull-secret-syncer-txtcd" (UID: "eae5d913-e185-42ae-9bf9-beabffd3d865") : object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:12.833895 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:12.833064 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdk8f\" (UniqueName: \"kubernetes.io/projected/0bd004cf-695f-4759-ad1a-daa6563fbc3a-kube-api-access-fdk8f\") pod \"network-check-target-rsmkr\" (UID: \"0bd004cf-695f-4759-ad1a-daa6563fbc3a\") " pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:34:12.833895 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:12.833266 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 18:34:12.833895 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:12.833290 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 18:34:12.833895 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:12.833304 2560 projected.go:196] Error preparing data for projected volume kube-api-access-fdk8f for pod openshift-network-diagnostics/network-check-target-rsmkr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:12.833895 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:12.833368 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0bd004cf-695f-4759-ad1a-daa6563fbc3a-kube-api-access-fdk8f podName:0bd004cf-695f-4759-ad1a-daa6563fbc3a nodeName:}" failed. No retries permitted until 2026-07-29 18:34:14.833347293 +0000 UTC m=+6.173454021 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fdk8f" (UniqueName: "kubernetes.io/projected/0bd004cf-695f-4759-ad1a-daa6563fbc3a-kube-api-access-fdk8f") pod "network-check-target-rsmkr" (UID: "0bd004cf-695f-4759-ad1a-daa6563fbc3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:13.152791 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:13.152686 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 18:29:11 +0000 UTC" deadline="2028-04-09 23:10:40.949895058 +0000 UTC" Jul 29 18:34:13.152791 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:13.152730 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14884h36m27.797169826s" Jul 29 18:34:13.262297 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:13.261784 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:13.262297 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:13.261925 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-txtcd" podUID="eae5d913-e185-42ae-9bf9-beabffd3d865" Jul 29 18:34:13.417911 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:13.417823 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-135.ec2.internal" event={"ID":"ca2bdc6067477bf48ef1a76df789af47","Type":"ContainerStarted","Data":"475f8a84d846c5278706398063e77637b342b32d69d094881e44560fceaee7f0"} Jul 29 18:34:14.261569 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:14.261531 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:34:14.262106 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:14.261695 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rsmkr" podUID="0bd004cf-695f-4759-ad1a-daa6563fbc3a" Jul 29 18:34:14.262172 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:14.262129 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:34:14.262311 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:14.262285 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94h2v" podUID="1e43e1c7-433e-4559-8fa2-2c818770dc36" Jul 29 18:34:14.751954 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:14.751868 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eae5d913-e185-42ae-9bf9-beabffd3d865-original-pull-secret\") pod \"global-pull-secret-syncer-txtcd\" (UID: \"eae5d913-e185-42ae-9bf9-beabffd3d865\") " pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:14.751954 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:14.751944 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs\") pod \"network-metrics-daemon-94h2v\" (UID: \"1e43e1c7-433e-4559-8fa2-2c818770dc36\") " pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:34:14.752183 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:14.752094 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:14.752183 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:14.752155 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs podName:1e43e1c7-433e-4559-8fa2-2c818770dc36 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:18.752134816 +0000 UTC m=+10.092241559 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs") pod "network-metrics-daemon-94h2v" (UID: "1e43e1c7-433e-4559-8fa2-2c818770dc36") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:14.752593 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:14.752570 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:14.752700 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:14.752655 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae5d913-e185-42ae-9bf9-beabffd3d865-original-pull-secret podName:eae5d913-e185-42ae-9bf9-beabffd3d865 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:18.752620795 +0000 UTC m=+10.092727538 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eae5d913-e185-42ae-9bf9-beabffd3d865-original-pull-secret") pod "global-pull-secret-syncer-txtcd" (UID: "eae5d913-e185-42ae-9bf9-beabffd3d865") : object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:14.853258 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:14.853220 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdk8f\" (UniqueName: \"kubernetes.io/projected/0bd004cf-695f-4759-ad1a-daa6563fbc3a-kube-api-access-fdk8f\") pod \"network-check-target-rsmkr\" (UID: \"0bd004cf-695f-4759-ad1a-daa6563fbc3a\") " pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:34:14.853460 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:14.853438 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 18:34:14.853460 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:14.853461 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 18:34:14.853592 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:14.853473 2560 projected.go:196] Error preparing data for projected volume kube-api-access-fdk8f for pod openshift-network-diagnostics/network-check-target-rsmkr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:14.853592 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:14.853527 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0bd004cf-695f-4759-ad1a-daa6563fbc3a-kube-api-access-fdk8f podName:0bd004cf-695f-4759-ad1a-daa6563fbc3a nodeName:}" failed. No retries permitted until 2026-07-29 18:34:18.853508201 +0000 UTC m=+10.193614944 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fdk8f" (UniqueName: "kubernetes.io/projected/0bd004cf-695f-4759-ad1a-daa6563fbc3a-kube-api-access-fdk8f") pod "network-check-target-rsmkr" (UID: "0bd004cf-695f-4759-ad1a-daa6563fbc3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:15.262777 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:15.262712 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:15.263251 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:15.262853 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-txtcd" podUID="eae5d913-e185-42ae-9bf9-beabffd3d865" Jul 29 18:34:16.261799 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:16.261762 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:34:16.261981 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:16.261920 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94h2v" podUID="1e43e1c7-433e-4559-8fa2-2c818770dc36" Jul 29 18:34:16.262381 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:16.262361 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:34:16.262492 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:16.262455 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rsmkr" podUID="0bd004cf-695f-4759-ad1a-daa6563fbc3a" Jul 29 18:34:17.261999 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:17.261919 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:17.262462 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:17.262065 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-txtcd" podUID="eae5d913-e185-42ae-9bf9-beabffd3d865" Jul 29 18:34:18.261521 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:18.261483 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:34:18.261521 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:18.261507 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:34:18.261800 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:18.261625 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rsmkr" podUID="0bd004cf-695f-4759-ad1a-daa6563fbc3a" Jul 29 18:34:18.261800 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:18.261768 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94h2v" podUID="1e43e1c7-433e-4559-8fa2-2c818770dc36" Jul 29 18:34:18.796667 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:18.796624 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eae5d913-e185-42ae-9bf9-beabffd3d865-original-pull-secret\") pod \"global-pull-secret-syncer-txtcd\" (UID: \"eae5d913-e185-42ae-9bf9-beabffd3d865\") " pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:18.797200 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:18.796700 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs\") pod \"network-metrics-daemon-94h2v\" (UID: \"1e43e1c7-433e-4559-8fa2-2c818770dc36\") " pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:34:18.797200 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:18.796871 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:18.797200 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:18.796937 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs podName:1e43e1c7-433e-4559-8fa2-2c818770dc36 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:26.79691683 +0000 UTC m=+18.137023561 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs") pod "network-metrics-daemon-94h2v" (UID: "1e43e1c7-433e-4559-8fa2-2c818770dc36") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:18.797403 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:18.797350 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:18.797460 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:18.797403 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae5d913-e185-42ae-9bf9-beabffd3d865-original-pull-secret podName:eae5d913-e185-42ae-9bf9-beabffd3d865 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:26.797390298 +0000 UTC m=+18.137497023 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eae5d913-e185-42ae-9bf9-beabffd3d865-original-pull-secret") pod "global-pull-secret-syncer-txtcd" (UID: "eae5d913-e185-42ae-9bf9-beabffd3d865") : object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:18.897915 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:18.897787 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdk8f\" (UniqueName: \"kubernetes.io/projected/0bd004cf-695f-4759-ad1a-daa6563fbc3a-kube-api-access-fdk8f\") pod \"network-check-target-rsmkr\" (UID: \"0bd004cf-695f-4759-ad1a-daa6563fbc3a\") " pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:34:18.898109 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:18.897992 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 18:34:18.898109 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:18.898019 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 18:34:18.898109 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:18.898034 2560 projected.go:196] Error preparing data for projected volume kube-api-access-fdk8f for pod openshift-network-diagnostics/network-check-target-rsmkr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:18.898109 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:18.898104 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0bd004cf-695f-4759-ad1a-daa6563fbc3a-kube-api-access-fdk8f podName:0bd004cf-695f-4759-ad1a-daa6563fbc3a nodeName:}" failed. No retries permitted until 2026-07-29 18:34:26.898082896 +0000 UTC m=+18.238189626 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fdk8f" (UniqueName: "kubernetes.io/projected/0bd004cf-695f-4759-ad1a-daa6563fbc3a-kube-api-access-fdk8f") pod "network-check-target-rsmkr" (UID: "0bd004cf-695f-4759-ad1a-daa6563fbc3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:19.262834 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:19.262746 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:19.262985 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:19.262878 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-txtcd" podUID="eae5d913-e185-42ae-9bf9-beabffd3d865" Jul 29 18:34:20.261844 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:20.261552 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:34:20.261844 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:20.261576 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:34:20.261844 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:20.261687 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rsmkr" podUID="0bd004cf-695f-4759-ad1a-daa6563fbc3a" Jul 29 18:34:20.261844 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:20.261755 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94h2v" podUID="1e43e1c7-433e-4559-8fa2-2c818770dc36" Jul 29 18:34:21.265306 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:21.265274 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:21.265784 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:21.265401 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-txtcd" podUID="eae5d913-e185-42ae-9bf9-beabffd3d865" Jul 29 18:34:22.262123 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:22.262088 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:34:22.262291 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:22.262202 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94h2v" podUID="1e43e1c7-433e-4559-8fa2-2c818770dc36" Jul 29 18:34:22.262291 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:22.262230 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:34:22.262291 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:22.262276 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rsmkr" podUID="0bd004cf-695f-4759-ad1a-daa6563fbc3a" Jul 29 18:34:23.261575 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:23.261528 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:23.262000 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:23.261667 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-txtcd" podUID="eae5d913-e185-42ae-9bf9-beabffd3d865" Jul 29 18:34:24.261759 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:24.261685 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:34:24.262183 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:24.261694 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:34:24.262183 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:24.261806 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rsmkr" podUID="0bd004cf-695f-4759-ad1a-daa6563fbc3a" Jul 29 18:34:24.262183 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:24.261885 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94h2v" podUID="1e43e1c7-433e-4559-8fa2-2c818770dc36" Jul 29 18:34:25.264860 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:25.264832 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:25.265297 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:25.264937 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-txtcd" podUID="eae5d913-e185-42ae-9bf9-beabffd3d865" Jul 29 18:34:26.261539 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:26.261510 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:34:26.261539 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:26.261541 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:34:26.261899 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:26.261657 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94h2v" podUID="1e43e1c7-433e-4559-8fa2-2c818770dc36" Jul 29 18:34:26.261899 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:26.261787 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rsmkr" podUID="0bd004cf-695f-4759-ad1a-daa6563fbc3a" Jul 29 18:34:26.860618 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:26.860570 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eae5d913-e185-42ae-9bf9-beabffd3d865-original-pull-secret\") pod \"global-pull-secret-syncer-txtcd\" (UID: \"eae5d913-e185-42ae-9bf9-beabffd3d865\") " pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:26.861072 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:26.860643 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs\") pod \"network-metrics-daemon-94h2v\" (UID: \"1e43e1c7-433e-4559-8fa2-2c818770dc36\") " pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:34:26.861072 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:26.860727 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:26.861072 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:26.860765 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:26.861072 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:26.860793 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae5d913-e185-42ae-9bf9-beabffd3d865-original-pull-secret podName:eae5d913-e185-42ae-9bf9-beabffd3d865 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:42.860777247 +0000 UTC m=+34.200883969 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eae5d913-e185-42ae-9bf9-beabffd3d865-original-pull-secret") pod "global-pull-secret-syncer-txtcd" (UID: "eae5d913-e185-42ae-9bf9-beabffd3d865") : object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:26.861072 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:26.860817 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs podName:1e43e1c7-433e-4559-8fa2-2c818770dc36 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:42.860800511 +0000 UTC m=+34.200907242 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs") pod "network-metrics-daemon-94h2v" (UID: "1e43e1c7-433e-4559-8fa2-2c818770dc36") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:26.961032 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:26.960997 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdk8f\" (UniqueName: \"kubernetes.io/projected/0bd004cf-695f-4759-ad1a-daa6563fbc3a-kube-api-access-fdk8f\") pod \"network-check-target-rsmkr\" (UID: \"0bd004cf-695f-4759-ad1a-daa6563fbc3a\") " pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:34:26.961221 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:26.961153 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 18:34:26.961221 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:26.961180 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 18:34:26.961221 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:26.961194 2560 projected.go:196] Error preparing data for projected volume kube-api-access-fdk8f for pod openshift-network-diagnostics/network-check-target-rsmkr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:26.961365 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:26.961249 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0bd004cf-695f-4759-ad1a-daa6563fbc3a-kube-api-access-fdk8f podName:0bd004cf-695f-4759-ad1a-daa6563fbc3a nodeName:}" failed. No retries permitted until 2026-07-29 18:34:42.961237091 +0000 UTC m=+34.301343816 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fdk8f" (UniqueName: "kubernetes.io/projected/0bd004cf-695f-4759-ad1a-daa6563fbc3a-kube-api-access-fdk8f") pod "network-check-target-rsmkr" (UID: "0bd004cf-695f-4759-ad1a-daa6563fbc3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:27.265118 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:27.265050 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:27.265286 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:27.265167 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-txtcd" podUID="eae5d913-e185-42ae-9bf9-beabffd3d865" Jul 29 18:34:28.261480 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:28.261436 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:34:28.261935 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:28.261449 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:34:28.261935 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:28.261595 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rsmkr" podUID="0bd004cf-695f-4759-ad1a-daa6563fbc3a" Jul 29 18:34:28.261935 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:28.261705 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94h2v" podUID="1e43e1c7-433e-4559-8fa2-2c818770dc36" Jul 29 18:34:29.261991 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:29.261950 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:29.262476 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:29.262070 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-txtcd" podUID="eae5d913-e185-42ae-9bf9-beabffd3d865" Jul 29 18:34:30.261365 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:30.261327 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:34:30.261365 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:30.261355 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:34:30.261615 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:30.261463 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94h2v" podUID="1e43e1c7-433e-4559-8fa2-2c818770dc36" Jul 29 18:34:30.261686 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:30.261625 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rsmkr" podUID="0bd004cf-695f-4759-ad1a-daa6563fbc3a" Jul 29 18:34:31.261311 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:31.261272 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:31.261738 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:31.261401 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-txtcd" podUID="eae5d913-e185-42ae-9bf9-beabffd3d865" Jul 29 18:34:32.261741 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:32.261420 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:34:32.262318 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:32.261487 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:34:32.262318 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:32.261809 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rsmkr" podUID="0bd004cf-695f-4759-ad1a-daa6563fbc3a" Jul 29 18:34:32.262318 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:32.261905 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94h2v" podUID="1e43e1c7-433e-4559-8fa2-2c818770dc36" Jul 29 18:34:32.477906 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:32.477873 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-135.ec2.internal" event={"ID":"12e8f3118c4c6824b49f49c364fe735b","Type":"ContainerStarted","Data":"9163d5e5b08f93ee960e97b7f68eca2bd64fca02f483716c9a1e6303ed00e8e1"} Jul 29 18:34:32.481921 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:32.481893 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bn2mn" event={"ID":"ac39ef91-ebd7-46e9-8001-55b544a7dcea","Type":"ContainerStarted","Data":"6036fca11861ad1d73e280936004d846b7c02b7bf84b8fd9cc79b660011fd24e"} Jul 29 18:34:32.483225 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:32.483204 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" event={"ID":"dbb024f4-9e95-49a4-968b-f161254485e2","Type":"ContainerStarted","Data":"a47aa2b0e704b5089461affc020a5a08a5ee0ed3872a7add0f9cca40aa72d672"} Jul 29 18:34:32.485901 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:32.485879 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" event={"ID":"d908e5bd-1d3b-4142-a730-c1993b33b31f","Type":"ContainerStarted","Data":"0ecbf253739d565d71f6584d4bd4cffbab842d6a99a8de391667ef573eeaf789"} Jul 29 18:34:32.486003 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:32.485955 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" event={"ID":"d908e5bd-1d3b-4142-a730-c1993b33b31f","Type":"ContainerStarted","Data":"c64be0874f3b5911ca984201ab76da7e2e1320874c49245670ed5ccc7909b947"} Jul 29 18:34:32.486049 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:32.486004 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" event={"ID":"d908e5bd-1d3b-4142-a730-c1993b33b31f","Type":"ContainerStarted","Data":"b3524cdf0883b431a85f176f9b2ae3fc0e2acb5f186de19ca6f4f9e108504879"} Jul 29 18:34:32.486091 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:32.486052 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" event={"ID":"d908e5bd-1d3b-4142-a730-c1993b33b31f","Type":"ContainerStarted","Data":"f0c13d6b6a49dd1a4e8eab009db97e3a3af5ffc3d3ae5b752456244704b69973"} Jul 29 18:34:32.486138 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:32.486097 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" event={"ID":"d908e5bd-1d3b-4142-a730-c1993b33b31f","Type":"ContainerStarted","Data":"93d297148fd6ab8b71954b1ab30c69c4409185a2c6a76532badad02ee84f76d6"} Jul 29 18:34:32.486138 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:32.486126 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" event={"ID":"d908e5bd-1d3b-4142-a730-c1993b33b31f","Type":"ContainerStarted","Data":"b5530591e327db4133f73c4108fb0f6e362d208ef95be36f60c89ea301b26e81"} Jul 29 18:34:32.487216 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:32.487187 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p2gzm" event={"ID":"c3013e3c-44c1-49d0-be60-1a54f6b9d891","Type":"ContainerStarted","Data":"c6069c6596f796306a38b8cb9769be643d69fe2eeddd02f103d0d1fe26284038"} Jul 29 18:34:32.488388 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:32.488372 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5xpww" event={"ID":"c32d54e9-555f-4f8b-9157-09e3fb9ab5e6","Type":"ContainerStarted","Data":"cedecfc17c4587d5d3122e9c6baecdd07018025fd969952aefbc33c53ea21da7"} Jul 29 18:34:32.489520 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:32.489501 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7zxz4" event={"ID":"64c334b9-60b0-4b1b-96b3-c8caaf87f3fc","Type":"ContainerStarted","Data":"2c9e635945e5fbc5a3f797fc6b778b04caee21dd2f205daa8be06bc0bfca60f3"} Jul 29 18:34:32.490880 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:32.490860 2560 generic.go:356] "Generic (PLEG): container finished" podID="621948c8-2ee5-4e82-b91b-b316e662af37" containerID="c1a4bd1897bb3105f224315fe61fa4b67110c4ec325f0d28986d1cea384bd909" exitCode=0 Jul 29 18:34:32.490953 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:32.490917 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8qxk" event={"ID":"621948c8-2ee5-4e82-b91b-b316e662af37","Type":"ContainerDied","Data":"c1a4bd1897bb3105f224315fe61fa4b67110c4ec325f0d28986d1cea384bd909"} Jul 29 18:34:32.492427 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:32.492404 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w6ng5" event={"ID":"2be38e75-d5f3-48a1-a3eb-705b9ac9b7ae","Type":"ContainerStarted","Data":"10092ba3c3195612cf0f6db4c9c12ebe854e4bd6861c782703fa92844fe6aa45"} Jul 29 18:34:32.493743 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:32.493722 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bnb6z" event={"ID":"e3f7153c-aca1-4eae-8b30-d47df7715005","Type":"ContainerStarted","Data":"211f5eaf29a424d097f36368c255822976a85845c55e542af9d2b3b4cf9b4426"} Jul 29 18:34:32.496410 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:32.496376 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-135.ec2.internal" podStartSLOduration=21.49636556 podStartE2EDuration="21.49636556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:32.496227311 +0000 UTC m=+23.836334055" watchObservedRunningTime="2026-07-29 18:34:32.49636556 +0000 UTC m=+23.836472305" Jul 29 18:34:32.496563 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:32.496535 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-135.ec2.internal" podStartSLOduration=21.496531148 podStartE2EDuration="21.496531148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:13.437097283 +0000 UTC m=+4.777204032" watchObservedRunningTime="2026-07-29 18:34:32.496531148 +0000 UTC m=+23.836637893" Jul 29 18:34:32.511869 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:32.511809 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7zxz4" podStartSLOduration=2.677170105 podStartE2EDuration="22.511802266s" totalImagesPullingTime="19.834632161s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:32.511703689 +0000 UTC m=+23.851810434" watchObservedRunningTime="2026-07-29 18:34:32.511802266 +0000 UTC m=+23.851909012" Jul 29 18:34:32.527050 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:32.527012 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bn2mn" podStartSLOduration=6.623691825 podStartE2EDuration="22.527000112s" totalImagesPullingTime="15.903308287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:32.526527573 +0000 UTC m=+23.866634331" watchObservedRunningTime="2026-07-29 18:34:32.527000112 +0000 UTC m=+23.867106857" Jul 29 18:34:32.567424 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:32.567386 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-w6ng5" podStartSLOduration=2.730949882 podStartE2EDuration="22.567373106s" totalImagesPullingTime="19.836423224s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:32.539986428 +0000 UTC m=+23.880093173" watchObservedRunningTime="2026-07-29 18:34:32.567373106 +0000 UTC m=+23.907479865" Jul 29 18:34:32.591296 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:32.591256 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2k7fr" podStartSLOduration=2.7605720419999997 podStartE2EDuration="22.59124367s" totalImagesPullingTime="19.830671628s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:32.591093662 +0000 UTC m=+23.931200406" watchObservedRunningTime="2026-07-29 18:34:32.59124367 +0000 UTC m=+23.931350414" Jul 29 18:34:32.607748 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:32.607714 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bnb6z" podStartSLOduration=2.705466884 podStartE2EDuration="22.607701843s" totalImagesPullingTime="19.902234959s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:32.60750183 +0000 UTC m=+23.947608574" watchObservedRunningTime="2026-07-29 18:34:32.607701843 +0000 UTC m=+23.947808588" Jul 29 18:34:32.630300 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:32.630263 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-p2gzm" podStartSLOduration=2.800694452 podStartE2EDuration="22.63025136s" totalImagesPullingTime="19.829556908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:32.630197095 +0000 UTC m=+23.970303853" watchObservedRunningTime="2026-07-29 18:34:32.63025136 +0000 UTC m=+23.970358106" Jul 29 18:34:32.883004 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:32.882982 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 29 18:34:33.172741 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:33.172612 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T18:34:32.882998199Z","UUID":"dc79605c-985d-4223-8674-782bedb243f3","Handler":null,"Name":"","Endpoint":""} Jul 29 18:34:33.174464 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:33.174446 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 29 18:34:33.174602 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:33.174483 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 29 18:34:33.261260 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:33.261225 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:33.261413 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:33.261361 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-txtcd" podUID="eae5d913-e185-42ae-9bf9-beabffd3d865" Jul 29 18:34:33.501276 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:33.501242 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5xpww" event={"ID":"c32d54e9-555f-4f8b-9157-09e3fb9ab5e6","Type":"ContainerStarted","Data":"b9bfe56b2e7b05c161a48f67fd3d5a0ffa34f6fcf5d6bccbc7ecdf772cba8205"} Jul 29 18:34:33.791603 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:33.791524 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-p2gzm" Jul 29 18:34:33.792071 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:33.792051 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-p2gzm" Jul 29 18:34:34.261586 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:34.261535 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:34:34.261802 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:34.261753 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rsmkr" podUID="0bd004cf-695f-4759-ad1a-daa6563fbc3a" Jul 29 18:34:34.261802 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:34.261788 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:34:34.261943 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:34.261920 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94h2v" podUID="1e43e1c7-433e-4559-8fa2-2c818770dc36" Jul 29 18:34:34.507888 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:34.507789 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" event={"ID":"d908e5bd-1d3b-4142-a730-c1993b33b31f","Type":"ContainerStarted","Data":"63a39411114ea2acb75a024aea967384d042e1d4d9c55bd419fb8c417da97f67"} Jul 29 18:34:34.509986 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:34.509954 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5xpww" event={"ID":"c32d54e9-555f-4f8b-9157-09e3fb9ab5e6","Type":"ContainerStarted","Data":"2e9f1be1b63f6c7d1624d950daff03952631fdfd3ce7caa9b36bca8b8981d687"} Jul 29 18:34:34.529922 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:34.529867 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5xpww" podStartSLOduration=2.453913275 podStartE2EDuration="24.529851143s" totalImagesPullingTime="22.075937868s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:34.529175391 +0000 UTC m=+25.869282185" watchObservedRunningTime="2026-07-29 18:34:34.529851143 +0000 UTC m=+25.869957887" Jul 29 18:34:35.262299 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:35.262098 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:35.262484 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:35.262408 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-txtcd" podUID="eae5d913-e185-42ae-9bf9-beabffd3d865" Jul 29 18:34:35.512458 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:35.512386 2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 29 18:34:36.261893 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:36.261862 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:34:36.262060 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:36.261902 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:34:36.262060 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:36.261992 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94h2v" podUID="1e43e1c7-433e-4559-8fa2-2c818770dc36" Jul 29 18:34:36.262171 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:36.262146 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rsmkr" podUID="0bd004cf-695f-4759-ad1a-daa6563fbc3a" Jul 29 18:34:36.522545 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:36.522443 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" event={"ID":"d908e5bd-1d3b-4142-a730-c1993b33b31f","Type":"ContainerStarted","Data":"d960f3f702af8db762b0f27aff5a157bb8626c8d0e35aa496ce784791aa45bed"} Jul 29 18:34:36.524148 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:36.522702 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:36.538066 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:36.538047 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:36.555671 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:36.555630 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" podStartSLOduration=6.660770966 podStartE2EDuration="26.555614392s" totalImagesPullingTime="19.894843426s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:36.55517785 +0000 UTC m=+27.895284596" watchObservedRunningTime="2026-07-29 18:34:36.555614392 +0000 UTC m=+27.895721142" Jul 29 18:34:37.261926 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:37.261756 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:37.262094 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:37.261993 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-txtcd" podUID="eae5d913-e185-42ae-9bf9-beabffd3d865" Jul 29 18:34:37.471536 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:37.471506 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-p2gzm" Jul 29 18:34:37.471752 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:37.471634 2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 29 18:34:37.472089 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:37.472071 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-p2gzm" Jul 29 18:34:37.526112 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:37.526046 2560 generic.go:356] "Generic (PLEG): container finished" podID="621948c8-2ee5-4e82-b91b-b316e662af37" containerID="f3e448e3e1f89dd85c153a6fe2022aaf86c55a43d0999545d7f034aa9c960aa0" exitCode=0 Jul 29 18:34:37.526576 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:37.526136 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8qxk" event={"ID":"621948c8-2ee5-4e82-b91b-b316e662af37","Type":"ContainerDied","Data":"f3e448e3e1f89dd85c153a6fe2022aaf86c55a43d0999545d7f034aa9c960aa0"} Jul 29 18:34:37.526576 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:37.526475 2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 29 18:34:37.527306 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:37.526898 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:37.542283 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:37.542263 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:38.261341 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:38.261308 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:34:38.261341 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:38.261330 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:34:38.261618 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:38.261446 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94h2v" podUID="1e43e1c7-433e-4559-8fa2-2c818770dc36" Jul 29 18:34:38.261673 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:38.261607 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rsmkr" podUID="0bd004cf-695f-4759-ad1a-daa6563fbc3a" Jul 29 18:34:38.528156 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:38.528086 2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 29 18:34:38.697194 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:38.697162 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-txtcd"] Jul 29 18:34:38.697318 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:38.697272 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:38.697385 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:38.697362 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-txtcd" podUID="eae5d913-e185-42ae-9bf9-beabffd3d865" Jul 29 18:34:38.701277 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:38.701256 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-94h2v"] Jul 29 18:34:38.701409 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:38.701355 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:34:38.701475 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:38.701452 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94h2v" podUID="1e43e1c7-433e-4559-8fa2-2c818770dc36" Jul 29 18:34:38.702131 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:38.702107 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rsmkr"] Jul 29 18:34:38.702232 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:38.702196 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:34:38.702310 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:38.702289 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rsmkr" podUID="0bd004cf-695f-4759-ad1a-daa6563fbc3a" Jul 29 18:34:39.531744 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:39.531714 2560 generic.go:356] "Generic (PLEG): container finished" podID="621948c8-2ee5-4e82-b91b-b316e662af37" containerID="bc9a5d5370adc4ff454cd4cfd32e2ea3aba2e71693454c8604fb4c3b2ca80af3" exitCode=0 Jul 29 18:34:39.532078 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:39.531803 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8qxk" event={"ID":"621948c8-2ee5-4e82-b91b-b316e662af37","Type":"ContainerDied","Data":"bc9a5d5370adc4ff454cd4cfd32e2ea3aba2e71693454c8604fb4c3b2ca80af3"} Jul 29 18:34:39.532078 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:39.531857 2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 29 18:34:40.261541 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:40.261503 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:40.261541 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:40.261537 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:34:40.261541 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:40.261550 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:34:40.261845 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:40.261663 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-txtcd" podUID="eae5d913-e185-42ae-9bf9-beabffd3d865" Jul 29 18:34:40.261845 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:40.261775 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94h2v" podUID="1e43e1c7-433e-4559-8fa2-2c818770dc36" Jul 29 18:34:40.261845 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:40.261840 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rsmkr" podUID="0bd004cf-695f-4759-ad1a-daa6563fbc3a" Jul 29 18:34:41.124443 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:41.124256 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:34:41.124905 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:41.124692 2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 29 18:34:41.141300 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:41.141262 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" podUID="d908e5bd-1d3b-4142-a730-c1993b33b31f" containerName="ovnkube-controller" probeResult="failure" output="" Jul 29 18:34:41.149719 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:41.149684 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" podUID="d908e5bd-1d3b-4142-a730-c1993b33b31f" containerName="ovnkube-controller" probeResult="failure" output="" Jul 29 18:34:41.538987 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:41.538956 2560 generic.go:356] "Generic (PLEG): container finished" podID="621948c8-2ee5-4e82-b91b-b316e662af37" containerID="772c87efd992d87628255d22407d54065b176b007e84ca344e4ce2e50e3b6010" exitCode=0 Jul 29 18:34:41.539146 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:41.538999 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8qxk" event={"ID":"621948c8-2ee5-4e82-b91b-b316e662af37","Type":"ContainerDied","Data":"772c87efd992d87628255d22407d54065b176b007e84ca344e4ce2e50e3b6010"} Jul 29 18:34:42.261836 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:42.261809 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:42.261836 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:42.261840 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:34:42.262390 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:42.261843 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:34:42.262390 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:42.261930 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-txtcd" podUID="eae5d913-e185-42ae-9bf9-beabffd3d865" Jul 29 18:34:42.262390 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:42.261997 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rsmkr" podUID="0bd004cf-695f-4759-ad1a-daa6563fbc3a" Jul 29 18:34:42.262390 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:42.262074 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94h2v" podUID="1e43e1c7-433e-4559-8fa2-2c818770dc36" Jul 29 18:34:42.879699 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:42.879662 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eae5d913-e185-42ae-9bf9-beabffd3d865-original-pull-secret\") pod \"global-pull-secret-syncer-txtcd\" (UID: \"eae5d913-e185-42ae-9bf9-beabffd3d865\") " pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:42.879885 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:42.879732 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs\") pod \"network-metrics-daemon-94h2v\" (UID: \"1e43e1c7-433e-4559-8fa2-2c818770dc36\") " pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:34:42.879885 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:42.879816 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:42.879885 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:42.879862 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:42.880021 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:42.879893 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae5d913-e185-42ae-9bf9-beabffd3d865-original-pull-secret podName:eae5d913-e185-42ae-9bf9-beabffd3d865 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:14.879877907 +0000 UTC m=+66.219984629 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eae5d913-e185-42ae-9bf9-beabffd3d865-original-pull-secret") pod "global-pull-secret-syncer-txtcd" (UID: "eae5d913-e185-42ae-9bf9-beabffd3d865") : object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:42.880021 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:42.879914 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs podName:1e43e1c7-433e-4559-8fa2-2c818770dc36 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:14.879898684 +0000 UTC m=+66.220005424 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs") pod "network-metrics-daemon-94h2v" (UID: "1e43e1c7-433e-4559-8fa2-2c818770dc36") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:42.980471 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:42.980425 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdk8f\" (UniqueName: \"kubernetes.io/projected/0bd004cf-695f-4759-ad1a-daa6563fbc3a-kube-api-access-fdk8f\") pod \"network-check-target-rsmkr\" (UID: \"0bd004cf-695f-4759-ad1a-daa6563fbc3a\") " pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:34:42.980644 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:42.980577 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 18:34:42.980644 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:42.980594 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 18:34:42.980644 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:42.980603 2560 projected.go:196] Error preparing data for projected volume kube-api-access-fdk8f for pod openshift-network-diagnostics/network-check-target-rsmkr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:42.980770 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:42.980656 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0bd004cf-695f-4759-ad1a-daa6563fbc3a-kube-api-access-fdk8f podName:0bd004cf-695f-4759-ad1a-daa6563fbc3a nodeName:}" failed. No retries permitted until 2026-07-29 18:35:14.980638214 +0000 UTC m=+66.320744953 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fdk8f" (UniqueName: "kubernetes.io/projected/0bd004cf-695f-4759-ad1a-daa6563fbc3a-kube-api-access-fdk8f") pod "network-check-target-rsmkr" (UID: "0bd004cf-695f-4759-ad1a-daa6563fbc3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:43.927124 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:43.927094 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-135.ec2.internal" event="NodeReady" Jul 29 18:34:43.927526 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:43.927262 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 29 18:34:43.968455 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:43.968427 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-l94qg"] Jul 29 18:34:43.970691 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:43.970673 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-l94qg" Jul 29 18:34:43.973320 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:43.973295 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7cc9cc4c87-kfccg"] Jul 29 18:34:43.973698 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:43.973452 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 29 18:34:43.973698 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:43.973510 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-vmw8p\"" Jul 29 18:34:43.973865 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:43.973644 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 29 18:34:43.976023 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:43.976005 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-kl2tw"] Jul 29 18:34:43.976145 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:43.976131 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:34:43.978143 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:43.978125 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kl2tw" Jul 29 18:34:43.979615 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:43.979434 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 29 18:34:43.979615 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:43.979574 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 29 18:34:43.979769 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:43.979706 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-x4hx2\"" Jul 29 18:34:43.979827 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:43.979766 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 29 18:34:43.981220 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:43.981203 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 18:34:43.981309 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:43.981226 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 18:34:43.981363 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:43.981316 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-rmnxg\"" Jul 29 18:34:43.984873 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:43.984837 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-l94qg"] Jul 29 18:34:43.985367 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:43.985348 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 29 18:34:43.993695 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:43.992813 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-kl2tw"] Jul 29 18:34:43.993695 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:43.992902 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wljgs"] Jul 29 18:34:43.995278 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:43.995257 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tj78n"] Jul 29 18:34:43.995598 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:43.995579 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wljgs" Jul 29 18:34:43.997908 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:43.997888 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tj78n" Jul 29 18:34:43.998139 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:43.998117 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cc9cc4c87-kfccg"] Jul 29 18:34:43.999922 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:43.999905 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jmxd5\"" Jul 29 18:34:44.000344 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.000328 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 29 18:34:44.000512 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.000498 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 29 18:34:44.000684 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.000668 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zfgsf\"" Jul 29 18:34:44.000776 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.000759 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 29 18:34:44.001201 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.001107 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 29 18:34:44.001201 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.001149 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 29 18:34:44.007322 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.007301 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wljgs"] Jul 29 18:34:44.014130 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.014112 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tj78n"] Jul 29 18:34:44.086624 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.086529 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0c4b0ad6-e876-4580-841c-91a36f53a0f8-trusted-ca\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:34:44.086624 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.086588 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-bound-sa-token\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:34:44.086835 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.086641 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rn4v\" (UniqueName: \"kubernetes.io/projected/f8172992-b0a4-4052-8f49-cea2640071ec-kube-api-access-6rn4v\") pod \"network-check-source-7d88cb55d8-kl2tw\" (UID: \"f8172992-b0a4-4052-8f49-cea2640071ec\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kl2tw" Jul 29 18:34:44.086835 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.086677 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b762ab1b-627c-44b0-97c5-7d948e4ef348-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-l94qg\" (UID: \"b762ab1b-627c-44b0-97c5-7d948e4ef348\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-l94qg" Jul 29 18:34:44.086835 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.086732 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0c4b0ad6-e876-4580-841c-91a36f53a0f8-installation-pull-secrets\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:34:44.086835 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.086768 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-certificates\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:34:44.086835 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.086824 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28c92\" (UniqueName: \"kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-kube-api-access-28c92\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:34:44.087083 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.086854 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b762ab1b-627c-44b0-97c5-7d948e4ef348-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-l94qg\" (UID: \"b762ab1b-627c-44b0-97c5-7d948e4ef348\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-l94qg" Jul 29 18:34:44.087083 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.086878 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0c4b0ad6-e876-4580-841c-91a36f53a0f8-image-registry-private-configuration\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:34:44.087083 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.086919 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:34:44.087083 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.086943 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0c4b0ad6-e876-4580-841c-91a36f53a0f8-ca-trust-extracted\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:34:44.187804 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.187627 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-tmp-dir\") pod \"dns-default-tj78n\" (UID: \"a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91\") " pod="openshift-dns/dns-default-tj78n" Jul 29 18:34:44.187804 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.187676 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-certificates\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:34:44.187938 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.187856 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28c92\" (UniqueName: \"kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-kube-api-access-28c92\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:34:44.187938 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.187886 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-config-volume\") pod \"dns-default-tj78n\" (UID: \"a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91\") " pod="openshift-dns/dns-default-tj78n" Jul 29 18:34:44.187938 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.187915 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b762ab1b-627c-44b0-97c5-7d948e4ef348-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-l94qg\" (UID: \"b762ab1b-627c-44b0-97c5-7d948e4ef348\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-l94qg" Jul 29 18:34:44.188378 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.187939 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0c4b0ad6-e876-4580-841c-91a36f53a0f8-image-registry-private-configuration\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:34:44.188378 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.187964 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:34:44.188378 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.187988 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0c4b0ad6-e876-4580-841c-91a36f53a0f8-ca-trust-extracted\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:34:44.188378 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.188023 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0c4b0ad6-e876-4580-841c-91a36f53a0f8-trusted-ca\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:34:44.188378 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.188046 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-bound-sa-token\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:34:44.188378 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.188070 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-metrics-tls\") pod \"dns-default-tj78n\" (UID: \"a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91\") " pod="openshift-dns/dns-default-tj78n" Jul 29 18:34:44.188378 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.188098 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rn4v\" (UniqueName: \"kubernetes.io/projected/f8172992-b0a4-4052-8f49-cea2640071ec-kube-api-access-6rn4v\") pod \"network-check-source-7d88cb55d8-kl2tw\" (UID: \"f8172992-b0a4-4052-8f49-cea2640071ec\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kl2tw" Jul 29 18:34:44.188378 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.188123 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6574g\" (UniqueName: \"kubernetes.io/projected/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-kube-api-access-6574g\") pod \"dns-default-tj78n\" (UID: \"a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91\") " pod="openshift-dns/dns-default-tj78n" Jul 29 18:34:44.188378 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.188154 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b762ab1b-627c-44b0-97c5-7d948e4ef348-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-l94qg\" (UID: \"b762ab1b-627c-44b0-97c5-7d948e4ef348\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-l94qg" Jul 29 18:34:44.188378 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.188180 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b475136a-e94f-4558-a2c8-f1cc51174d5e-cert\") pod \"ingress-canary-wljgs\" (UID: \"b475136a-e94f-4558-a2c8-f1cc51174d5e\") " pod="openshift-ingress-canary/ingress-canary-wljgs" Jul 29 18:34:44.188378 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.188228 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0c4b0ad6-e876-4580-841c-91a36f53a0f8-installation-pull-secrets\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:34:44.188378 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.188251 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5wvm\" (UniqueName: \"kubernetes.io/projected/b475136a-e94f-4558-a2c8-f1cc51174d5e-kube-api-access-v5wvm\") pod \"ingress-canary-wljgs\" (UID: \"b475136a-e94f-4558-a2c8-f1cc51174d5e\") " pod="openshift-ingress-canary/ingress-canary-wljgs" Jul 29 18:34:44.188950 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.188531 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-certificates\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:34:44.189001 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:44.188991 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 18:34:44.189058 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:44.189051 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b762ab1b-627c-44b0-97c5-7d948e4ef348-networking-console-plugin-cert podName:b762ab1b-627c-44b0-97c5-7d948e4ef348 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:44.689032892 +0000 UTC m=+36.029139623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b762ab1b-627c-44b0-97c5-7d948e4ef348-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-l94qg" (UID: "b762ab1b-627c-44b0-97c5-7d948e4ef348") : secret "networking-console-plugin-cert" not found Jul 29 18:34:44.189539 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:44.189449 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 18:34:44.189539 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:44.189468 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cc9cc4c87-kfccg: secret "image-registry-tls" not found Jul 29 18:34:44.189539 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.189475 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b762ab1b-627c-44b0-97c5-7d948e4ef348-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-l94qg\" (UID: \"b762ab1b-627c-44b0-97c5-7d948e4ef348\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-l94qg" Jul 29 18:34:44.189539 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:44.189512 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls podName:0c4b0ad6-e876-4580-841c-91a36f53a0f8 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:44.689495387 +0000 UTC m=+36.029602114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls") pod "image-registry-7cc9cc4c87-kfccg" (UID: "0c4b0ad6-e876-4580-841c-91a36f53a0f8") : secret "image-registry-tls" not found Jul 29 18:34:44.189854 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.189750 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0c4b0ad6-e876-4580-841c-91a36f53a0f8-ca-trust-extracted\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:34:44.190359 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.190335 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0c4b0ad6-e876-4580-841c-91a36f53a0f8-trusted-ca\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:34:44.194260 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.194238 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0c4b0ad6-e876-4580-841c-91a36f53a0f8-installation-pull-secrets\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:34:44.194351 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.194265 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0c4b0ad6-e876-4580-841c-91a36f53a0f8-image-registry-private-configuration\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:34:44.207115 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.207069 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rn4v\" (UniqueName: \"kubernetes.io/projected/f8172992-b0a4-4052-8f49-cea2640071ec-kube-api-access-6rn4v\") pod \"network-check-source-7d88cb55d8-kl2tw\" (UID: \"f8172992-b0a4-4052-8f49-cea2640071ec\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kl2tw" Jul 29 18:34:44.207682 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.207656 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-bound-sa-token\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:34:44.209195 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.209172 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28c92\" (UniqueName: \"kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-kube-api-access-28c92\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:34:44.261578 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.261520 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:34:44.261720 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.261527 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:34:44.261789 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.261534 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:34:44.265229 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.265208 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 18:34:44.265372 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.265260 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-595vq\"" Jul 29 18:34:44.265372 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.265350 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c2rc9\"" Jul 29 18:34:44.265475 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.265454 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 18:34:44.289130 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.289094 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-config-volume\") pod \"dns-default-tj78n\" (UID: \"a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91\") " pod="openshift-dns/dns-default-tj78n" Jul 29 18:34:44.289222 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.289169 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-metrics-tls\") pod \"dns-default-tj78n\" (UID: \"a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91\") " pod="openshift-dns/dns-default-tj78n" Jul 29 18:34:44.289222 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.289198 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6574g\" (UniqueName: \"kubernetes.io/projected/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-kube-api-access-6574g\") pod \"dns-default-tj78n\" (UID: \"a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91\") " pod="openshift-dns/dns-default-tj78n" Jul 29 18:34:44.289333 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.289226 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b475136a-e94f-4558-a2c8-f1cc51174d5e-cert\") pod \"ingress-canary-wljgs\" (UID: \"b475136a-e94f-4558-a2c8-f1cc51174d5e\") " pod="openshift-ingress-canary/ingress-canary-wljgs" Jul 29 18:34:44.289333 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.289271 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5wvm\" (UniqueName: \"kubernetes.io/projected/b475136a-e94f-4558-a2c8-f1cc51174d5e-kube-api-access-v5wvm\") pod \"ingress-canary-wljgs\" (UID: \"b475136a-e94f-4558-a2c8-f1cc51174d5e\") " pod="openshift-ingress-canary/ingress-canary-wljgs" Jul 29 18:34:44.289333 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:44.289279 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 18:34:44.289333 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.289306 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-tmp-dir\") pod \"dns-default-tj78n\" (UID: \"a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91\") " pod="openshift-dns/dns-default-tj78n" Jul 29 18:34:44.289514 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:44.289341 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-metrics-tls podName:a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:44.789320854 +0000 UTC m=+36.129427590 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-metrics-tls") pod "dns-default-tj78n" (UID: "a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91") : secret "dns-default-metrics-tls" not found Jul 29 18:34:44.289607 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.289588 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-tmp-dir\") pod \"dns-default-tj78n\" (UID: \"a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91\") " pod="openshift-dns/dns-default-tj78n" Jul 29 18:34:44.289703 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.289681 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-config-volume\") pod \"dns-default-tj78n\" (UID: \"a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91\") " pod="openshift-dns/dns-default-tj78n" Jul 29 18:34:44.291957 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.291936 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b475136a-e94f-4558-a2c8-f1cc51174d5e-cert\") pod \"ingress-canary-wljgs\" (UID: \"b475136a-e94f-4558-a2c8-f1cc51174d5e\") " pod="openshift-ingress-canary/ingress-canary-wljgs" Jul 29 18:34:44.296634 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.296614 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kl2tw" Jul 29 18:34:44.302006 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.301985 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6574g\" (UniqueName: \"kubernetes.io/projected/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-kube-api-access-6574g\") pod \"dns-default-tj78n\" (UID: \"a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91\") " pod="openshift-dns/dns-default-tj78n" Jul 29 18:34:44.303149 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.303128 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5wvm\" (UniqueName: \"kubernetes.io/projected/b475136a-e94f-4558-a2c8-f1cc51174d5e-kube-api-access-v5wvm\") pod \"ingress-canary-wljgs\" (UID: \"b475136a-e94f-4558-a2c8-f1cc51174d5e\") " pod="openshift-ingress-canary/ingress-canary-wljgs" Jul 29 18:34:44.305919 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.305902 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wljgs" Jul 29 18:34:44.692888 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.692849 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b762ab1b-627c-44b0-97c5-7d948e4ef348-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-l94qg\" (UID: \"b762ab1b-627c-44b0-97c5-7d948e4ef348\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-l94qg" Jul 29 18:34:44.693065 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.692894 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:34:44.693065 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:44.693002 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 18:34:44.693065 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:44.693036 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 18:34:44.693065 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:44.693050 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cc9cc4c87-kfccg: secret "image-registry-tls" not found Jul 29 18:34:44.693264 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:44.693084 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b762ab1b-627c-44b0-97c5-7d948e4ef348-networking-console-plugin-cert podName:b762ab1b-627c-44b0-97c5-7d948e4ef348 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:45.693059777 +0000 UTC m=+37.033166513 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b762ab1b-627c-44b0-97c5-7d948e4ef348-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-l94qg" (UID: "b762ab1b-627c-44b0-97c5-7d948e4ef348") : secret "networking-console-plugin-cert" not found Jul 29 18:34:44.693264 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:44.693105 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls podName:0c4b0ad6-e876-4580-841c-91a36f53a0f8 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:45.693094467 +0000 UTC m=+37.033201194 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls") pod "image-registry-7cc9cc4c87-kfccg" (UID: "0c4b0ad6-e876-4580-841c-91a36f53a0f8") : secret "image-registry-tls" not found Jul 29 18:34:44.793571 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:44.793533 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-metrics-tls\") pod \"dns-default-tj78n\" (UID: \"a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91\") " pod="openshift-dns/dns-default-tj78n" Jul 29 18:34:44.793734 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:44.793709 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 18:34:44.793818 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:44.793793 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-metrics-tls podName:a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:45.793772032 +0000 UTC m=+37.133878757 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-metrics-tls") pod "dns-default-tj78n" (UID: "a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91") : secret "dns-default-metrics-tls" not found Jul 29 18:34:45.653784 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:45.653459 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wljgs"] Jul 29 18:34:45.654667 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:45.654645 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-kl2tw"] Jul 29 18:34:45.655818 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:45.655791 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8172992_b0a4_4052_8f49_cea2640071ec.slice/crio-6a3c284db032c8b23ef87d17c67b5a690995f03237107c5cff2d00d2cc6ccfc6 WatchSource:0}: Error finding container 6a3c284db032c8b23ef87d17c67b5a690995f03237107c5cff2d00d2cc6ccfc6: Status 404 returned error can't find the container with id 6a3c284db032c8b23ef87d17c67b5a690995f03237107c5cff2d00d2cc6ccfc6 Jul 29 18:34:45.656692 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:34:45.656666 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb475136a_e94f_4558_a2c8_f1cc51174d5e.slice/crio-124c05c1847790d79457d194f3a39656c5ce45960839f120d3c70a95593ea47d WatchSource:0}: Error finding container 124c05c1847790d79457d194f3a39656c5ce45960839f120d3c70a95593ea47d: Status 404 returned error can't find the container with id 124c05c1847790d79457d194f3a39656c5ce45960839f120d3c70a95593ea47d Jul 29 18:34:45.700695 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:45.700667 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b762ab1b-627c-44b0-97c5-7d948e4ef348-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-l94qg\" (UID: \"b762ab1b-627c-44b0-97c5-7d948e4ef348\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-l94qg" Jul 29 18:34:45.700816 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:45.700707 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:34:45.700879 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:45.700829 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 18:34:45.700879 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:45.700853 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 18:34:45.700879 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:45.700864 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cc9cc4c87-kfccg: secret "image-registry-tls" not found Jul 29 18:34:45.701010 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:45.700897 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b762ab1b-627c-44b0-97c5-7d948e4ef348-networking-console-plugin-cert podName:b762ab1b-627c-44b0-97c5-7d948e4ef348 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:47.700877327 +0000 UTC m=+39.040984065 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b762ab1b-627c-44b0-97c5-7d948e4ef348-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-l94qg" (UID: "b762ab1b-627c-44b0-97c5-7d948e4ef348") : secret "networking-console-plugin-cert" not found Jul 29 18:34:45.701010 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:45.700913 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls podName:0c4b0ad6-e876-4580-841c-91a36f53a0f8 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:47.700904466 +0000 UTC m=+39.041011197 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls") pod "image-registry-7cc9cc4c87-kfccg" (UID: "0c4b0ad6-e876-4580-841c-91a36f53a0f8") : secret "image-registry-tls" not found Jul 29 18:34:45.801837 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:45.801808 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-metrics-tls\") pod \"dns-default-tj78n\" (UID: \"a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91\") " pod="openshift-dns/dns-default-tj78n" Jul 29 18:34:45.801974 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:45.801956 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 18:34:45.802025 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:45.802020 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-metrics-tls podName:a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:47.802003046 +0000 UTC m=+39.142109770 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-metrics-tls") pod "dns-default-tj78n" (UID: "a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91") : secret "dns-default-metrics-tls" not found Jul 29 18:34:46.573863 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:46.573696 2560 generic.go:356] "Generic (PLEG): container finished" podID="621948c8-2ee5-4e82-b91b-b316e662af37" containerID="7337a461aeed6f9d3567b0619a3447f5a1642df764f3f0cbd9a06a0589e3a31d" exitCode=0 Jul 29 18:34:46.573863 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:46.573766 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8qxk" event={"ID":"621948c8-2ee5-4e82-b91b-b316e662af37","Type":"ContainerDied","Data":"7337a461aeed6f9d3567b0619a3447f5a1642df764f3f0cbd9a06a0589e3a31d"} Jul 29 18:34:46.575805 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:46.575730 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wljgs" event={"ID":"b475136a-e94f-4558-a2c8-f1cc51174d5e","Type":"ContainerStarted","Data":"124c05c1847790d79457d194f3a39656c5ce45960839f120d3c70a95593ea47d"} Jul 29 18:34:46.577189 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:46.577110 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kl2tw" event={"ID":"f8172992-b0a4-4052-8f49-cea2640071ec","Type":"ContainerStarted","Data":"6a3c284db032c8b23ef87d17c67b5a690995f03237107c5cff2d00d2cc6ccfc6"} Jul 29 18:34:47.583506 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:47.583464 2560 generic.go:356] "Generic (PLEG): container finished" podID="621948c8-2ee5-4e82-b91b-b316e662af37" containerID="e0779015725d2fee7d4c702e4a79415353cc6b385343bd84884943cfe434d95a" exitCode=0 Jul 29 18:34:47.583966 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:47.583508 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8qxk" event={"ID":"621948c8-2ee5-4e82-b91b-b316e662af37","Type":"ContainerDied","Data":"e0779015725d2fee7d4c702e4a79415353cc6b385343bd84884943cfe434d95a"} Jul 29 18:34:47.719387 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:47.719351 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b762ab1b-627c-44b0-97c5-7d948e4ef348-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-l94qg\" (UID: \"b762ab1b-627c-44b0-97c5-7d948e4ef348\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-l94qg" Jul 29 18:34:47.719387 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:47.719392 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:34:47.719648 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:47.719511 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 18:34:47.719648 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:47.719535 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 18:34:47.719648 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:47.719547 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cc9cc4c87-kfccg: secret "image-registry-tls" not found Jul 29 18:34:47.719648 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:47.719593 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b762ab1b-627c-44b0-97c5-7d948e4ef348-networking-console-plugin-cert podName:b762ab1b-627c-44b0-97c5-7d948e4ef348 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:51.719577205 +0000 UTC m=+43.059683928 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b762ab1b-627c-44b0-97c5-7d948e4ef348-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-l94qg" (UID: "b762ab1b-627c-44b0-97c5-7d948e4ef348") : secret "networking-console-plugin-cert" not found Jul 29 18:34:47.719648 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:47.719608 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls podName:0c4b0ad6-e876-4580-841c-91a36f53a0f8 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:51.719602342 +0000 UTC m=+43.059709065 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls") pod "image-registry-7cc9cc4c87-kfccg" (UID: "0c4b0ad6-e876-4580-841c-91a36f53a0f8") : secret "image-registry-tls" not found Jul 29 18:34:47.820731 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:47.820686 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-metrics-tls\") pod \"dns-default-tj78n\" (UID: \"a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91\") " pod="openshift-dns/dns-default-tj78n" Jul 29 18:34:47.820924 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:47.820850 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 18:34:47.820989 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:47.820927 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-metrics-tls podName:a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:51.820906122 +0000 UTC m=+43.161012871 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-metrics-tls") pod "dns-default-tj78n" (UID: "a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91") : secret "dns-default-metrics-tls" not found Jul 29 18:34:49.590175 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:49.590083 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wljgs" event={"ID":"b475136a-e94f-4558-a2c8-f1cc51174d5e","Type":"ContainerStarted","Data":"a1227b3e7b58a96dc2eb5e7e8a7c37c127466d75b06ab2c504d5ba2acc6680e2"} Jul 29 18:34:49.591772 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:49.591742 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kl2tw" event={"ID":"f8172992-b0a4-4052-8f49-cea2640071ec","Type":"ContainerStarted","Data":"b7dde27c84d9c1f0f9afb1b5d59fca3ea51d38191836dd1c0d13d0d692807555"} Jul 29 18:34:49.595286 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:49.595256 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8qxk" event={"ID":"621948c8-2ee5-4e82-b91b-b316e662af37","Type":"ContainerStarted","Data":"bbe3bce8c5a5fc87612bdc82b661172809d71d241bbbb5876082f967fb100134"} Jul 29 18:34:49.624165 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:49.624105 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wljgs" podStartSLOduration=2.922458452 podStartE2EDuration="6.624087254s" totalImagesPullingTime="3.701628802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:49.623573359 +0000 UTC m=+40.963680102" watchObservedRunningTime="2026-07-29 18:34:49.624087254 +0000 UTC m=+40.964193995" Jul 29 18:34:49.672605 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:49.672532 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-f8qxk" podStartSLOduration=9.593744856 podStartE2EDuration="39.672517257s" totalImagesPullingTime="30.078772401s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:49.66857964 +0000 UTC m=+41.008686385" watchObservedRunningTime="2026-07-29 18:34:49.672517257 +0000 UTC m=+41.012624002" Jul 29 18:34:49.718078 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:49.718029 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kl2tw" podStartSLOduration=33.005885372 podStartE2EDuration="36.718011766s" totalImagesPullingTime="3.712126394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:34:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:49.714294119 +0000 UTC m=+41.054400864" watchObservedRunningTime="2026-07-29 18:34:49.718011766 +0000 UTC m=+41.058118510" Jul 29 18:34:51.756911 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:51.756876 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b762ab1b-627c-44b0-97c5-7d948e4ef348-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-l94qg\" (UID: \"b762ab1b-627c-44b0-97c5-7d948e4ef348\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-l94qg" Jul 29 18:34:51.756911 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:51.756910 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:34:51.757285 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:51.757005 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 18:34:51.757285 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:51.757016 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cc9cc4c87-kfccg: secret "image-registry-tls" not found Jul 29 18:34:51.757285 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:51.757017 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 18:34:51.757285 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:51.757065 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls podName:0c4b0ad6-e876-4580-841c-91a36f53a0f8 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:59.757050298 +0000 UTC m=+51.097157022 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls") pod "image-registry-7cc9cc4c87-kfccg" (UID: "0c4b0ad6-e876-4580-841c-91a36f53a0f8") : secret "image-registry-tls" not found Jul 29 18:34:51.757285 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:51.757084 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b762ab1b-627c-44b0-97c5-7d948e4ef348-networking-console-plugin-cert podName:b762ab1b-627c-44b0-97c5-7d948e4ef348 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:59.757070249 +0000 UTC m=+51.097176972 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b762ab1b-627c-44b0-97c5-7d948e4ef348-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-l94qg" (UID: "b762ab1b-627c-44b0-97c5-7d948e4ef348") : secret "networking-console-plugin-cert" not found Jul 29 18:34:51.857660 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:51.857623 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-metrics-tls\") pod \"dns-default-tj78n\" (UID: \"a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91\") " pod="openshift-dns/dns-default-tj78n" Jul 29 18:34:51.857792 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:51.857775 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 18:34:51.857851 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:51.857841 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-metrics-tls podName:a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:59.857825263 +0000 UTC m=+51.197932009 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-metrics-tls") pod "dns-default-tj78n" (UID: "a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91") : secret "dns-default-metrics-tls" not found Jul 29 18:34:59.808208 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:59.808166 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b762ab1b-627c-44b0-97c5-7d948e4ef348-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-l94qg\" (UID: \"b762ab1b-627c-44b0-97c5-7d948e4ef348\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-l94qg" Jul 29 18:34:59.808208 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:59.808206 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:34:59.808730 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:59.808310 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 18:34:59.808730 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:59.808322 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cc9cc4c87-kfccg: secret "image-registry-tls" not found Jul 29 18:34:59.808730 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:59.808374 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls podName:0c4b0ad6-e876-4580-841c-91a36f53a0f8 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:15.808359771 +0000 UTC m=+67.148466494 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls") pod "image-registry-7cc9cc4c87-kfccg" (UID: "0c4b0ad6-e876-4580-841c-91a36f53a0f8") : secret "image-registry-tls" not found Jul 29 18:34:59.808730 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:59.808310 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 18:34:59.808730 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:59.808510 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b762ab1b-627c-44b0-97c5-7d948e4ef348-networking-console-plugin-cert podName:b762ab1b-627c-44b0-97c5-7d948e4ef348 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:15.808487487 +0000 UTC m=+67.148594226 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b762ab1b-627c-44b0-97c5-7d948e4ef348-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-l94qg" (UID: "b762ab1b-627c-44b0-97c5-7d948e4ef348") : secret "networking-console-plugin-cert" not found Jul 29 18:34:59.909088 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:34:59.908979 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-metrics-tls\") pod \"dns-default-tj78n\" (UID: \"a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91\") " pod="openshift-dns/dns-default-tj78n" Jul 29 18:34:59.909235 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:59.909064 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 18:34:59.909235 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:34:59.909216 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-metrics-tls podName:a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:15.909197201 +0000 UTC m=+67.249303924 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-metrics-tls") pod "dns-default-tj78n" (UID: "a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91") : secret "dns-default-metrics-tls" not found Jul 29 18:35:11.151245 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:35:11.151216 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nldtg" Jul 29 18:35:14.923153 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:35:14.923098 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eae5d913-e185-42ae-9bf9-beabffd3d865-original-pull-secret\") pod \"global-pull-secret-syncer-txtcd\" (UID: \"eae5d913-e185-42ae-9bf9-beabffd3d865\") " pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:35:14.923641 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:35:14.923169 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs\") pod \"network-metrics-daemon-94h2v\" (UID: \"1e43e1c7-433e-4559-8fa2-2c818770dc36\") " pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:35:14.926116 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:35:14.926093 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 18:35:14.926230 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:35:14.926094 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 18:35:14.933963 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:35:14.933941 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 29 18:35:14.934024 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:35:14.934013 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs podName:1e43e1c7-433e-4559-8fa2-2c818770dc36 nodeName:}" failed. No retries permitted until 2026-07-29 18:36:18.933991699 +0000 UTC m=+130.274098439 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs") pod "network-metrics-daemon-94h2v" (UID: "1e43e1c7-433e-4559-8fa2-2c818770dc36") : secret "metrics-daemon-secret" not found Jul 29 18:35:14.937092 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:35:14.937072 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eae5d913-e185-42ae-9bf9-beabffd3d865-original-pull-secret\") pod \"global-pull-secret-syncer-txtcd\" (UID: \"eae5d913-e185-42ae-9bf9-beabffd3d865\") " pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:35:15.023637 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:35:15.023600 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdk8f\" (UniqueName: \"kubernetes.io/projected/0bd004cf-695f-4759-ad1a-daa6563fbc3a-kube-api-access-fdk8f\") pod \"network-check-target-rsmkr\" (UID: \"0bd004cf-695f-4759-ad1a-daa6563fbc3a\") " pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:35:15.025871 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:35:15.025852 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdk8f\" (UniqueName: \"kubernetes.io/projected/0bd004cf-695f-4759-ad1a-daa6563fbc3a-kube-api-access-fdk8f\") pod \"network-check-target-rsmkr\" (UID: \"0bd004cf-695f-4759-ad1a-daa6563fbc3a\") " pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:35:15.175865 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:35:15.175788 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-595vq\"" Jul 29 18:35:15.181024 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:35:15.181008 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-txtcd" Jul 29 18:35:15.183133 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:35:15.183116 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:35:15.311790 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:35:15.311760 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-txtcd"] Jul 29 18:35:15.314951 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:35:15.314927 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeae5d913_e185_42ae_9bf9_beabffd3d865.slice/crio-efa2f7f0d3be3bf55e10181f8e43c844c604908d19d085909e2dee184fd0c526 WatchSource:0}: Error finding container efa2f7f0d3be3bf55e10181f8e43c844c604908d19d085909e2dee184fd0c526: Status 404 returned error can't find the container with id efa2f7f0d3be3bf55e10181f8e43c844c604908d19d085909e2dee184fd0c526 Jul 29 18:35:15.329917 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:35:15.329889 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rsmkr"] Jul 29 18:35:15.332215 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:35:15.332192 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bd004cf_695f_4759_ad1a_daa6563fbc3a.slice/crio-7f81b2081d560f2b44d123cd8e5a7319000906e8b557c65547ef2732e60c7607 WatchSource:0}: Error finding container 7f81b2081d560f2b44d123cd8e5a7319000906e8b557c65547ef2732e60c7607: Status 404 returned error can't find the container with id 7f81b2081d560f2b44d123cd8e5a7319000906e8b557c65547ef2732e60c7607 Jul 29 18:35:15.658460 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:35:15.658427 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rsmkr" event={"ID":"0bd004cf-695f-4759-ad1a-daa6563fbc3a","Type":"ContainerStarted","Data":"ed70a1d3805e0b3ed98f50dcc49d4d35b498a5dd2e5e20409298c0f0e9077a55"} Jul 29 18:35:15.658673 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:35:15.658482 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rsmkr" event={"ID":"0bd004cf-695f-4759-ad1a-daa6563fbc3a","Type":"ContainerStarted","Data":"7f81b2081d560f2b44d123cd8e5a7319000906e8b557c65547ef2732e60c7607"} Jul 29 18:35:15.658673 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:35:15.658511 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:35:15.659406 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:35:15.659385 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-txtcd" event={"ID":"eae5d913-e185-42ae-9bf9-beabffd3d865","Type":"ContainerStarted","Data":"efa2f7f0d3be3bf55e10181f8e43c844c604908d19d085909e2dee184fd0c526"} Jul 29 18:35:15.830185 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:35:15.830144 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b762ab1b-627c-44b0-97c5-7d948e4ef348-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-l94qg\" (UID: \"b762ab1b-627c-44b0-97c5-7d948e4ef348\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-l94qg" Jul 29 18:35:15.830185 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:35:15.830185 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:35:15.830422 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:35:15.830301 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 18:35:15.830422 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:35:15.830327 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 18:35:15.830422 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:35:15.830342 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cc9cc4c87-kfccg: secret "image-registry-tls" not found Jul 29 18:35:15.830422 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:35:15.830369 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b762ab1b-627c-44b0-97c5-7d948e4ef348-networking-console-plugin-cert podName:b762ab1b-627c-44b0-97c5-7d948e4ef348 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:47.830352295 +0000 UTC m=+99.170459025 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b762ab1b-627c-44b0-97c5-7d948e4ef348-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-l94qg" (UID: "b762ab1b-627c-44b0-97c5-7d948e4ef348") : secret "networking-console-plugin-cert" not found Jul 29 18:35:15.830422 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:35:15.830399 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls podName:0c4b0ad6-e876-4580-841c-91a36f53a0f8 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:47.830382424 +0000 UTC m=+99.170489163 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls") pod "image-registry-7cc9cc4c87-kfccg" (UID: "0c4b0ad6-e876-4580-841c-91a36f53a0f8") : secret "image-registry-tls" not found Jul 29 18:35:15.930894 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:35:15.930823 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-metrics-tls\") pod \"dns-default-tj78n\" (UID: \"a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91\") " pod="openshift-dns/dns-default-tj78n" Jul 29 18:35:15.931247 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:35:15.930940 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 18:35:15.931247 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:35:15.930994 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-metrics-tls podName:a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:47.930979528 +0000 UTC m=+99.271086251 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-metrics-tls") pod "dns-default-tj78n" (UID: "a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91") : secret "dns-default-metrics-tls" not found Jul 29 18:35:20.672672 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:35:20.672633 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-txtcd" event={"ID":"eae5d913-e185-42ae-9bf9-beabffd3d865","Type":"ContainerStarted","Data":"0b3d2f2bee6c0f746343a117e72ad053f1428b8aac392124700e7f1ea11b8889"} Jul 29 18:35:20.687481 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:35:20.687431 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rsmkr" podStartSLOduration=70.687413294 podStartE2EDuration="1m10.687413294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:34:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:35:15.674016054 +0000 UTC m=+67.014122798" watchObservedRunningTime="2026-07-29 18:35:20.687413294 +0000 UTC m=+72.027520039" Jul 29 18:35:20.688726 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:35:20.688679 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-txtcd" podStartSLOduration=65.901234747 podStartE2EDuration="1m10.688662566s" totalImagesPullingTime="4.787427819s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:35:20.687216589 +0000 UTC m=+72.027323334" watchObservedRunningTime="2026-07-29 18:35:20.688662566 +0000 UTC m=+72.028769314" Jul 29 18:35:46.663781 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:35:46.663681 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rsmkr" Jul 29 18:35:47.869005 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:35:47.868963 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b762ab1b-627c-44b0-97c5-7d948e4ef348-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-l94qg\" (UID: \"b762ab1b-627c-44b0-97c5-7d948e4ef348\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-l94qg" Jul 29 18:35:47.869005 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:35:47.869001 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:35:47.869425 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:35:47.869093 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 18:35:47.869425 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:35:47.869104 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cc9cc4c87-kfccg: secret "image-registry-tls" not found Jul 29 18:35:47.869425 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:35:47.869115 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 18:35:47.869425 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:35:47.869154 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls podName:0c4b0ad6-e876-4580-841c-91a36f53a0f8 nodeName:}" failed. No retries permitted until 2026-07-29 18:36:51.869140415 +0000 UTC m=+163.209247139 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls") pod "image-registry-7cc9cc4c87-kfccg" (UID: "0c4b0ad6-e876-4580-841c-91a36f53a0f8") : secret "image-registry-tls" not found Jul 29 18:35:47.869425 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:35:47.869175 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b762ab1b-627c-44b0-97c5-7d948e4ef348-networking-console-plugin-cert podName:b762ab1b-627c-44b0-97c5-7d948e4ef348 nodeName:}" failed. No retries permitted until 2026-07-29 18:36:51.869160987 +0000 UTC m=+163.209267710 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b762ab1b-627c-44b0-97c5-7d948e4ef348-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-l94qg" (UID: "b762ab1b-627c-44b0-97c5-7d948e4ef348") : secret "networking-console-plugin-cert" not found Jul 29 18:35:47.969725 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:35:47.969687 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-metrics-tls\") pod \"dns-default-tj78n\" (UID: \"a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91\") " pod="openshift-dns/dns-default-tj78n" Jul 29 18:35:47.969887 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:35:47.969839 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 18:35:47.969929 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:35:47.969899 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-metrics-tls podName:a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91 nodeName:}" failed. No retries permitted until 2026-07-29 18:36:51.969885231 +0000 UTC m=+163.309991954 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-metrics-tls") pod "dns-default-tj78n" (UID: "a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91") : secret "dns-default-metrics-tls" not found Jul 29 18:36:18.983144 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:36:18.983098 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs\") pod \"network-metrics-daemon-94h2v\" (UID: \"1e43e1c7-433e-4559-8fa2-2c818770dc36\") " pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:36:18.983642 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:36:18.983254 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 29 18:36:18.983642 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:36:18.983329 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs podName:1e43e1c7-433e-4559-8fa2-2c818770dc36 nodeName:}" failed. No retries permitted until 2026-07-29 18:38:20.983312742 +0000 UTC m=+252.323419465 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs") pod "network-metrics-daemon-94h2v" (UID: "1e43e1c7-433e-4559-8fa2-2c818770dc36") : secret "metrics-daemon-secret" not found Jul 29 18:36:46.983207 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:36:46.983153 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-l94qg" podUID="b762ab1b-627c-44b0-97c5-7d948e4ef348" Jul 29 18:36:46.989442 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:36:46.989422 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" podUID="0c4b0ad6-e876-4580-841c-91a36f53a0f8" Jul 29 18:36:47.012632 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:36:47.012601 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-tj78n" podUID="a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91" Jul 29 18:36:47.286243 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:36:47.286148 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-94h2v" podUID="1e43e1c7-433e-4559-8fa2-2c818770dc36" Jul 29 18:36:47.882647 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:36:47.882619 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tj78n" Jul 29 18:36:47.882805 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:36:47.882619 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-l94qg" Jul 29 18:36:47.882805 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:36:47.882626 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:36:51.908023 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:36:51.907994 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b762ab1b-627c-44b0-97c5-7d948e4ef348-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-l94qg\" (UID: \"b762ab1b-627c-44b0-97c5-7d948e4ef348\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-l94qg" Jul 29 18:36:51.908471 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:36:51.908028 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:36:51.908471 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:36:51.908137 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 18:36:51.908471 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:36:51.908137 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 18:36:51.908471 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:36:51.908194 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b762ab1b-627c-44b0-97c5-7d948e4ef348-networking-console-plugin-cert podName:b762ab1b-627c-44b0-97c5-7d948e4ef348 nodeName:}" failed. No retries permitted until 2026-07-29 18:38:53.908178539 +0000 UTC m=+285.248285265 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b762ab1b-627c-44b0-97c5-7d948e4ef348-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-l94qg" (UID: "b762ab1b-627c-44b0-97c5-7d948e4ef348") : secret "networking-console-plugin-cert" not found Jul 29 18:36:51.908471 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:36:51.908148 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cc9cc4c87-kfccg: secret "image-registry-tls" not found Jul 29 18:36:51.908471 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:36:51.908227 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls podName:0c4b0ad6-e876-4580-841c-91a36f53a0f8 nodeName:}" failed. No retries permitted until 2026-07-29 18:38:53.908220173 +0000 UTC m=+285.248326896 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls") pod "image-registry-7cc9cc4c87-kfccg" (UID: "0c4b0ad6-e876-4580-841c-91a36f53a0f8") : secret "image-registry-tls" not found Jul 29 18:36:52.009385 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:36:52.009345 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-metrics-tls\") pod \"dns-default-tj78n\" (UID: \"a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91\") " pod="openshift-dns/dns-default-tj78n" Jul 29 18:36:52.009580 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:36:52.009487 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 18:36:52.009580 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:36:52.009544 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-metrics-tls podName:a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91 nodeName:}" failed. No retries permitted until 2026-07-29 18:38:54.009526591 +0000 UTC m=+285.349633318 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-metrics-tls") pod "dns-default-tj78n" (UID: "a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91") : secret "dns-default-metrics-tls" not found Jul 29 18:37:02.261591 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:37:02.261481 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:38:21.006088 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:21.006032 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs\") pod \"network-metrics-daemon-94h2v\" (UID: \"1e43e1c7-433e-4559-8fa2-2c818770dc36\") " pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:38:21.006581 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:21.006157 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 29 18:38:21.006581 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:21.006227 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs podName:1e43e1c7-433e-4559-8fa2-2c818770dc36 nodeName:}" failed. No retries permitted until 2026-07-29 18:40:23.006212494 +0000 UTC m=+374.346319217 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs") pod "network-metrics-daemon-94h2v" (UID: "1e43e1c7-433e-4559-8fa2-2c818770dc36") : secret "metrics-daemon-secret" not found Jul 29 18:38:37.922140 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:37.922048 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5dgjv"] Jul 29 18:38:37.923975 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:37.923952 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xgr5t"] Jul 29 18:38:37.924171 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:37.924083 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5dgjv" Jul 29 18:38:37.926226 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:37.926205 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-j2jv8"] Jul 29 18:38:37.926355 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:37.926332 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xgr5t" Jul 29 18:38:37.927401 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:37.927380 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 29 18:38:37.927629 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:37.927613 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 29 18:38:37.927684 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:37.927613 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mljjc\"" Jul 29 18:38:37.927729 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:37.927716 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 29 18:38:37.927906 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:37.927889 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-lbf7x"] Jul 29 18:38:37.928000 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:37.927988 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-j2jv8" Jul 29 18:38:37.928909 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:37.928892 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 29 18:38:37.929004 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:37.928927 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 29 18:38:37.929707 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:37.929692 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lbf7x" Jul 29 18:38:37.929811 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:37.929794 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 29 18:38:37.929882 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:37.929865 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 29 18:38:37.930391 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:37.930366 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 29 18:38:37.931268 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:37.931006 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-xl5jv\"" Jul 29 18:38:37.931268 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:37.931038 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 29 18:38:37.931645 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:37.931630 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-76866\"" Jul 29 18:38:37.933011 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:37.932996 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-dqvf7\"" Jul 29 18:38:37.933082 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:37.932996 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 29 18:38:37.934288 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:37.934269 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 29 18:38:37.934288 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:37.934285 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 29 18:38:37.934415 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:37.934285 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 29 18:38:37.955930 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:37.955905 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5dgjv"] Jul 29 18:38:37.957307 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:37.957287 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xgr5t"] Jul 29 18:38:37.962691 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:37.962670 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-j2jv8"] Jul 29 18:38:37.973712 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:37.973682 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-lbf7x"] Jul 29 18:38:38.026866 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:38.026834 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e63b8244-092b-4e01-b975-3fde603facf0-serving-cert\") pod \"service-ca-operator-5d6c75f84f-xgr5t\" (UID: \"e63b8244-092b-4e01-b975-3fde603facf0\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xgr5t" Jul 29 18:38:38.026866 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:38.026868 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e63b8244-092b-4e01-b975-3fde603facf0-config\") pod \"service-ca-operator-5d6c75f84f-xgr5t\" (UID: \"e63b8244-092b-4e01-b975-3fde603facf0\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xgr5t" Jul 29 18:38:38.027094 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:38.026889 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs8vp\" (UniqueName: \"kubernetes.io/projected/5a486c64-b769-4520-964d-770b838d4d89-kube-api-access-cs8vp\") pod \"cluster-samples-operator-6748489656-5dgjv\" (UID: \"5a486c64-b769-4520-964d-770b838d4d89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5dgjv" Jul 29 18:38:38.027094 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:38.026943 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/171dbb04-212f-4c71-a0df-fb56fff86589-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-lbf7x\" (UID: \"171dbb04-212f-4c71-a0df-fb56fff86589\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lbf7x" Jul 29 18:38:38.027094 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:38.027028 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a486c64-b769-4520-964d-770b838d4d89-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5dgjv\" (UID: \"5a486c64-b769-4520-964d-770b838d4d89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5dgjv" Jul 29 18:38:38.027094 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:38.027048 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/171dbb04-212f-4c71-a0df-fb56fff86589-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-lbf7x\" (UID: \"171dbb04-212f-4c71-a0df-fb56fff86589\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lbf7x" Jul 29 18:38:38.027094 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:38.027067 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnv7s\" (UniqueName: \"kubernetes.io/projected/e63b8244-092b-4e01-b975-3fde603facf0-kube-api-access-jnv7s\") pod \"service-ca-operator-5d6c75f84f-xgr5t\" (UID: \"e63b8244-092b-4e01-b975-3fde603facf0\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xgr5t" Jul 29 18:38:38.027094 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:38.027083 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz2xm\" (UniqueName: \"kubernetes.io/projected/171dbb04-212f-4c71-a0df-fb56fff86589-kube-api-access-bz2xm\") pod \"cluster-monitoring-operator-548b489cb8-lbf7x\" (UID: \"171dbb04-212f-4c71-a0df-fb56fff86589\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lbf7x" Jul 29 18:38:38.027405 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:38.027102 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwggl\" (UniqueName: \"kubernetes.io/projected/f090f40b-71fd-4bda-adbb-84233acde634-kube-api-access-kwggl\") pod \"volume-data-source-validator-549c6d54cf-j2jv8\" (UID: \"f090f40b-71fd-4bda-adbb-84233acde634\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-j2jv8" Jul 29 18:38:38.128498 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:38.128458 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/171dbb04-212f-4c71-a0df-fb56fff86589-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-lbf7x\" (UID: \"171dbb04-212f-4c71-a0df-fb56fff86589\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lbf7x" Jul 29 18:38:38.128698 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:38.128513 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a486c64-b769-4520-964d-770b838d4d89-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5dgjv\" (UID: \"5a486c64-b769-4520-964d-770b838d4d89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5dgjv" Jul 29 18:38:38.128698 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:38.128536 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/171dbb04-212f-4c71-a0df-fb56fff86589-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-lbf7x\" (UID: \"171dbb04-212f-4c71-a0df-fb56fff86589\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lbf7x" Jul 29 18:38:38.128698 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:38.128629 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 18:38:38.128698 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:38.128653 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 18:38:38.128698 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:38.128685 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnv7s\" (UniqueName: \"kubernetes.io/projected/e63b8244-092b-4e01-b975-3fde603facf0-kube-api-access-jnv7s\") pod \"service-ca-operator-5d6c75f84f-xgr5t\" (UID: \"e63b8244-092b-4e01-b975-3fde603facf0\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xgr5t" Jul 29 18:38:38.128698 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:38.128702 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/171dbb04-212f-4c71-a0df-fb56fff86589-cluster-monitoring-operator-tls podName:171dbb04-212f-4c71-a0df-fb56fff86589 nodeName:}" failed. No retries permitted until 2026-07-29 18:38:38.628686541 +0000 UTC m=+269.968793265 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/171dbb04-212f-4c71-a0df-fb56fff86589-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-lbf7x" (UID: "171dbb04-212f-4c71-a0df-fb56fff86589") : secret "cluster-monitoring-operator-tls" not found Jul 29 18:38:38.129016 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:38.128726 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a486c64-b769-4520-964d-770b838d4d89-samples-operator-tls podName:5a486c64-b769-4520-964d-770b838d4d89 nodeName:}" failed. No retries permitted until 2026-07-29 18:38:38.628719933 +0000 UTC m=+269.968826656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5a486c64-b769-4520-964d-770b838d4d89-samples-operator-tls") pod "cluster-samples-operator-6748489656-5dgjv" (UID: "5a486c64-b769-4520-964d-770b838d4d89") : secret "samples-operator-tls" not found Jul 29 18:38:38.129016 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:38.128743 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz2xm\" (UniqueName: \"kubernetes.io/projected/171dbb04-212f-4c71-a0df-fb56fff86589-kube-api-access-bz2xm\") pod \"cluster-monitoring-operator-548b489cb8-lbf7x\" (UID: \"171dbb04-212f-4c71-a0df-fb56fff86589\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lbf7x" Jul 29 18:38:38.129016 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:38.128766 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwggl\" (UniqueName: \"kubernetes.io/projected/f090f40b-71fd-4bda-adbb-84233acde634-kube-api-access-kwggl\") pod \"volume-data-source-validator-549c6d54cf-j2jv8\" (UID: \"f090f40b-71fd-4bda-adbb-84233acde634\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-j2jv8" Jul 29 18:38:38.129016 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:38.128854 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e63b8244-092b-4e01-b975-3fde603facf0-serving-cert\") pod \"service-ca-operator-5d6c75f84f-xgr5t\" (UID: \"e63b8244-092b-4e01-b975-3fde603facf0\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xgr5t" Jul 29 18:38:38.129016 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:38.128877 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e63b8244-092b-4e01-b975-3fde603facf0-config\") pod \"service-ca-operator-5d6c75f84f-xgr5t\" (UID: \"e63b8244-092b-4e01-b975-3fde603facf0\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xgr5t" Jul 29 18:38:38.129016 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:38.128903 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs8vp\" (UniqueName: \"kubernetes.io/projected/5a486c64-b769-4520-964d-770b838d4d89-kube-api-access-cs8vp\") pod \"cluster-samples-operator-6748489656-5dgjv\" (UID: \"5a486c64-b769-4520-964d-770b838d4d89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5dgjv" Jul 29 18:38:38.129333 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:38.129314 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/171dbb04-212f-4c71-a0df-fb56fff86589-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-lbf7x\" (UID: \"171dbb04-212f-4c71-a0df-fb56fff86589\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lbf7x" Jul 29 18:38:38.129400 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:38.129386 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e63b8244-092b-4e01-b975-3fde603facf0-config\") pod \"service-ca-operator-5d6c75f84f-xgr5t\" (UID: \"e63b8244-092b-4e01-b975-3fde603facf0\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xgr5t" Jul 29 18:38:38.131199 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:38.131182 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e63b8244-092b-4e01-b975-3fde603facf0-serving-cert\") pod \"service-ca-operator-5d6c75f84f-xgr5t\" (UID: \"e63b8244-092b-4e01-b975-3fde603facf0\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xgr5t" Jul 29 18:38:38.138969 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:38.138938 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs8vp\" (UniqueName: \"kubernetes.io/projected/5a486c64-b769-4520-964d-770b838d4d89-kube-api-access-cs8vp\") pod \"cluster-samples-operator-6748489656-5dgjv\" (UID: \"5a486c64-b769-4520-964d-770b838d4d89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5dgjv" Jul 29 18:38:38.140369 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:38.140347 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz2xm\" (UniqueName: \"kubernetes.io/projected/171dbb04-212f-4c71-a0df-fb56fff86589-kube-api-access-bz2xm\") pod \"cluster-monitoring-operator-548b489cb8-lbf7x\" (UID: \"171dbb04-212f-4c71-a0df-fb56fff86589\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lbf7x" Jul 29 18:38:38.142168 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:38.142141 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwggl\" (UniqueName: \"kubernetes.io/projected/f090f40b-71fd-4bda-adbb-84233acde634-kube-api-access-kwggl\") pod \"volume-data-source-validator-549c6d54cf-j2jv8\" (UID: \"f090f40b-71fd-4bda-adbb-84233acde634\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-j2jv8" Jul 29 18:38:38.142260 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:38.142222 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnv7s\" (UniqueName: \"kubernetes.io/projected/e63b8244-092b-4e01-b975-3fde603facf0-kube-api-access-jnv7s\") pod \"service-ca-operator-5d6c75f84f-xgr5t\" (UID: \"e63b8244-092b-4e01-b975-3fde603facf0\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xgr5t" Jul 29 18:38:38.240547 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:38.240500 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-j2jv8" Jul 29 18:38:38.246373 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:38.246351 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xgr5t" Jul 29 18:38:38.375575 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:38.375525 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-j2jv8"] Jul 29 18:38:38.379721 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:38:38.379675 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf090f40b_71fd_4bda_adbb_84233acde634.slice/crio-5e6b66a16f6eea8189ed80bd5fbbbe8da368d95a41284d465062012e70dd6785 WatchSource:0}: Error finding container 5e6b66a16f6eea8189ed80bd5fbbbe8da368d95a41284d465062012e70dd6785: Status 404 returned error can't find the container with id 5e6b66a16f6eea8189ed80bd5fbbbe8da368d95a41284d465062012e70dd6785 Jul 29 18:38:38.392317 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:38.392291 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xgr5t"] Jul 29 18:38:38.395778 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:38:38.395754 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode63b8244_092b_4e01_b975_3fde603facf0.slice/crio-91478dc69bf969cd29ab2049af25bab533c01537c19bf11f77eb20fb8fe76a6d WatchSource:0}: Error finding container 91478dc69bf969cd29ab2049af25bab533c01537c19bf11f77eb20fb8fe76a6d: Status 404 returned error can't find the container with id 91478dc69bf969cd29ab2049af25bab533c01537c19bf11f77eb20fb8fe76a6d Jul 29 18:38:38.632528 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:38.632440 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/171dbb04-212f-4c71-a0df-fb56fff86589-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-lbf7x\" (UID: \"171dbb04-212f-4c71-a0df-fb56fff86589\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lbf7x" Jul 29 18:38:38.632528 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:38.632499 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a486c64-b769-4520-964d-770b838d4d89-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5dgjv\" (UID: \"5a486c64-b769-4520-964d-770b838d4d89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5dgjv" Jul 29 18:38:38.632731 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:38.632607 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 18:38:38.632731 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:38.632610 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 18:38:38.632731 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:38.632669 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a486c64-b769-4520-964d-770b838d4d89-samples-operator-tls podName:5a486c64-b769-4520-964d-770b838d4d89 nodeName:}" failed. No retries permitted until 2026-07-29 18:38:39.632646429 +0000 UTC m=+270.972753152 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5a486c64-b769-4520-964d-770b838d4d89-samples-operator-tls") pod "cluster-samples-operator-6748489656-5dgjv" (UID: "5a486c64-b769-4520-964d-770b838d4d89") : secret "samples-operator-tls" not found Jul 29 18:38:38.632731 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:38.632682 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/171dbb04-212f-4c71-a0df-fb56fff86589-cluster-monitoring-operator-tls podName:171dbb04-212f-4c71-a0df-fb56fff86589 nodeName:}" failed. No retries permitted until 2026-07-29 18:38:39.632676046 +0000 UTC m=+270.972782768 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/171dbb04-212f-4c71-a0df-fb56fff86589-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-lbf7x" (UID: "171dbb04-212f-4c71-a0df-fb56fff86589") : secret "cluster-monitoring-operator-tls" not found Jul 29 18:38:39.151223 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:39.151166 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xgr5t" event={"ID":"e63b8244-092b-4e01-b975-3fde603facf0","Type":"ContainerStarted","Data":"91478dc69bf969cd29ab2049af25bab533c01537c19bf11f77eb20fb8fe76a6d"} Jul 29 18:38:39.152568 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:39.152520 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-j2jv8" event={"ID":"f090f40b-71fd-4bda-adbb-84233acde634","Type":"ContainerStarted","Data":"5e6b66a16f6eea8189ed80bd5fbbbe8da368d95a41284d465062012e70dd6785"} Jul 29 18:38:39.641275 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:39.641243 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/171dbb04-212f-4c71-a0df-fb56fff86589-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-lbf7x\" (UID: \"171dbb04-212f-4c71-a0df-fb56fff86589\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lbf7x" Jul 29 18:38:39.641440 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:39.641298 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a486c64-b769-4520-964d-770b838d4d89-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5dgjv\" (UID: \"5a486c64-b769-4520-964d-770b838d4d89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5dgjv" Jul 29 18:38:39.641440 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:39.641390 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 18:38:39.641440 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:39.641419 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 18:38:39.641630 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:39.641480 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/171dbb04-212f-4c71-a0df-fb56fff86589-cluster-monitoring-operator-tls podName:171dbb04-212f-4c71-a0df-fb56fff86589 nodeName:}" failed. No retries permitted until 2026-07-29 18:38:41.641458742 +0000 UTC m=+272.981565465 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/171dbb04-212f-4c71-a0df-fb56fff86589-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-lbf7x" (UID: "171dbb04-212f-4c71-a0df-fb56fff86589") : secret "cluster-monitoring-operator-tls" not found Jul 29 18:38:39.641630 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:39.641498 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a486c64-b769-4520-964d-770b838d4d89-samples-operator-tls podName:5a486c64-b769-4520-964d-770b838d4d89 nodeName:}" failed. No retries permitted until 2026-07-29 18:38:41.641492334 +0000 UTC m=+272.981599057 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5a486c64-b769-4520-964d-770b838d4d89-samples-operator-tls") pod "cluster-samples-operator-6748489656-5dgjv" (UID: "5a486c64-b769-4520-964d-770b838d4d89") : secret "samples-operator-tls" not found Jul 29 18:38:40.156716 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:40.156657 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-j2jv8" event={"ID":"f090f40b-71fd-4bda-adbb-84233acde634","Type":"ContainerStarted","Data":"183aabffd580622f780fe4ac258364fa3a20d2b5e3c4e2d707d057ec56d8aae1"} Jul 29 18:38:40.172977 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:40.172918 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-j2jv8" podStartSLOduration=1.981199722 podStartE2EDuration="3.172895865s" totalImagesPullingTime="1.191696143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:38:40.172009211 +0000 UTC m=+271.512115957" watchObservedRunningTime="2026-07-29 18:38:40.172895865 +0000 UTC m=+271.513002610" Jul 29 18:38:41.160961 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:41.160919 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xgr5t" event={"ID":"e63b8244-092b-4e01-b975-3fde603facf0","Type":"ContainerStarted","Data":"7fcf55bebe919881447242b2e742a13af04bf5182725f61955b8c55a623a3406"} Jul 29 18:38:41.176847 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:41.176791 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xgr5t" podStartSLOduration=2.1365771159999998 podStartE2EDuration="4.176772789s" totalImagesPullingTime="2.040195673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:38:41.175850426 +0000 UTC m=+272.515957196" watchObservedRunningTime="2026-07-29 18:38:41.176772789 +0000 UTC m=+272.516879534" Jul 29 18:38:41.660771 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:41.660737 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/171dbb04-212f-4c71-a0df-fb56fff86589-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-lbf7x\" (UID: \"171dbb04-212f-4c71-a0df-fb56fff86589\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lbf7x" Jul 29 18:38:41.660771 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:41.660781 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a486c64-b769-4520-964d-770b838d4d89-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5dgjv\" (UID: \"5a486c64-b769-4520-964d-770b838d4d89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5dgjv" Jul 29 18:38:41.660997 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:41.660874 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 18:38:41.660997 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:41.660881 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 18:38:41.660997 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:41.660927 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a486c64-b769-4520-964d-770b838d4d89-samples-operator-tls podName:5a486c64-b769-4520-964d-770b838d4d89 nodeName:}" failed. No retries permitted until 2026-07-29 18:38:45.660912992 +0000 UTC m=+277.001019716 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5a486c64-b769-4520-964d-770b838d4d89-samples-operator-tls") pod "cluster-samples-operator-6748489656-5dgjv" (UID: "5a486c64-b769-4520-964d-770b838d4d89") : secret "samples-operator-tls" not found Jul 29 18:38:41.660997 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:41.660942 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/171dbb04-212f-4c71-a0df-fb56fff86589-cluster-monitoring-operator-tls podName:171dbb04-212f-4c71-a0df-fb56fff86589 nodeName:}" failed. No retries permitted until 2026-07-29 18:38:45.660935879 +0000 UTC m=+277.001042601 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/171dbb04-212f-4c71-a0df-fb56fff86589-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-lbf7x" (UID: "171dbb04-212f-4c71-a0df-fb56fff86589") : secret "cluster-monitoring-operator-tls" not found Jul 29 18:38:43.107153 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.107119 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2kk8l"] Jul 29 18:38:43.109361 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.109345 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2kk8l" Jul 29 18:38:43.117906 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.117884 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 29 18:38:43.119083 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.119063 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 29 18:38:43.119172 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.119063 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qwk2w\"" Jul 29 18:38:43.119172 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.119104 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 29 18:38:43.119493 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.119479 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 29 18:38:43.142777 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.142747 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2kk8l"] Jul 29 18:38:43.172844 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.172810 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dcd6b859-e31a-41e2-8de4-a8168822f2cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2kk8l\" (UID: \"dcd6b859-e31a-41e2-8de4-a8168822f2cd\") " pod="openshift-insights/insights-runtime-extractor-2kk8l" Jul 29 18:38:43.173013 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.172852 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcd6b859-e31a-41e2-8de4-a8168822f2cd-data-volume\") pod \"insights-runtime-extractor-2kk8l\" (UID: \"dcd6b859-e31a-41e2-8de4-a8168822f2cd\") " pod="openshift-insights/insights-runtime-extractor-2kk8l" Jul 29 18:38:43.173013 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.172878 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dcd6b859-e31a-41e2-8de4-a8168822f2cd-crio-socket\") pod \"insights-runtime-extractor-2kk8l\" (UID: \"dcd6b859-e31a-41e2-8de4-a8168822f2cd\") " pod="openshift-insights/insights-runtime-extractor-2kk8l" Jul 29 18:38:43.173013 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.172967 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dcd6b859-e31a-41e2-8de4-a8168822f2cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2kk8l\" (UID: \"dcd6b859-e31a-41e2-8de4-a8168822f2cd\") " pod="openshift-insights/insights-runtime-extractor-2kk8l" Jul 29 18:38:43.173013 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.173005 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnbqc\" (UniqueName: \"kubernetes.io/projected/dcd6b859-e31a-41e2-8de4-a8168822f2cd-kube-api-access-gnbqc\") pod \"insights-runtime-extractor-2kk8l\" (UID: \"dcd6b859-e31a-41e2-8de4-a8168822f2cd\") " pod="openshift-insights/insights-runtime-extractor-2kk8l" Jul 29 18:38:43.274108 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.274075 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dcd6b859-e31a-41e2-8de4-a8168822f2cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2kk8l\" (UID: \"dcd6b859-e31a-41e2-8de4-a8168822f2cd\") " pod="openshift-insights/insights-runtime-extractor-2kk8l" Jul 29 18:38:43.274108 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.274109 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcd6b859-e31a-41e2-8de4-a8168822f2cd-data-volume\") pod \"insights-runtime-extractor-2kk8l\" (UID: \"dcd6b859-e31a-41e2-8de4-a8168822f2cd\") " pod="openshift-insights/insights-runtime-extractor-2kk8l" Jul 29 18:38:43.274389 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.274137 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dcd6b859-e31a-41e2-8de4-a8168822f2cd-crio-socket\") pod \"insights-runtime-extractor-2kk8l\" (UID: \"dcd6b859-e31a-41e2-8de4-a8168822f2cd\") " pod="openshift-insights/insights-runtime-extractor-2kk8l" Jul 29 18:38:43.274389 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.274183 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dcd6b859-e31a-41e2-8de4-a8168822f2cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2kk8l\" (UID: \"dcd6b859-e31a-41e2-8de4-a8168822f2cd\") " pod="openshift-insights/insights-runtime-extractor-2kk8l" Jul 29 18:38:43.274389 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:43.274210 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 18:38:43.274389 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.274225 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnbqc\" (UniqueName: \"kubernetes.io/projected/dcd6b859-e31a-41e2-8de4-a8168822f2cd-kube-api-access-gnbqc\") pod \"insights-runtime-extractor-2kk8l\" (UID: \"dcd6b859-e31a-41e2-8de4-a8168822f2cd\") " pod="openshift-insights/insights-runtime-extractor-2kk8l" Jul 29 18:38:43.274389 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:43.274285 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dcd6b859-e31a-41e2-8de4-a8168822f2cd-kube-rbac-proxy-cm podName:dcd6b859-e31a-41e2-8de4-a8168822f2cd nodeName:}" failed. No retries permitted until 2026-07-29 18:38:43.774266006 +0000 UTC m=+275.114372746 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dcd6b859-e31a-41e2-8de4-a8168822f2cd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2kk8l" (UID: "dcd6b859-e31a-41e2-8de4-a8168822f2cd") : configmap "kube-rbac-proxy" not found Jul 29 18:38:43.274389 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.274281 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dcd6b859-e31a-41e2-8de4-a8168822f2cd-crio-socket\") pod \"insights-runtime-extractor-2kk8l\" (UID: \"dcd6b859-e31a-41e2-8de4-a8168822f2cd\") " pod="openshift-insights/insights-runtime-extractor-2kk8l" Jul 29 18:38:43.274389 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:43.274326 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 18:38:43.274389 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:43.274380 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcd6b859-e31a-41e2-8de4-a8168822f2cd-insights-runtime-extractor-tls podName:dcd6b859-e31a-41e2-8de4-a8168822f2cd nodeName:}" failed. No retries permitted until 2026-07-29 18:38:43.774365153 +0000 UTC m=+275.114471879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dcd6b859-e31a-41e2-8de4-a8168822f2cd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2kk8l" (UID: "dcd6b859-e31a-41e2-8de4-a8168822f2cd") : secret "insights-runtime-extractor-tls" not found Jul 29 18:38:43.274755 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.274484 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcd6b859-e31a-41e2-8de4-a8168822f2cd-data-volume\") pod \"insights-runtime-extractor-2kk8l\" (UID: \"dcd6b859-e31a-41e2-8de4-a8168822f2cd\") " pod="openshift-insights/insights-runtime-extractor-2kk8l" Jul 29 18:38:43.288577 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.288524 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnbqc\" (UniqueName: \"kubernetes.io/projected/dcd6b859-e31a-41e2-8de4-a8168822f2cd-kube-api-access-gnbqc\") pod \"insights-runtime-extractor-2kk8l\" (UID: \"dcd6b859-e31a-41e2-8de4-a8168822f2cd\") " pod="openshift-insights/insights-runtime-extractor-2kk8l" Jul 29 18:38:43.661291 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.661256 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-rm899"] Jul 29 18:38:43.664540 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.664519 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-rm899" Jul 29 18:38:43.667115 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.667089 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 29 18:38:43.667339 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.667324 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 29 18:38:43.667431 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.667405 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-46brw\"" Jul 29 18:38:43.667431 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.667425 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 29 18:38:43.667527 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.667466 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 29 18:38:43.671723 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.671698 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-rm899"] Jul 29 18:38:43.778063 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.778022 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxqj2\" (UniqueName: \"kubernetes.io/projected/33c71203-1b58-4320-bfb0-446d03c1de74-kube-api-access-nxqj2\") pod \"service-ca-658d7b7c78-rm899\" (UID: \"33c71203-1b58-4320-bfb0-446d03c1de74\") " pod="openshift-service-ca/service-ca-658d7b7c78-rm899" Jul 29 18:38:43.778262 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.778101 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dcd6b859-e31a-41e2-8de4-a8168822f2cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2kk8l\" (UID: \"dcd6b859-e31a-41e2-8de4-a8168822f2cd\") " pod="openshift-insights/insights-runtime-extractor-2kk8l" Jul 29 18:38:43.778262 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.778158 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dcd6b859-e31a-41e2-8de4-a8168822f2cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2kk8l\" (UID: \"dcd6b859-e31a-41e2-8de4-a8168822f2cd\") " pod="openshift-insights/insights-runtime-extractor-2kk8l" Jul 29 18:38:43.778262 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.778220 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/33c71203-1b58-4320-bfb0-446d03c1de74-signing-key\") pod \"service-ca-658d7b7c78-rm899\" (UID: \"33c71203-1b58-4320-bfb0-446d03c1de74\") " pod="openshift-service-ca/service-ca-658d7b7c78-rm899" Jul 29 18:38:43.778262 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.778242 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/33c71203-1b58-4320-bfb0-446d03c1de74-signing-cabundle\") pod \"service-ca-658d7b7c78-rm899\" (UID: \"33c71203-1b58-4320-bfb0-446d03c1de74\") " pod="openshift-service-ca/service-ca-658d7b7c78-rm899" Jul 29 18:38:43.778262 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:43.778221 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 18:38:43.778510 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:43.778306 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 18:38:43.778510 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:43.778334 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dcd6b859-e31a-41e2-8de4-a8168822f2cd-kube-rbac-proxy-cm podName:dcd6b859-e31a-41e2-8de4-a8168822f2cd nodeName:}" failed. No retries permitted until 2026-07-29 18:38:44.778313736 +0000 UTC m=+276.118420465 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dcd6b859-e31a-41e2-8de4-a8168822f2cd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2kk8l" (UID: "dcd6b859-e31a-41e2-8de4-a8168822f2cd") : configmap "kube-rbac-proxy" not found Jul 29 18:38:43.778510 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:43.778392 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcd6b859-e31a-41e2-8de4-a8168822f2cd-insights-runtime-extractor-tls podName:dcd6b859-e31a-41e2-8de4-a8168822f2cd nodeName:}" failed. No retries permitted until 2026-07-29 18:38:44.77837932 +0000 UTC m=+276.118486043 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dcd6b859-e31a-41e2-8de4-a8168822f2cd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2kk8l" (UID: "dcd6b859-e31a-41e2-8de4-a8168822f2cd") : secret "insights-runtime-extractor-tls" not found Jul 29 18:38:43.879580 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.879537 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/33c71203-1b58-4320-bfb0-446d03c1de74-signing-key\") pod \"service-ca-658d7b7c78-rm899\" (UID: \"33c71203-1b58-4320-bfb0-446d03c1de74\") " pod="openshift-service-ca/service-ca-658d7b7c78-rm899" Jul 29 18:38:43.879580 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.879586 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/33c71203-1b58-4320-bfb0-446d03c1de74-signing-cabundle\") pod \"service-ca-658d7b7c78-rm899\" (UID: \"33c71203-1b58-4320-bfb0-446d03c1de74\") " pod="openshift-service-ca/service-ca-658d7b7c78-rm899" Jul 29 18:38:43.879980 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.879631 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxqj2\" (UniqueName: \"kubernetes.io/projected/33c71203-1b58-4320-bfb0-446d03c1de74-kube-api-access-nxqj2\") pod \"service-ca-658d7b7c78-rm899\" (UID: \"33c71203-1b58-4320-bfb0-446d03c1de74\") " pod="openshift-service-ca/service-ca-658d7b7c78-rm899" Jul 29 18:38:43.884644 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.884616 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/33c71203-1b58-4320-bfb0-446d03c1de74-signing-cabundle\") pod \"service-ca-658d7b7c78-rm899\" (UID: \"33c71203-1b58-4320-bfb0-446d03c1de74\") " pod="openshift-service-ca/service-ca-658d7b7c78-rm899" Jul 29 18:38:43.886418 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.886392 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/33c71203-1b58-4320-bfb0-446d03c1de74-signing-key\") pod \"service-ca-658d7b7c78-rm899\" (UID: \"33c71203-1b58-4320-bfb0-446d03c1de74\") " pod="openshift-service-ca/service-ca-658d7b7c78-rm899" Jul 29 18:38:43.888452 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.888427 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxqj2\" (UniqueName: \"kubernetes.io/projected/33c71203-1b58-4320-bfb0-446d03c1de74-kube-api-access-nxqj2\") pod \"service-ca-658d7b7c78-rm899\" (UID: \"33c71203-1b58-4320-bfb0-446d03c1de74\") " pod="openshift-service-ca/service-ca-658d7b7c78-rm899" Jul 29 18:38:43.974026 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:43.973996 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-rm899" Jul 29 18:38:44.098457 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:44.098427 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-rm899"] Jul 29 18:38:44.101482 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:38:44.101453 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33c71203_1b58_4320_bfb0_446d03c1de74.slice/crio-713e599d7b5f58c91a2ff691892f6e7ff34a51e51b3981f2674a9302afafafb9 WatchSource:0}: Error finding container 713e599d7b5f58c91a2ff691892f6e7ff34a51e51b3981f2674a9302afafafb9: Status 404 returned error can't find the container with id 713e599d7b5f58c91a2ff691892f6e7ff34a51e51b3981f2674a9302afafafb9 Jul 29 18:38:44.171807 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:44.171774 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-rm899" event={"ID":"33c71203-1b58-4320-bfb0-446d03c1de74","Type":"ContainerStarted","Data":"b71a214f29ad7529b37a105b8c93f1a1d155fe79f148b31d82f78de20cd32f99"} Jul 29 18:38:44.172278 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:44.171830 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-rm899" event={"ID":"33c71203-1b58-4320-bfb0-446d03c1de74","Type":"ContainerStarted","Data":"713e599d7b5f58c91a2ff691892f6e7ff34a51e51b3981f2674a9302afafafb9"} Jul 29 18:38:44.190630 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:44.190574 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-rm899" podStartSLOduration=1.190539174 podStartE2EDuration="1.190539174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:38:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:38:44.189499814 +0000 UTC m=+275.529606560" watchObservedRunningTime="2026-07-29 18:38:44.190539174 +0000 UTC m=+275.530645919" Jul 29 18:38:44.789424 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:44.789375 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dcd6b859-e31a-41e2-8de4-a8168822f2cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2kk8l\" (UID: \"dcd6b859-e31a-41e2-8de4-a8168822f2cd\") " pod="openshift-insights/insights-runtime-extractor-2kk8l" Jul 29 18:38:44.789634 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:44.789526 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dcd6b859-e31a-41e2-8de4-a8168822f2cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2kk8l\" (UID: \"dcd6b859-e31a-41e2-8de4-a8168822f2cd\") " pod="openshift-insights/insights-runtime-extractor-2kk8l" Jul 29 18:38:44.789723 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:44.789634 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 18:38:44.789723 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:44.789638 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 18:38:44.789723 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:44.789697 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dcd6b859-e31a-41e2-8de4-a8168822f2cd-kube-rbac-proxy-cm podName:dcd6b859-e31a-41e2-8de4-a8168822f2cd nodeName:}" failed. No retries permitted until 2026-07-29 18:38:46.789677684 +0000 UTC m=+278.129784409 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dcd6b859-e31a-41e2-8de4-a8168822f2cd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2kk8l" (UID: "dcd6b859-e31a-41e2-8de4-a8168822f2cd") : configmap "kube-rbac-proxy" not found Jul 29 18:38:44.789723 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:44.789712 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcd6b859-e31a-41e2-8de4-a8168822f2cd-insights-runtime-extractor-tls podName:dcd6b859-e31a-41e2-8de4-a8168822f2cd nodeName:}" failed. No retries permitted until 2026-07-29 18:38:46.789705912 +0000 UTC m=+278.129812635 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dcd6b859-e31a-41e2-8de4-a8168822f2cd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2kk8l" (UID: "dcd6b859-e31a-41e2-8de4-a8168822f2cd") : secret "insights-runtime-extractor-tls" not found Jul 29 18:38:45.698999 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:45.698963 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a486c64-b769-4520-964d-770b838d4d89-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5dgjv\" (UID: \"5a486c64-b769-4520-964d-770b838d4d89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5dgjv" Jul 29 18:38:45.699360 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:45.699070 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/171dbb04-212f-4c71-a0df-fb56fff86589-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-lbf7x\" (UID: \"171dbb04-212f-4c71-a0df-fb56fff86589\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lbf7x" Jul 29 18:38:45.699360 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:45.699116 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 18:38:45.699360 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:45.699155 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 18:38:45.699360 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:45.699178 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a486c64-b769-4520-964d-770b838d4d89-samples-operator-tls podName:5a486c64-b769-4520-964d-770b838d4d89 nodeName:}" failed. No retries permitted until 2026-07-29 18:38:53.699163507 +0000 UTC m=+285.039270233 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5a486c64-b769-4520-964d-770b838d4d89-samples-operator-tls") pod "cluster-samples-operator-6748489656-5dgjv" (UID: "5a486c64-b769-4520-964d-770b838d4d89") : secret "samples-operator-tls" not found Jul 29 18:38:45.699360 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:45.699194 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/171dbb04-212f-4c71-a0df-fb56fff86589-cluster-monitoring-operator-tls podName:171dbb04-212f-4c71-a0df-fb56fff86589 nodeName:}" failed. No retries permitted until 2026-07-29 18:38:53.699183696 +0000 UTC m=+285.039290419 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/171dbb04-212f-4c71-a0df-fb56fff86589-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-lbf7x" (UID: "171dbb04-212f-4c71-a0df-fb56fff86589") : secret "cluster-monitoring-operator-tls" not found Jul 29 18:38:45.772122 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:45.772095 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7zxz4_64c334b9-60b0-4b1b-96b3-c8caaf87f3fc/dns-node-resolver/0.log" Jul 29 18:38:46.772220 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:46.772192 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bn2mn_ac39ef91-ebd7-46e9-8001-55b544a7dcea/node-ca/0.log" Jul 29 18:38:46.807269 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:46.807237 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dcd6b859-e31a-41e2-8de4-a8168822f2cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2kk8l\" (UID: \"dcd6b859-e31a-41e2-8de4-a8168822f2cd\") " pod="openshift-insights/insights-runtime-extractor-2kk8l" Jul 29 18:38:46.807402 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:46.807293 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dcd6b859-e31a-41e2-8de4-a8168822f2cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2kk8l\" (UID: \"dcd6b859-e31a-41e2-8de4-a8168822f2cd\") " pod="openshift-insights/insights-runtime-extractor-2kk8l" Jul 29 18:38:46.807443 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:46.807398 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 18:38:46.807443 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:46.807406 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 18:38:46.807503 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:46.807459 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcd6b859-e31a-41e2-8de4-a8168822f2cd-insights-runtime-extractor-tls podName:dcd6b859-e31a-41e2-8de4-a8168822f2cd nodeName:}" failed. No retries permitted until 2026-07-29 18:38:50.80744605 +0000 UTC m=+282.147552772 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dcd6b859-e31a-41e2-8de4-a8168822f2cd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2kk8l" (UID: "dcd6b859-e31a-41e2-8de4-a8168822f2cd") : secret "insights-runtime-extractor-tls" not found Jul 29 18:38:46.807503 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:46.807475 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dcd6b859-e31a-41e2-8de4-a8168822f2cd-kube-rbac-proxy-cm podName:dcd6b859-e31a-41e2-8de4-a8168822f2cd nodeName:}" failed. No retries permitted until 2026-07-29 18:38:50.807469249 +0000 UTC m=+282.147575972 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dcd6b859-e31a-41e2-8de4-a8168822f2cd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2kk8l" (UID: "dcd6b859-e31a-41e2-8de4-a8168822f2cd") : configmap "kube-rbac-proxy" not found Jul 29 18:38:47.972134 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:47.972105 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wljgs_b475136a-e94f-4558-a2c8-f1cc51174d5e/serve-healthcheck-canary/0.log" Jul 29 18:38:50.842715 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:50.842675 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dcd6b859-e31a-41e2-8de4-a8168822f2cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2kk8l\" (UID: \"dcd6b859-e31a-41e2-8de4-a8168822f2cd\") " pod="openshift-insights/insights-runtime-extractor-2kk8l" Jul 29 18:38:50.843103 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:50.842738 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dcd6b859-e31a-41e2-8de4-a8168822f2cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2kk8l\" (UID: \"dcd6b859-e31a-41e2-8de4-a8168822f2cd\") " pod="openshift-insights/insights-runtime-extractor-2kk8l" Jul 29 18:38:50.843103 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:50.842813 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 18:38:50.843103 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:50.842885 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dcd6b859-e31a-41e2-8de4-a8168822f2cd-kube-rbac-proxy-cm podName:dcd6b859-e31a-41e2-8de4-a8168822f2cd nodeName:}" failed. No retries permitted until 2026-07-29 18:38:58.842868518 +0000 UTC m=+290.182975810 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dcd6b859-e31a-41e2-8de4-a8168822f2cd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2kk8l" (UID: "dcd6b859-e31a-41e2-8de4-a8168822f2cd") : configmap "kube-rbac-proxy" not found Jul 29 18:38:50.843103 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:50.842905 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 18:38:50.843103 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:50.842966 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcd6b859-e31a-41e2-8de4-a8168822f2cd-insights-runtime-extractor-tls podName:dcd6b859-e31a-41e2-8de4-a8168822f2cd nodeName:}" failed. No retries permitted until 2026-07-29 18:38:58.842950852 +0000 UTC m=+290.183057575 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dcd6b859-e31a-41e2-8de4-a8168822f2cd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2kk8l" (UID: "dcd6b859-e31a-41e2-8de4-a8168822f2cd") : secret "insights-runtime-extractor-tls" not found Jul 29 18:38:50.883808 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:50.883769 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" podUID="0c4b0ad6-e876-4580-841c-91a36f53a0f8" Jul 29 18:38:50.883808 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:50.883790 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-l94qg" podUID="b762ab1b-627c-44b0-97c5-7d948e4ef348" Jul 29 18:38:50.883808 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:38:50.883769 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-tj78n" podUID="a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91" Jul 29 18:38:51.193978 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:51.193896 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:38:51.194136 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:51.193897 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-l94qg" Jul 29 18:38:51.194136 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:51.194080 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tj78n" Jul 29 18:38:53.768484 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:53.768445 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/171dbb04-212f-4c71-a0df-fb56fff86589-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-lbf7x\" (UID: \"171dbb04-212f-4c71-a0df-fb56fff86589\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lbf7x" Jul 29 18:38:53.768929 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:53.768494 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a486c64-b769-4520-964d-770b838d4d89-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5dgjv\" (UID: \"5a486c64-b769-4520-964d-770b838d4d89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5dgjv" Jul 29 18:38:53.770926 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:53.770897 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a486c64-b769-4520-964d-770b838d4d89-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5dgjv\" (UID: \"5a486c64-b769-4520-964d-770b838d4d89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5dgjv" Jul 29 18:38:53.770926 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:53.770909 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/171dbb04-212f-4c71-a0df-fb56fff86589-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-lbf7x\" (UID: \"171dbb04-212f-4c71-a0df-fb56fff86589\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lbf7x" Jul 29 18:38:53.834096 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:53.834045 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5dgjv" Jul 29 18:38:53.850703 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:53.850675 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lbf7x" Jul 29 18:38:53.967371 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:53.967335 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5dgjv"] Jul 29 18:38:53.971105 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:53.971079 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:38:53.971213 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:53.971182 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b762ab1b-627c-44b0-97c5-7d948e4ef348-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-l94qg\" (UID: \"b762ab1b-627c-44b0-97c5-7d948e4ef348\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-l94qg" Jul 29 18:38:53.973485 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:53.973462 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b762ab1b-627c-44b0-97c5-7d948e4ef348-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-l94qg\" (UID: \"b762ab1b-627c-44b0-97c5-7d948e4ef348\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-l94qg" Jul 29 18:38:53.973627 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:53.973608 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls\") pod \"image-registry-7cc9cc4c87-kfccg\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:38:53.985878 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:53.985852 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-lbf7x"] Jul 29 18:38:53.988644 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:38:53.988623 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod171dbb04_212f_4c71_a0df_fb56fff86589.slice/crio-a12470dea1a53e842efda6a7195d946b37a5330867ed98f5ac993c9c08da1f5e WatchSource:0}: Error finding container a12470dea1a53e842efda6a7195d946b37a5330867ed98f5ac993c9c08da1f5e: Status 404 returned error can't find the container with id a12470dea1a53e842efda6a7195d946b37a5330867ed98f5ac993c9c08da1f5e Jul 29 18:38:54.071871 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:54.071840 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-metrics-tls\") pod \"dns-default-tj78n\" (UID: \"a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91\") " pod="openshift-dns/dns-default-tj78n" Jul 29 18:38:54.074049 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:54.074031 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91-metrics-tls\") pod \"dns-default-tj78n\" (UID: \"a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91\") " pod="openshift-dns/dns-default-tj78n" Jul 29 18:38:54.197729 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:54.197696 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-vmw8p\"" Jul 29 18:38:54.197729 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:54.197697 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zfgsf\"" Jul 29 18:38:54.197729 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:54.197697 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-x4hx2\"" Jul 29 18:38:54.204211 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:54.204184 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lbf7x" event={"ID":"171dbb04-212f-4c71-a0df-fb56fff86589","Type":"ContainerStarted","Data":"a12470dea1a53e842efda6a7195d946b37a5330867ed98f5ac993c9c08da1f5e"} Jul 29 18:38:54.204943 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:54.204923 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:38:54.205064 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:54.204960 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-l94qg" Jul 29 18:38:54.205064 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:54.204960 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tj78n" Jul 29 18:38:54.205229 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:54.205211 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5dgjv" event={"ID":"5a486c64-b769-4520-964d-770b838d4d89","Type":"ContainerStarted","Data":"68c827ce86f2d2802839aeafa0c8a1535a0975f1c96426d49298fe232c6289cb"} Jul 29 18:38:54.341748 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:54.341712 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-l94qg"] Jul 29 18:38:54.345338 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:38:54.345310 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb762ab1b_627c_44b0_97c5_7d948e4ef348.slice/crio-55985ba7a4020b105ae95edeeb25b1b6629f7ac5da880cf2dd1020b36bbe99aa WatchSource:0}: Error finding container 55985ba7a4020b105ae95edeeb25b1b6629f7ac5da880cf2dd1020b36bbe99aa: Status 404 returned error can't find the container with id 55985ba7a4020b105ae95edeeb25b1b6629f7ac5da880cf2dd1020b36bbe99aa Jul 29 18:38:54.364868 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:54.364734 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cc9cc4c87-kfccg"] Jul 29 18:38:54.367289 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:38:54.367267 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c4b0ad6_e876_4580_841c_91a36f53a0f8.slice/crio-7f773a3bdd1375eec5a5dcfd440d612662a8d78075e5e28757d024c902ac63e8 WatchSource:0}: Error finding container 7f773a3bdd1375eec5a5dcfd440d612662a8d78075e5e28757d024c902ac63e8: Status 404 returned error can't find the container with id 7f773a3bdd1375eec5a5dcfd440d612662a8d78075e5e28757d024c902ac63e8 Jul 29 18:38:54.381672 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:54.381647 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tj78n"] Jul 29 18:38:54.384971 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:38:54.384946 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2a0e8be_b2ac_4bbf_ad58_6cf79b215b91.slice/crio-29c5d3630c8c237a2bad2e1eb6cfd551ccfd1d1771d109b6dec98074169dce30 WatchSource:0}: Error finding container 29c5d3630c8c237a2bad2e1eb6cfd551ccfd1d1771d109b6dec98074169dce30: Status 404 returned error can't find the container with id 29c5d3630c8c237a2bad2e1eb6cfd551ccfd1d1771d109b6dec98074169dce30 Jul 29 18:38:55.212373 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:55.212335 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-l94qg" event={"ID":"b762ab1b-627c-44b0-97c5-7d948e4ef348","Type":"ContainerStarted","Data":"55985ba7a4020b105ae95edeeb25b1b6629f7ac5da880cf2dd1020b36bbe99aa"} Jul 29 18:38:55.215818 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:55.214877 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" event={"ID":"0c4b0ad6-e876-4580-841c-91a36f53a0f8","Type":"ContainerStarted","Data":"ccbc8fa7534eaeb643ca3c56aed01751d2a619020b012eb546973342cbee923a"} Jul 29 18:38:55.215818 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:55.214930 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" event={"ID":"0c4b0ad6-e876-4580-841c-91a36f53a0f8","Type":"ContainerStarted","Data":"7f773a3bdd1375eec5a5dcfd440d612662a8d78075e5e28757d024c902ac63e8"} Jul 29 18:38:55.215818 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:55.215758 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:38:55.218856 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:55.218749 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tj78n" event={"ID":"a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91","Type":"ContainerStarted","Data":"29c5d3630c8c237a2bad2e1eb6cfd551ccfd1d1771d109b6dec98074169dce30"} Jul 29 18:38:55.238734 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:55.238668 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" podStartSLOduration=285.238645069 podStartE2EDuration="4m45.238645069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:34:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:38:55.238157476 +0000 UTC m=+286.578264222" watchObservedRunningTime="2026-07-29 18:38:55.238645069 +0000 UTC m=+286.578751815" Jul 29 18:38:58.230187 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:58.230151 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5dgjv" event={"ID":"5a486c64-b769-4520-964d-770b838d4d89","Type":"ContainerStarted","Data":"d4b19d0d4bb9a99e27372f62df32e03dcbac2861d62692540438366ef2cc9a20"} Jul 29 18:38:58.230646 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:58.230211 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5dgjv" event={"ID":"5a486c64-b769-4520-964d-770b838d4d89","Type":"ContainerStarted","Data":"53fe81bf97f7ad9a3f09b60c89d8ff578c37031f6e295a209fbc39a6288783a5"} Jul 29 18:38:58.231759 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:58.231738 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-l94qg" event={"ID":"b762ab1b-627c-44b0-97c5-7d948e4ef348","Type":"ContainerStarted","Data":"34dcf712d662bc850ff4269baa3aa9ba1ecab67fbfef76a80c6d6537d7e3c562"} Jul 29 18:38:58.233081 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:58.233062 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lbf7x" event={"ID":"171dbb04-212f-4c71-a0df-fb56fff86589","Type":"ContainerStarted","Data":"bd32aa90c70f28b64e7549769673d88f2655eb5a690f894b97c96a6a3ae7c71e"} Jul 29 18:38:58.234811 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:58.234791 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tj78n" event={"ID":"a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91","Type":"ContainerStarted","Data":"9538c0eedd0c991cdce29252dd3bfbe4551f87a741aa21c788a1ee8fe2051fb5"} Jul 29 18:38:58.234887 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:58.234824 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tj78n" event={"ID":"a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91","Type":"ContainerStarted","Data":"bb79c123c338b5d08ef22a251fc8aa975cf98d5e323004090bf4c41450c3b968"} Jul 29 18:38:58.234950 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:58.234919 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tj78n" Jul 29 18:38:58.248157 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:58.248111 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5dgjv" podStartSLOduration=18.040972351 podStartE2EDuration="21.248092752s" totalImagesPullingTime="3.207120401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:38:58.247876261 +0000 UTC m=+289.587983009" watchObservedRunningTime="2026-07-29 18:38:58.248092752 +0000 UTC m=+289.588199497" Jul 29 18:38:58.265350 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:58.265296 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-l94qg" podStartSLOduration=277.384113108 podStartE2EDuration="4m40.265280007s" totalImagesPullingTime="2.881166899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:38:58.26464752 +0000 UTC m=+289.604754265" watchObservedRunningTime="2026-07-29 18:38:58.265280007 +0000 UTC m=+289.605386752" Jul 29 18:38:58.288823 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:58.288775 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lbf7x" podStartSLOduration=18.049586263 podStartE2EDuration="21.288756913s" totalImagesPullingTime="3.23917065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:38:58.28820423 +0000 UTC m=+289.628310974" watchObservedRunningTime="2026-07-29 18:38:58.288756913 +0000 UTC m=+289.628863658" Jul 29 18:38:58.311021 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:58.310968 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tj78n" podStartSLOduration=252.463883351 podStartE2EDuration="4m15.310950111s" totalImagesPullingTime="2.84706676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:38:58.30930058 +0000 UTC m=+289.649407351" watchObservedRunningTime="2026-07-29 18:38:58.310950111 +0000 UTC m=+289.651056856" Jul 29 18:38:58.916645 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:58.916605 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dcd6b859-e31a-41e2-8de4-a8168822f2cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2kk8l\" (UID: \"dcd6b859-e31a-41e2-8de4-a8168822f2cd\") " pod="openshift-insights/insights-runtime-extractor-2kk8l" Jul 29 18:38:58.916822 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:58.916705 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dcd6b859-e31a-41e2-8de4-a8168822f2cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2kk8l\" (UID: \"dcd6b859-e31a-41e2-8de4-a8168822f2cd\") " pod="openshift-insights/insights-runtime-extractor-2kk8l" Jul 29 18:38:58.917250 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:58.917228 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dcd6b859-e31a-41e2-8de4-a8168822f2cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2kk8l\" (UID: \"dcd6b859-e31a-41e2-8de4-a8168822f2cd\") " pod="openshift-insights/insights-runtime-extractor-2kk8l" Jul 29 18:38:58.918861 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:58.918841 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dcd6b859-e31a-41e2-8de4-a8168822f2cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2kk8l\" (UID: \"dcd6b859-e31a-41e2-8de4-a8168822f2cd\") " pod="openshift-insights/insights-runtime-extractor-2kk8l" Jul 29 18:38:59.017340 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:59.017306 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2kk8l" Jul 29 18:38:59.147336 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:59.147304 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2kk8l"] Jul 29 18:38:59.150391 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:38:59.150366 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcd6b859_e31a_41e2_8de4_a8168822f2cd.slice/crio-a9f41eae79607f3b3498c2dfbd8d44a3da3f456d4ba2cf46b9ba3b7c6a278f10 WatchSource:0}: Error finding container a9f41eae79607f3b3498c2dfbd8d44a3da3f456d4ba2cf46b9ba3b7c6a278f10: Status 404 returned error can't find the container with id a9f41eae79607f3b3498c2dfbd8d44a3da3f456d4ba2cf46b9ba3b7c6a278f10 Jul 29 18:38:59.243107 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:38:59.243068 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2kk8l" event={"ID":"dcd6b859-e31a-41e2-8de4-a8168822f2cd","Type":"ContainerStarted","Data":"a9f41eae79607f3b3498c2dfbd8d44a3da3f456d4ba2cf46b9ba3b7c6a278f10"} Jul 29 18:39:04.266304 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:04.266270 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2kk8l" event={"ID":"dcd6b859-e31a-41e2-8de4-a8168822f2cd","Type":"ContainerStarted","Data":"f97352e424cc600cbf956d36a8a84bcb5f1033b0b63834772df40aa0a55a5bb0"} Jul 29 18:39:05.262700 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:39:05.262660 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-94h2v" podUID="1e43e1c7-433e-4559-8fa2-2c818770dc36" Jul 29 18:39:05.863407 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:05.863375 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-nqxhp"] Jul 29 18:39:05.868363 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:05.868336 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-nqxhp" Jul 29 18:39:05.871323 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:05.871279 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-qv8bd\"" Jul 29 18:39:05.871470 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:05.871332 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 29 18:39:05.871783 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:05.871765 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 29 18:39:05.872235 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:05.872216 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-zvmk7"] Jul 29 18:39:05.876806 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:05.876790 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-zvmk7" Jul 29 18:39:05.880077 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:05.880060 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 29 18:39:05.881733 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:05.881712 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-nfjvb\"" Jul 29 18:39:05.890196 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:05.890170 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-zvmk7"] Jul 29 18:39:05.891532 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:05.891501 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-nqxhp"] Jul 29 18:39:05.977372 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:05.977332 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5rbn\" (UniqueName: \"kubernetes.io/projected/a6d09fb3-550c-4079-aac6-29efc75fb8f3-kube-api-access-t5rbn\") pod \"downloads-7c97dc4555-nqxhp\" (UID: \"a6d09fb3-550c-4079-aac6-29efc75fb8f3\") " pod="openshift-console/downloads-7c97dc4555-nqxhp" Jul 29 18:39:05.977372 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:05.977374 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/94d5c83d-4abf-4cff-8d92-380d696a61b0-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-zvmk7\" (UID: \"94d5c83d-4abf-4cff-8d92-380d696a61b0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-zvmk7" Jul 29 18:39:06.078841 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:06.078803 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5rbn\" (UniqueName: \"kubernetes.io/projected/a6d09fb3-550c-4079-aac6-29efc75fb8f3-kube-api-access-t5rbn\") pod \"downloads-7c97dc4555-nqxhp\" (UID: \"a6d09fb3-550c-4079-aac6-29efc75fb8f3\") " pod="openshift-console/downloads-7c97dc4555-nqxhp" Jul 29 18:39:06.078841 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:06.078847 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/94d5c83d-4abf-4cff-8d92-380d696a61b0-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-zvmk7\" (UID: \"94d5c83d-4abf-4cff-8d92-380d696a61b0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-zvmk7" Jul 29 18:39:06.081443 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:06.081409 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/94d5c83d-4abf-4cff-8d92-380d696a61b0-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-zvmk7\" (UID: \"94d5c83d-4abf-4cff-8d92-380d696a61b0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-zvmk7" Jul 29 18:39:06.120489 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:06.120406 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5rbn\" (UniqueName: \"kubernetes.io/projected/a6d09fb3-550c-4079-aac6-29efc75fb8f3-kube-api-access-t5rbn\") pod \"downloads-7c97dc4555-nqxhp\" (UID: \"a6d09fb3-550c-4079-aac6-29efc75fb8f3\") " pod="openshift-console/downloads-7c97dc4555-nqxhp" Jul 29 18:39:06.178708 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:06.178680 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-nqxhp" Jul 29 18:39:06.187947 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:06.187912 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-zvmk7" Jul 29 18:39:07.904289 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:07.904151 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-nqxhp"] Jul 29 18:39:07.910422 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:39:07.910391 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6d09fb3_550c_4079_aac6_29efc75fb8f3.slice/crio-a556e38f43267c711bc90f1ce5904d783102993e8b3fb0a3a5dc06b95b35f929 WatchSource:0}: Error finding container a556e38f43267c711bc90f1ce5904d783102993e8b3fb0a3a5dc06b95b35f929: Status 404 returned error can't find the container with id a556e38f43267c711bc90f1ce5904d783102993e8b3fb0a3a5dc06b95b35f929 Jul 29 18:39:07.916970 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:07.916945 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-zvmk7"] Jul 29 18:39:07.919361 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:39:07.919339 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94d5c83d_4abf_4cff_8d92_380d696a61b0.slice/crio-9ec8686be899aebffd204f6d8f2d7d8bd5cb08d4910cb0edf51a5031e4349282 WatchSource:0}: Error finding container 9ec8686be899aebffd204f6d8f2d7d8bd5cb08d4910cb0edf51a5031e4349282: Status 404 returned error can't find the container with id 9ec8686be899aebffd204f6d8f2d7d8bd5cb08d4910cb0edf51a5031e4349282 Jul 29 18:39:08.244950 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:08.244923 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tj78n" Jul 29 18:39:08.283161 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:08.283126 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-zvmk7" event={"ID":"94d5c83d-4abf-4cff-8d92-380d696a61b0","Type":"ContainerStarted","Data":"9ec8686be899aebffd204f6d8f2d7d8bd5cb08d4910cb0edf51a5031e4349282"} Jul 29 18:39:08.285352 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:08.285321 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2kk8l" event={"ID":"dcd6b859-e31a-41e2-8de4-a8168822f2cd","Type":"ContainerStarted","Data":"36d4d63cd6485de799a3ab646b15c5e1d4d3e112ca97d41aadbd948e0914de57"} Jul 29 18:39:08.286675 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:08.286649 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-nqxhp" event={"ID":"a6d09fb3-550c-4079-aac6-29efc75fb8f3","Type":"ContainerStarted","Data":"a556e38f43267c711bc90f1ce5904d783102993e8b3fb0a3a5dc06b95b35f929"} Jul 29 18:39:09.147722 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:09.147691 2560 kubelet.go:1648] "Image garbage collection succeeded" Jul 29 18:39:09.293300 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:09.293084 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-zvmk7" event={"ID":"94d5c83d-4abf-4cff-8d92-380d696a61b0","Type":"ContainerStarted","Data":"4d975058e246bd170ac3ec7961fabc6d06f254dca00d7ec7038433d482d4116c"} Jul 29 18:39:09.294683 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:09.293722 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-zvmk7" Jul 29 18:39:09.299443 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:09.299396 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-zvmk7" Jul 29 18:39:09.310969 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:09.310256 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-zvmk7" podStartSLOduration=3.080892385 podStartE2EDuration="4.310234273s" totalImagesPullingTime="1.229341888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:39:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:39:09.308826702 +0000 UTC m=+300.648933449" watchObservedRunningTime="2026-07-29 18:39:09.310234273 +0000 UTC m=+300.650341020" Jul 29 18:39:09.830023 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:09.829991 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-hz8zk"] Jul 29 18:39:09.833476 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:09.833452 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-hz8zk" Jul 29 18:39:09.836269 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:09.836242 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 29 18:39:09.836450 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:09.836302 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-846rd\"" Jul 29 18:39:09.836450 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:09.836252 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 29 18:39:09.837681 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:09.837661 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 29 18:39:09.842935 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:09.842901 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-hz8zk"] Jul 29 18:39:10.016824 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:10.016788 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-hz8zk\" (UID: \"6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hz8zk" Jul 29 18:39:10.017023 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:10.016847 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfbz8\" (UniqueName: \"kubernetes.io/projected/6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c-kube-api-access-xfbz8\") pod \"prometheus-operator-84d69f794d-hz8zk\" (UID: \"6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hz8zk" Jul 29 18:39:10.017023 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:10.016969 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-hz8zk\" (UID: \"6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hz8zk" Jul 29 18:39:10.017152 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:10.017086 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-hz8zk\" (UID: \"6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hz8zk" Jul 29 18:39:10.118032 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:10.117935 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-hz8zk\" (UID: \"6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hz8zk" Jul 29 18:39:10.118207 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:10.118039 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-hz8zk\" (UID: \"6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hz8zk" Jul 29 18:39:10.118207 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:10.118070 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-hz8zk\" (UID: \"6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hz8zk" Jul 29 18:39:10.118207 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:10.118111 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfbz8\" (UniqueName: \"kubernetes.io/projected/6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c-kube-api-access-xfbz8\") pod \"prometheus-operator-84d69f794d-hz8zk\" (UID: \"6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hz8zk" Jul 29 18:39:10.118428 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:39:10.118216 2560 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 29 18:39:10.118428 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:39:10.118289 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c-prometheus-operator-tls podName:6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c nodeName:}" failed. No retries permitted until 2026-07-29 18:39:10.618269909 +0000 UTC m=+301.958376646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-hz8zk" (UID: "6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c") : secret "prometheus-operator-tls" not found Jul 29 18:39:10.119000 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:10.118975 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-hz8zk\" (UID: \"6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hz8zk" Jul 29 18:39:10.120969 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:10.120944 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-hz8zk\" (UID: \"6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hz8zk" Jul 29 18:39:10.129125 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:10.129075 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfbz8\" (UniqueName: \"kubernetes.io/projected/6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c-kube-api-access-xfbz8\") pod \"prometheus-operator-84d69f794d-hz8zk\" (UID: \"6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hz8zk" Jul 29 18:39:10.622903 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:10.622859 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-hz8zk\" (UID: \"6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hz8zk" Jul 29 18:39:10.626172 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:10.626116 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-hz8zk\" (UID: \"6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hz8zk" Jul 29 18:39:10.749037 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:10.748998 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-hz8zk" Jul 29 18:39:12.808651 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:12.808610 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-hz8zk"] Jul 29 18:39:12.812252 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:39:12.812219 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a8e9bc2_5558_464b_8ef3_cde9ebf5d17c.slice/crio-d0cf5a4ae8cdaa9950a7dc8b68035ea3d07e8921996239f75edc0a3fb5575373 WatchSource:0}: Error finding container d0cf5a4ae8cdaa9950a7dc8b68035ea3d07e8921996239f75edc0a3fb5575373: Status 404 returned error can't find the container with id d0cf5a4ae8cdaa9950a7dc8b68035ea3d07e8921996239f75edc0a3fb5575373 Jul 29 18:39:12.815058 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:12.814655 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 18:39:13.311435 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:13.311396 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2kk8l" event={"ID":"dcd6b859-e31a-41e2-8de4-a8168822f2cd","Type":"ContainerStarted","Data":"912e43de7cb5541d3bb1d177db0d5fb937c3eb169ca877f163c9b33aa8bc383b"} Jul 29 18:39:13.312574 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:13.312537 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-hz8zk" event={"ID":"6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c","Type":"ContainerStarted","Data":"d0cf5a4ae8cdaa9950a7dc8b68035ea3d07e8921996239f75edc0a3fb5575373"} Jul 29 18:39:13.332677 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:13.332617 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2kk8l" podStartSLOduration=16.888450997 podStartE2EDuration="30.332586038s" totalImagesPullingTime="13.444135041s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:38:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:39:13.330854704 +0000 UTC m=+304.670961448" watchObservedRunningTime="2026-07-29 18:39:13.332586038 +0000 UTC m=+304.672692824" Jul 29 18:39:14.211395 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:14.211356 2560 patch_prober.go:28] interesting pod/image-registry-7cc9cc4c87-kfccg container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 29 18:39:14.211843 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:14.211418 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" podUID="0c4b0ad6-e876-4580-841c-91a36f53a0f8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 29 18:39:15.324323 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:15.324281 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-hz8zk" event={"ID":"6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c","Type":"ContainerStarted","Data":"1eb2c9eb2e46bbd0bcbb86336ee85f65323954eadd3dbe7e1a39ea8f8bee8de2"} Jul 29 18:39:15.324774 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:15.324351 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-hz8zk" event={"ID":"6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c","Type":"ContainerStarted","Data":"dec1dab822bb1acce08d35a2d69f8190389901b714abb03806f297b142641f11"} Jul 29 18:39:15.341721 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:15.341660 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-hz8zk" podStartSLOduration=4.563422693 podStartE2EDuration="6.341638757s" totalImagesPullingTime="1.778216064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:39:15.340805337 +0000 UTC m=+306.680912081" watchObservedRunningTime="2026-07-29 18:39:15.341638757 +0000 UTC m=+306.681745506" Jul 29 18:39:16.261475 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:16.261441 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:39:17.231705 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.231671 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:39:17.244048 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.243371 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-n28r7"] Jul 29 18:39:17.247304 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.247280 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n28r7" Jul 29 18:39:17.250039 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.250015 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-p5cr9\"" Jul 29 18:39:17.251006 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.250641 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 29 18:39:17.251266 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.251236 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 29 18:39:17.251960 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.251833 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xnj4k"] Jul 29 18:39:17.255941 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.255740 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xnj4k" Jul 29 18:39:17.264609 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.262147 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 29 18:39:17.264609 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.262313 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 29 18:39:17.264609 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.262362 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 29 18:39:17.264609 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.262159 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-l79db\"" Jul 29 18:39:17.272964 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.272895 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-n28r7"] Jul 29 18:39:17.280502 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.279205 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c-metrics-client-ca\") pod \"node-exporter-xnj4k\" (UID: \"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c\") " pod="openshift-monitoring/node-exporter-xnj4k" Jul 29 18:39:17.280502 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.279264 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c-node-exporter-accelerators-collector-config\") pod \"node-exporter-xnj4k\" (UID: \"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c\") " pod="openshift-monitoring/node-exporter-xnj4k" Jul 29 18:39:17.280502 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.279292 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c-node-exporter-tls\") pod \"node-exporter-xnj4k\" (UID: \"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c\") " pod="openshift-monitoring/node-exporter-xnj4k" Jul 29 18:39:17.280502 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.279389 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f6ff8c3-1d67-484f-af65-1f4b773b7d9c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-n28r7\" (UID: \"1f6ff8c3-1d67-484f-af65-1f4b773b7d9c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n28r7" Jul 29 18:39:17.280502 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.279413 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f6ff8c3-1d67-484f-af65-1f4b773b7d9c-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-n28r7\" (UID: \"1f6ff8c3-1d67-484f-af65-1f4b773b7d9c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n28r7" Jul 29 18:39:17.280502 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.279439 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c-node-exporter-textfile\") pod \"node-exporter-xnj4k\" (UID: \"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c\") " pod="openshift-monitoring/node-exporter-xnj4k" Jul 29 18:39:17.280502 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.279493 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c-node-exporter-wtmp\") pod \"node-exporter-xnj4k\" (UID: \"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c\") " pod="openshift-monitoring/node-exporter-xnj4k" Jul 29 18:39:17.280502 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.279530 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f6ff8c3-1d67-484f-af65-1f4b773b7d9c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-n28r7\" (UID: \"1f6ff8c3-1d67-484f-af65-1f4b773b7d9c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n28r7" Jul 29 18:39:17.280502 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.279572 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xnj4k\" (UID: \"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c\") " pod="openshift-monitoring/node-exporter-xnj4k" Jul 29 18:39:17.280502 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.279598 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c-root\") pod \"node-exporter-xnj4k\" (UID: \"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c\") " pod="openshift-monitoring/node-exporter-xnj4k" Jul 29 18:39:17.280502 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.279654 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mccdv\" (UniqueName: \"kubernetes.io/projected/1f6ff8c3-1d67-484f-af65-1f4b773b7d9c-kube-api-access-mccdv\") pod \"openshift-state-metrics-b8f49f5c6-n28r7\" (UID: \"1f6ff8c3-1d67-484f-af65-1f4b773b7d9c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n28r7" Jul 29 18:39:17.280502 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.279676 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c-sys\") pod \"node-exporter-xnj4k\" (UID: \"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c\") " pod="openshift-monitoring/node-exporter-xnj4k" Jul 29 18:39:17.280502 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.279753 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnsdl\" (UniqueName: \"kubernetes.io/projected/58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c-kube-api-access-jnsdl\") pod \"node-exporter-xnj4k\" (UID: \"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c\") " pod="openshift-monitoring/node-exporter-xnj4k" Jul 29 18:39:17.380743 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.380704 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mccdv\" (UniqueName: \"kubernetes.io/projected/1f6ff8c3-1d67-484f-af65-1f4b773b7d9c-kube-api-access-mccdv\") pod \"openshift-state-metrics-b8f49f5c6-n28r7\" (UID: \"1f6ff8c3-1d67-484f-af65-1f4b773b7d9c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n28r7" Jul 29 18:39:17.380925 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.380755 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c-sys\") pod \"node-exporter-xnj4k\" (UID: \"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c\") " pod="openshift-monitoring/node-exporter-xnj4k" Jul 29 18:39:17.380925 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.380795 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnsdl\" (UniqueName: \"kubernetes.io/projected/58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c-kube-api-access-jnsdl\") pod \"node-exporter-xnj4k\" (UID: \"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c\") " pod="openshift-monitoring/node-exporter-xnj4k" Jul 29 18:39:17.380925 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.380826 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c-metrics-client-ca\") pod \"node-exporter-xnj4k\" (UID: \"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c\") " pod="openshift-monitoring/node-exporter-xnj4k" Jul 29 18:39:17.380925 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.380855 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c-node-exporter-accelerators-collector-config\") pod \"node-exporter-xnj4k\" (UID: \"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c\") " pod="openshift-monitoring/node-exporter-xnj4k" Jul 29 18:39:17.380925 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.380882 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c-node-exporter-tls\") pod \"node-exporter-xnj4k\" (UID: \"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c\") " pod="openshift-monitoring/node-exporter-xnj4k" Jul 29 18:39:17.381165 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.380933 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f6ff8c3-1d67-484f-af65-1f4b773b7d9c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-n28r7\" (UID: \"1f6ff8c3-1d67-484f-af65-1f4b773b7d9c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n28r7" Jul 29 18:39:17.381165 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.380958 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f6ff8c3-1d67-484f-af65-1f4b773b7d9c-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-n28r7\" (UID: \"1f6ff8c3-1d67-484f-af65-1f4b773b7d9c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n28r7" Jul 29 18:39:17.381165 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.380981 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c-node-exporter-textfile\") pod \"node-exporter-xnj4k\" (UID: \"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c\") " pod="openshift-monitoring/node-exporter-xnj4k" Jul 29 18:39:17.381165 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.381017 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c-node-exporter-wtmp\") pod \"node-exporter-xnj4k\" (UID: \"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c\") " pod="openshift-monitoring/node-exporter-xnj4k" Jul 29 18:39:17.381165 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.381050 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f6ff8c3-1d67-484f-af65-1f4b773b7d9c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-n28r7\" (UID: \"1f6ff8c3-1d67-484f-af65-1f4b773b7d9c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n28r7" Jul 29 18:39:17.381165 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.381076 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xnj4k\" (UID: \"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c\") " pod="openshift-monitoring/node-exporter-xnj4k" Jul 29 18:39:17.381165 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.381101 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c-root\") pod \"node-exporter-xnj4k\" (UID: \"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c\") " pod="openshift-monitoring/node-exporter-xnj4k" Jul 29 18:39:17.381528 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.381185 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c-root\") pod \"node-exporter-xnj4k\" (UID: \"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c\") " pod="openshift-monitoring/node-exporter-xnj4k" Jul 29 18:39:17.381528 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:39:17.381278 2560 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 29 18:39:17.381528 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:39:17.381285 2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 29 18:39:17.381528 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:39:17.381351 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f6ff8c3-1d67-484f-af65-1f4b773b7d9c-openshift-state-metrics-tls podName:1f6ff8c3-1d67-484f-af65-1f4b773b7d9c nodeName:}" failed. No retries permitted until 2026-07-29 18:39:17.881331302 +0000 UTC m=+309.221438038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1f6ff8c3-1d67-484f-af65-1f4b773b7d9c-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-n28r7" (UID: "1f6ff8c3-1d67-484f-af65-1f4b773b7d9c") : secret "openshift-state-metrics-tls" not found Jul 29 18:39:17.381741 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.381662 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c-sys\") pod \"node-exporter-xnj4k\" (UID: \"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c\") " pod="openshift-monitoring/node-exporter-xnj4k" Jul 29 18:39:17.382585 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.382099 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f6ff8c3-1d67-484f-af65-1f4b773b7d9c-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-n28r7\" (UID: \"1f6ff8c3-1d67-484f-af65-1f4b773b7d9c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n28r7" Jul 29 18:39:17.382585 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.382338 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c-node-exporter-textfile\") pod \"node-exporter-xnj4k\" (UID: \"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c\") " pod="openshift-monitoring/node-exporter-xnj4k" Jul 29 18:39:17.382585 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.382438 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c-metrics-client-ca\") pod \"node-exporter-xnj4k\" (UID: \"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c\") " pod="openshift-monitoring/node-exporter-xnj4k" Jul 29 18:39:17.382585 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.382463 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c-node-exporter-wtmp\") pod \"node-exporter-xnj4k\" (UID: \"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c\") " pod="openshift-monitoring/node-exporter-xnj4k" Jul 29 18:39:17.382585 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.382464 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c-node-exporter-accelerators-collector-config\") pod \"node-exporter-xnj4k\" (UID: \"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c\") " pod="openshift-monitoring/node-exporter-xnj4k" Jul 29 18:39:17.382585 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:39:17.382508 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c-node-exporter-tls podName:58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c nodeName:}" failed. No retries permitted until 2026-07-29 18:39:17.882491822 +0000 UTC m=+309.222598555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c-node-exporter-tls") pod "node-exporter-xnj4k" (UID: "58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c") : secret "node-exporter-tls" not found Jul 29 18:39:17.387290 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.386123 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f6ff8c3-1d67-484f-af65-1f4b773b7d9c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-n28r7\" (UID: \"1f6ff8c3-1d67-484f-af65-1f4b773b7d9c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n28r7" Jul 29 18:39:17.389271 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.389213 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xnj4k\" (UID: \"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c\") " pod="openshift-monitoring/node-exporter-xnj4k" Jul 29 18:39:17.397149 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.397093 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnsdl\" (UniqueName: \"kubernetes.io/projected/58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c-kube-api-access-jnsdl\") pod \"node-exporter-xnj4k\" (UID: \"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c\") " pod="openshift-monitoring/node-exporter-xnj4k" Jul 29 18:39:17.398006 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.397980 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mccdv\" (UniqueName: \"kubernetes.io/projected/1f6ff8c3-1d67-484f-af65-1f4b773b7d9c-kube-api-access-mccdv\") pod \"openshift-state-metrics-b8f49f5c6-n28r7\" (UID: \"1f6ff8c3-1d67-484f-af65-1f4b773b7d9c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n28r7" Jul 29 18:39:17.611777 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.611689 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84f45d7dd6-jhv6n"] Jul 29 18:39:17.616779 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.616753 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f45d7dd6-jhv6n" Jul 29 18:39:17.619812 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.619787 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4gbs6\"" Jul 29 18:39:17.619812 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.619808 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 29 18:39:17.620097 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.619831 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 29 18:39:17.620097 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.619786 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 29 18:39:17.620097 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.619787 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 29 18:39:17.620315 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.620152 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 29 18:39:17.626101 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.625910 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84f45d7dd6-jhv6n"] Jul 29 18:39:17.626281 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.626260 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 29 18:39:17.690890 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.684275 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-console-serving-cert\") pod \"console-84f45d7dd6-jhv6n\" (UID: \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\") " pod="openshift-console/console-84f45d7dd6-jhv6n" Jul 29 18:39:17.690890 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.684332 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48zfz\" (UniqueName: \"kubernetes.io/projected/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-kube-api-access-48zfz\") pod \"console-84f45d7dd6-jhv6n\" (UID: \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\") " pod="openshift-console/console-84f45d7dd6-jhv6n" Jul 29 18:39:17.690890 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.684369 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-trusted-ca-bundle\") pod \"console-84f45d7dd6-jhv6n\" (UID: \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\") " pod="openshift-console/console-84f45d7dd6-jhv6n" Jul 29 18:39:17.690890 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.684424 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-console-oauth-config\") pod \"console-84f45d7dd6-jhv6n\" (UID: \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\") " pod="openshift-console/console-84f45d7dd6-jhv6n" Jul 29 18:39:17.690890 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.684450 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-console-config\") pod \"console-84f45d7dd6-jhv6n\" (UID: \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\") " pod="openshift-console/console-84f45d7dd6-jhv6n" Jul 29 18:39:17.690890 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.684498 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-service-ca\") pod \"console-84f45d7dd6-jhv6n\" (UID: \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\") " pod="openshift-console/console-84f45d7dd6-jhv6n" Jul 29 18:39:17.690890 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.684526 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-oauth-serving-cert\") pod \"console-84f45d7dd6-jhv6n\" (UID: \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\") " pod="openshift-console/console-84f45d7dd6-jhv6n" Jul 29 18:39:17.786086 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.786048 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-console-serving-cert\") pod \"console-84f45d7dd6-jhv6n\" (UID: \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\") " pod="openshift-console/console-84f45d7dd6-jhv6n" Jul 29 18:39:17.786326 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.786108 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48zfz\" (UniqueName: \"kubernetes.io/projected/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-kube-api-access-48zfz\") pod \"console-84f45d7dd6-jhv6n\" (UID: \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\") " pod="openshift-console/console-84f45d7dd6-jhv6n" Jul 29 18:39:17.786326 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.786155 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-trusted-ca-bundle\") pod \"console-84f45d7dd6-jhv6n\" (UID: \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\") " pod="openshift-console/console-84f45d7dd6-jhv6n" Jul 29 18:39:17.786326 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.786246 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-console-oauth-config\") pod \"console-84f45d7dd6-jhv6n\" (UID: \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\") " pod="openshift-console/console-84f45d7dd6-jhv6n" Jul 29 18:39:17.786326 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.786270 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-console-config\") pod \"console-84f45d7dd6-jhv6n\" (UID: \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\") " pod="openshift-console/console-84f45d7dd6-jhv6n" Jul 29 18:39:17.786326 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.786310 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-service-ca\") pod \"console-84f45d7dd6-jhv6n\" (UID: \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\") " pod="openshift-console/console-84f45d7dd6-jhv6n" Jul 29 18:39:17.786622 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.786348 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-oauth-serving-cert\") pod \"console-84f45d7dd6-jhv6n\" (UID: \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\") " pod="openshift-console/console-84f45d7dd6-jhv6n" Jul 29 18:39:17.787296 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.787239 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-console-config\") pod \"console-84f45d7dd6-jhv6n\" (UID: \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\") " pod="openshift-console/console-84f45d7dd6-jhv6n" Jul 29 18:39:17.788052 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.787735 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-service-ca\") pod \"console-84f45d7dd6-jhv6n\" (UID: \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\") " pod="openshift-console/console-84f45d7dd6-jhv6n" Jul 29 18:39:17.788052 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.787766 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-oauth-serving-cert\") pod \"console-84f45d7dd6-jhv6n\" (UID: \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\") " pod="openshift-console/console-84f45d7dd6-jhv6n" Jul 29 18:39:17.788333 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.788311 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-trusted-ca-bundle\") pod \"console-84f45d7dd6-jhv6n\" (UID: \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\") " pod="openshift-console/console-84f45d7dd6-jhv6n" Jul 29 18:39:17.789385 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.789342 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-console-serving-cert\") pod \"console-84f45d7dd6-jhv6n\" (UID: \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\") " pod="openshift-console/console-84f45d7dd6-jhv6n" Jul 29 18:39:17.789657 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.789631 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-console-oauth-config\") pod \"console-84f45d7dd6-jhv6n\" (UID: \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\") " pod="openshift-console/console-84f45d7dd6-jhv6n" Jul 29 18:39:17.795076 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.795056 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48zfz\" (UniqueName: \"kubernetes.io/projected/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-kube-api-access-48zfz\") pod \"console-84f45d7dd6-jhv6n\" (UID: \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\") " pod="openshift-console/console-84f45d7dd6-jhv6n" Jul 29 18:39:17.887945 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.887865 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c-node-exporter-tls\") pod \"node-exporter-xnj4k\" (UID: \"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c\") " pod="openshift-monitoring/node-exporter-xnj4k" Jul 29 18:39:17.887945 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.887932 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f6ff8c3-1d67-484f-af65-1f4b773b7d9c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-n28r7\" (UID: \"1f6ff8c3-1d67-484f-af65-1f4b773b7d9c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n28r7" Jul 29 18:39:17.890910 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.890881 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c-node-exporter-tls\") pod \"node-exporter-xnj4k\" (UID: \"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c\") " pod="openshift-monitoring/node-exporter-xnj4k" Jul 29 18:39:17.891033 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.890936 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f6ff8c3-1d67-484f-af65-1f4b773b7d9c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-n28r7\" (UID: \"1f6ff8c3-1d67-484f-af65-1f4b773b7d9c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n28r7" Jul 29 18:39:17.931849 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:17.931779 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f45d7dd6-jhv6n" Jul 29 18:39:18.091441 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:18.091413 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84f45d7dd6-jhv6n"] Jul 29 18:39:18.093750 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:39:18.093726 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7dd3e3c_1f2b_4017_a57d_5b9a022f2447.slice/crio-486c46d0599d5bc5c6f59d54b49ed66066ea61b87d709854c7a8375058a80095 WatchSource:0}: Error finding container 486c46d0599d5bc5c6f59d54b49ed66066ea61b87d709854c7a8375058a80095: Status 404 returned error can't find the container with id 486c46d0599d5bc5c6f59d54b49ed66066ea61b87d709854c7a8375058a80095 Jul 29 18:39:18.162722 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:18.162551 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n28r7" Jul 29 18:39:18.178817 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:18.178697 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xnj4k" Jul 29 18:39:18.193698 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:39:18.193657 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58a2adbe_a8b4_49d2_a4f6_6423e4b5da8c.slice/crio-2654c8ea1fa416ccbbb765a278695768509c3aaa47b74d5decd29c25a06b4816 WatchSource:0}: Error finding container 2654c8ea1fa416ccbbb765a278695768509c3aaa47b74d5decd29c25a06b4816: Status 404 returned error can't find the container with id 2654c8ea1fa416ccbbb765a278695768509c3aaa47b74d5decd29c25a06b4816 Jul 29 18:39:18.334202 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:18.334168 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-n28r7"] Jul 29 18:39:18.338482 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:39:18.338452 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f6ff8c3_1d67_484f_af65_1f4b773b7d9c.slice/crio-ca28182ef3e3085b2d372081e9f30372eb1f6446fca8f3c6b34219b803d7fd9f WatchSource:0}: Error finding container ca28182ef3e3085b2d372081e9f30372eb1f6446fca8f3c6b34219b803d7fd9f: Status 404 returned error can't find the container with id ca28182ef3e3085b2d372081e9f30372eb1f6446fca8f3c6b34219b803d7fd9f Jul 29 18:39:18.341665 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:18.341632 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f45d7dd6-jhv6n" event={"ID":"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447","Type":"ContainerStarted","Data":"486c46d0599d5bc5c6f59d54b49ed66066ea61b87d709854c7a8375058a80095"} Jul 29 18:39:18.343290 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:18.343225 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xnj4k" event={"ID":"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c","Type":"ContainerStarted","Data":"2654c8ea1fa416ccbbb765a278695768509c3aaa47b74d5decd29c25a06b4816"} Jul 29 18:39:19.205538 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.203484 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f"] Jul 29 18:39:19.209633 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.208242 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" Jul 29 18:39:19.216096 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.213346 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 29 18:39:19.216096 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.213592 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 29 18:39:19.216096 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.213798 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 29 18:39:19.216096 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.214017 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ac69khjash8q9\"" Jul 29 18:39:19.216096 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.214636 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 29 18:39:19.216096 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.215574 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-bznfn\"" Jul 29 18:39:19.216096 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.215797 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 29 18:39:19.223731 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.222543 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f"] Jul 29 18:39:19.303963 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.303922 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/11a34d1f-bb08-4972-8c38-5552b769d385-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f4f999b9c-q8h5f\" (UID: \"11a34d1f-bb08-4972-8c38-5552b769d385\") " pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" Jul 29 18:39:19.304148 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.303989 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11a34d1f-bb08-4972-8c38-5552b769d385-metrics-client-ca\") pod \"thanos-querier-7f4f999b9c-q8h5f\" (UID: \"11a34d1f-bb08-4972-8c38-5552b769d385\") " pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" Jul 29 18:39:19.304148 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.304020 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sbxz\" (UniqueName: \"kubernetes.io/projected/11a34d1f-bb08-4972-8c38-5552b769d385-kube-api-access-5sbxz\") pod \"thanos-querier-7f4f999b9c-q8h5f\" (UID: \"11a34d1f-bb08-4972-8c38-5552b769d385\") " pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" Jul 29 18:39:19.304148 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.304053 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11a34d1f-bb08-4972-8c38-5552b769d385-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f4f999b9c-q8h5f\" (UID: \"11a34d1f-bb08-4972-8c38-5552b769d385\") " pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" Jul 29 18:39:19.304148 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.304095 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11a34d1f-bb08-4972-8c38-5552b769d385-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f4f999b9c-q8h5f\" (UID: \"11a34d1f-bb08-4972-8c38-5552b769d385\") " pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" Jul 29 18:39:19.304148 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.304122 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/11a34d1f-bb08-4972-8c38-5552b769d385-secret-thanos-querier-tls\") pod \"thanos-querier-7f4f999b9c-q8h5f\" (UID: \"11a34d1f-bb08-4972-8c38-5552b769d385\") " pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" Jul 29 18:39:19.304422 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.304151 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/11a34d1f-bb08-4972-8c38-5552b769d385-secret-grpc-tls\") pod \"thanos-querier-7f4f999b9c-q8h5f\" (UID: \"11a34d1f-bb08-4972-8c38-5552b769d385\") " pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" Jul 29 18:39:19.304422 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.304214 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/11a34d1f-bb08-4972-8c38-5552b769d385-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f4f999b9c-q8h5f\" (UID: \"11a34d1f-bb08-4972-8c38-5552b769d385\") " pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" Jul 29 18:39:19.351676 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.351626 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n28r7" event={"ID":"1f6ff8c3-1d67-484f-af65-1f4b773b7d9c","Type":"ContainerStarted","Data":"febe00c79939ca2edba0de2bf4a29c6abb0325f6305f13947d0b86ae88a0bfa1"} Jul 29 18:39:19.352138 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.351697 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n28r7" event={"ID":"1f6ff8c3-1d67-484f-af65-1f4b773b7d9c","Type":"ContainerStarted","Data":"2fdc55dca279c79c56c7555e55871693e0a443a09caac5994bc2d68432bbc6a1"} Jul 29 18:39:19.352138 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.351727 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n28r7" event={"ID":"1f6ff8c3-1d67-484f-af65-1f4b773b7d9c","Type":"ContainerStarted","Data":"ca28182ef3e3085b2d372081e9f30372eb1f6446fca8f3c6b34219b803d7fd9f"} Jul 29 18:39:19.404849 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.404811 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11a34d1f-bb08-4972-8c38-5552b769d385-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f4f999b9c-q8h5f\" (UID: \"11a34d1f-bb08-4972-8c38-5552b769d385\") " pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" Jul 29 18:39:19.405017 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.404865 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/11a34d1f-bb08-4972-8c38-5552b769d385-secret-thanos-querier-tls\") pod \"thanos-querier-7f4f999b9c-q8h5f\" (UID: \"11a34d1f-bb08-4972-8c38-5552b769d385\") " pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" Jul 29 18:39:19.405017 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.404895 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/11a34d1f-bb08-4972-8c38-5552b769d385-secret-grpc-tls\") pod \"thanos-querier-7f4f999b9c-q8h5f\" (UID: \"11a34d1f-bb08-4972-8c38-5552b769d385\") " pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" Jul 29 18:39:19.405017 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.404957 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/11a34d1f-bb08-4972-8c38-5552b769d385-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f4f999b9c-q8h5f\" (UID: \"11a34d1f-bb08-4972-8c38-5552b769d385\") " pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" Jul 29 18:39:19.405017 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.405003 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/11a34d1f-bb08-4972-8c38-5552b769d385-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f4f999b9c-q8h5f\" (UID: \"11a34d1f-bb08-4972-8c38-5552b769d385\") " pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" Jul 29 18:39:19.405253 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.405055 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11a34d1f-bb08-4972-8c38-5552b769d385-metrics-client-ca\") pod \"thanos-querier-7f4f999b9c-q8h5f\" (UID: \"11a34d1f-bb08-4972-8c38-5552b769d385\") " pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" Jul 29 18:39:19.405253 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.405082 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sbxz\" (UniqueName: \"kubernetes.io/projected/11a34d1f-bb08-4972-8c38-5552b769d385-kube-api-access-5sbxz\") pod \"thanos-querier-7f4f999b9c-q8h5f\" (UID: \"11a34d1f-bb08-4972-8c38-5552b769d385\") " pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" Jul 29 18:39:19.405253 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.405118 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11a34d1f-bb08-4972-8c38-5552b769d385-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f4f999b9c-q8h5f\" (UID: \"11a34d1f-bb08-4972-8c38-5552b769d385\") " pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" Jul 29 18:39:19.406540 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.406508 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11a34d1f-bb08-4972-8c38-5552b769d385-metrics-client-ca\") pod \"thanos-querier-7f4f999b9c-q8h5f\" (UID: \"11a34d1f-bb08-4972-8c38-5552b769d385\") " pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" Jul 29 18:39:19.409817 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.409763 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/11a34d1f-bb08-4972-8c38-5552b769d385-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f4f999b9c-q8h5f\" (UID: \"11a34d1f-bb08-4972-8c38-5552b769d385\") " pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" Jul 29 18:39:19.410769 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.410605 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/11a34d1f-bb08-4972-8c38-5552b769d385-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f4f999b9c-q8h5f\" (UID: \"11a34d1f-bb08-4972-8c38-5552b769d385\") " pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" Jul 29 18:39:19.410769 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.410729 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11a34d1f-bb08-4972-8c38-5552b769d385-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f4f999b9c-q8h5f\" (UID: \"11a34d1f-bb08-4972-8c38-5552b769d385\") " pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" Jul 29 18:39:19.410932 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.410785 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11a34d1f-bb08-4972-8c38-5552b769d385-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f4f999b9c-q8h5f\" (UID: \"11a34d1f-bb08-4972-8c38-5552b769d385\") " pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" Jul 29 18:39:19.412280 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.412228 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/11a34d1f-bb08-4972-8c38-5552b769d385-secret-grpc-tls\") pod \"thanos-querier-7f4f999b9c-q8h5f\" (UID: \"11a34d1f-bb08-4972-8c38-5552b769d385\") " pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" Jul 29 18:39:19.414763 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.414722 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/11a34d1f-bb08-4972-8c38-5552b769d385-secret-thanos-querier-tls\") pod \"thanos-querier-7f4f999b9c-q8h5f\" (UID: \"11a34d1f-bb08-4972-8c38-5552b769d385\") " pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" Jul 29 18:39:19.416670 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.416649 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sbxz\" (UniqueName: \"kubernetes.io/projected/11a34d1f-bb08-4972-8c38-5552b769d385-kube-api-access-5sbxz\") pod \"thanos-querier-7f4f999b9c-q8h5f\" (UID: \"11a34d1f-bb08-4972-8c38-5552b769d385\") " pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" Jul 29 18:39:19.529662 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:19.529545 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" Jul 29 18:39:21.974682 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:21.974644 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-8hc7q"] Jul 29 18:39:21.978196 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:21.978176 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8hc7q" Jul 29 18:39:21.980824 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:21.980797 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 29 18:39:21.980923 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:21.980881 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-mlfvh\"" Jul 29 18:39:21.988806 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:21.988779 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-8hc7q"] Jul 29 18:39:22.013120 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.013078 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-559897d849-s9bxv"] Jul 29 18:39:22.016722 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.016699 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559897d849-s9bxv" Jul 29 18:39:22.027800 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.027775 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-559897d849-s9bxv"] Jul 29 18:39:22.030281 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.030255 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vs95\" (UniqueName: \"kubernetes.io/projected/c3001455-5862-4c52-bf35-10e7e907ac15-kube-api-access-6vs95\") pod \"monitoring-plugin-68b7fc9574-8hc7q\" (UID: \"c3001455-5862-4c52-bf35-10e7e907ac15\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8hc7q" Jul 29 18:39:22.030416 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.030314 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c3001455-5862-4c52-bf35-10e7e907ac15-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-8hc7q\" (UID: \"c3001455-5862-4c52-bf35-10e7e907ac15\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8hc7q" Jul 29 18:39:22.131820 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.131786 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/580e8c1a-6550-4bc9-8ef2-ef25883dec93-trusted-ca-bundle\") pod \"console-559897d849-s9bxv\" (UID: \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\") " pod="openshift-console/console-559897d849-s9bxv" Jul 29 18:39:22.131820 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.131827 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/580e8c1a-6550-4bc9-8ef2-ef25883dec93-console-config\") pod \"console-559897d849-s9bxv\" (UID: \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\") " pod="openshift-console/console-559897d849-s9bxv" Jul 29 18:39:22.132064 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.131903 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vs95\" (UniqueName: \"kubernetes.io/projected/c3001455-5862-4c52-bf35-10e7e907ac15-kube-api-access-6vs95\") pod \"monitoring-plugin-68b7fc9574-8hc7q\" (UID: \"c3001455-5862-4c52-bf35-10e7e907ac15\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8hc7q" Jul 29 18:39:22.132064 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.131926 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/580e8c1a-6550-4bc9-8ef2-ef25883dec93-console-oauth-config\") pod \"console-559897d849-s9bxv\" (UID: \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\") " pod="openshift-console/console-559897d849-s9bxv" Jul 29 18:39:22.132064 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.131971 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c3001455-5862-4c52-bf35-10e7e907ac15-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-8hc7q\" (UID: \"c3001455-5862-4c52-bf35-10e7e907ac15\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8hc7q" Jul 29 18:39:22.132064 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.132003 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/580e8c1a-6550-4bc9-8ef2-ef25883dec93-oauth-serving-cert\") pod \"console-559897d849-s9bxv\" (UID: \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\") " pod="openshift-console/console-559897d849-s9bxv" Jul 29 18:39:22.132274 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:39:22.132083 2560 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 29 18:39:22.132274 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.132103 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/580e8c1a-6550-4bc9-8ef2-ef25883dec93-service-ca\") pod \"console-559897d849-s9bxv\" (UID: \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\") " pod="openshift-console/console-559897d849-s9bxv" Jul 29 18:39:22.132274 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:39:22.132133 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3001455-5862-4c52-bf35-10e7e907ac15-monitoring-plugin-cert podName:c3001455-5862-4c52-bf35-10e7e907ac15 nodeName:}" failed. No retries permitted until 2026-07-29 18:39:22.632114587 +0000 UTC m=+313.972221310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/c3001455-5862-4c52-bf35-10e7e907ac15-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-8hc7q" (UID: "c3001455-5862-4c52-bf35-10e7e907ac15") : secret "monitoring-plugin-cert" not found Jul 29 18:39:22.132274 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.132186 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/580e8c1a-6550-4bc9-8ef2-ef25883dec93-console-serving-cert\") pod \"console-559897d849-s9bxv\" (UID: \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\") " pod="openshift-console/console-559897d849-s9bxv" Jul 29 18:39:22.132274 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.132230 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2ppb\" (UniqueName: \"kubernetes.io/projected/580e8c1a-6550-4bc9-8ef2-ef25883dec93-kube-api-access-z2ppb\") pod \"console-559897d849-s9bxv\" (UID: \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\") " pod="openshift-console/console-559897d849-s9bxv" Jul 29 18:39:22.141436 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.141400 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vs95\" (UniqueName: \"kubernetes.io/projected/c3001455-5862-4c52-bf35-10e7e907ac15-kube-api-access-6vs95\") pod \"monitoring-plugin-68b7fc9574-8hc7q\" (UID: \"c3001455-5862-4c52-bf35-10e7e907ac15\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8hc7q" Jul 29 18:39:22.233243 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.233143 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/580e8c1a-6550-4bc9-8ef2-ef25883dec93-trusted-ca-bundle\") pod \"console-559897d849-s9bxv\" (UID: \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\") " pod="openshift-console/console-559897d849-s9bxv" Jul 29 18:39:22.233243 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.233191 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/580e8c1a-6550-4bc9-8ef2-ef25883dec93-console-config\") pod \"console-559897d849-s9bxv\" (UID: \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\") " pod="openshift-console/console-559897d849-s9bxv" Jul 29 18:39:22.233488 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.233383 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/580e8c1a-6550-4bc9-8ef2-ef25883dec93-console-oauth-config\") pod \"console-559897d849-s9bxv\" (UID: \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\") " pod="openshift-console/console-559897d849-s9bxv" Jul 29 18:39:22.233586 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.233533 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/580e8c1a-6550-4bc9-8ef2-ef25883dec93-oauth-serving-cert\") pod \"console-559897d849-s9bxv\" (UID: \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\") " pod="openshift-console/console-559897d849-s9bxv" Jul 29 18:39:22.233645 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.233625 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/580e8c1a-6550-4bc9-8ef2-ef25883dec93-service-ca\") pod \"console-559897d849-s9bxv\" (UID: \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\") " pod="openshift-console/console-559897d849-s9bxv" Jul 29 18:39:22.233697 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.233683 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/580e8c1a-6550-4bc9-8ef2-ef25883dec93-console-serving-cert\") pod \"console-559897d849-s9bxv\" (UID: \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\") " pod="openshift-console/console-559897d849-s9bxv" Jul 29 18:39:22.233746 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.233732 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2ppb\" (UniqueName: \"kubernetes.io/projected/580e8c1a-6550-4bc9-8ef2-ef25883dec93-kube-api-access-z2ppb\") pod \"console-559897d849-s9bxv\" (UID: \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\") " pod="openshift-console/console-559897d849-s9bxv" Jul 29 18:39:22.234104 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.234055 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/580e8c1a-6550-4bc9-8ef2-ef25883dec93-console-config\") pod \"console-559897d849-s9bxv\" (UID: \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\") " pod="openshift-console/console-559897d849-s9bxv" Jul 29 18:39:22.234354 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.234325 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/580e8c1a-6550-4bc9-8ef2-ef25883dec93-oauth-serving-cert\") pod \"console-559897d849-s9bxv\" (UID: \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\") " pod="openshift-console/console-559897d849-s9bxv" Jul 29 18:39:22.234959 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.234916 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/580e8c1a-6550-4bc9-8ef2-ef25883dec93-trusted-ca-bundle\") pod \"console-559897d849-s9bxv\" (UID: \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\") " pod="openshift-console/console-559897d849-s9bxv" Jul 29 18:39:22.235080 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.235056 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/580e8c1a-6550-4bc9-8ef2-ef25883dec93-service-ca\") pod \"console-559897d849-s9bxv\" (UID: \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\") " pod="openshift-console/console-559897d849-s9bxv" Jul 29 18:39:22.236347 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.236324 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/580e8c1a-6550-4bc9-8ef2-ef25883dec93-console-oauth-config\") pod \"console-559897d849-s9bxv\" (UID: \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\") " pod="openshift-console/console-559897d849-s9bxv" Jul 29 18:39:22.236483 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.236415 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/580e8c1a-6550-4bc9-8ef2-ef25883dec93-console-serving-cert\") pod \"console-559897d849-s9bxv\" (UID: \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\") " pod="openshift-console/console-559897d849-s9bxv" Jul 29 18:39:22.243083 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.243034 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2ppb\" (UniqueName: \"kubernetes.io/projected/580e8c1a-6550-4bc9-8ef2-ef25883dec93-kube-api-access-z2ppb\") pod \"console-559897d849-s9bxv\" (UID: \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\") " pod="openshift-console/console-559897d849-s9bxv" Jul 29 18:39:22.328546 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.328507 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559897d849-s9bxv" Jul 29 18:39:22.438905 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.438870 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5d976fc754-4z9b2"] Jul 29 18:39:22.442346 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.442324 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5d976fc754-4z9b2" Jul 29 18:39:22.445244 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.445221 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 29 18:39:22.445380 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.445323 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 29 18:39:22.445634 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.445615 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 29 18:39:22.445699 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.445621 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 29 18:39:22.445765 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.445672 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-vhrd8\"" Jul 29 18:39:22.446007 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.445989 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 29 18:39:22.450875 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.450849 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 29 18:39:22.456845 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.456819 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5d976fc754-4z9b2"] Jul 29 18:39:22.537102 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.537019 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/55b67a4d-5ec7-48d8-8b08-569f229fb028-secret-telemeter-client\") pod \"telemeter-client-5d976fc754-4z9b2\" (UID: \"55b67a4d-5ec7-48d8-8b08-569f229fb028\") " pod="openshift-monitoring/telemeter-client-5d976fc754-4z9b2" Jul 29 18:39:22.537102 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.537074 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55b67a4d-5ec7-48d8-8b08-569f229fb028-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d976fc754-4z9b2\" (UID: \"55b67a4d-5ec7-48d8-8b08-569f229fb028\") " pod="openshift-monitoring/telemeter-client-5d976fc754-4z9b2" Jul 29 18:39:22.537346 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.537102 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/55b67a4d-5ec7-48d8-8b08-569f229fb028-federate-client-tls\") pod \"telemeter-client-5d976fc754-4z9b2\" (UID: \"55b67a4d-5ec7-48d8-8b08-569f229fb028\") " pod="openshift-monitoring/telemeter-client-5d976fc754-4z9b2" Jul 29 18:39:22.537346 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.537134 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/55b67a4d-5ec7-48d8-8b08-569f229fb028-telemeter-client-tls\") pod \"telemeter-client-5d976fc754-4z9b2\" (UID: \"55b67a4d-5ec7-48d8-8b08-569f229fb028\") " pod="openshift-monitoring/telemeter-client-5d976fc754-4z9b2" Jul 29 18:39:22.537346 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.537172 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55b67a4d-5ec7-48d8-8b08-569f229fb028-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d976fc754-4z9b2\" (UID: \"55b67a4d-5ec7-48d8-8b08-569f229fb028\") " pod="openshift-monitoring/telemeter-client-5d976fc754-4z9b2" Jul 29 18:39:22.537346 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.537211 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55b67a4d-5ec7-48d8-8b08-569f229fb028-metrics-client-ca\") pod \"telemeter-client-5d976fc754-4z9b2\" (UID: \"55b67a4d-5ec7-48d8-8b08-569f229fb028\") " pod="openshift-monitoring/telemeter-client-5d976fc754-4z9b2" Jul 29 18:39:22.537346 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.537250 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55b67a4d-5ec7-48d8-8b08-569f229fb028-serving-certs-ca-bundle\") pod \"telemeter-client-5d976fc754-4z9b2\" (UID: \"55b67a4d-5ec7-48d8-8b08-569f229fb028\") " pod="openshift-monitoring/telemeter-client-5d976fc754-4z9b2" Jul 29 18:39:22.537346 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.537315 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9js8z\" (UniqueName: \"kubernetes.io/projected/55b67a4d-5ec7-48d8-8b08-569f229fb028-kube-api-access-9js8z\") pod \"telemeter-client-5d976fc754-4z9b2\" (UID: \"55b67a4d-5ec7-48d8-8b08-569f229fb028\") " pod="openshift-monitoring/telemeter-client-5d976fc754-4z9b2" Jul 29 18:39:22.638304 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.638266 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55b67a4d-5ec7-48d8-8b08-569f229fb028-metrics-client-ca\") pod \"telemeter-client-5d976fc754-4z9b2\" (UID: \"55b67a4d-5ec7-48d8-8b08-569f229fb028\") " pod="openshift-monitoring/telemeter-client-5d976fc754-4z9b2" Jul 29 18:39:22.638496 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.638316 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55b67a4d-5ec7-48d8-8b08-569f229fb028-serving-certs-ca-bundle\") pod \"telemeter-client-5d976fc754-4z9b2\" (UID: \"55b67a4d-5ec7-48d8-8b08-569f229fb028\") " pod="openshift-monitoring/telemeter-client-5d976fc754-4z9b2" Jul 29 18:39:22.638496 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.638342 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9js8z\" (UniqueName: \"kubernetes.io/projected/55b67a4d-5ec7-48d8-8b08-569f229fb028-kube-api-access-9js8z\") pod \"telemeter-client-5d976fc754-4z9b2\" (UID: \"55b67a4d-5ec7-48d8-8b08-569f229fb028\") " pod="openshift-monitoring/telemeter-client-5d976fc754-4z9b2" Jul 29 18:39:22.638496 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.638384 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c3001455-5862-4c52-bf35-10e7e907ac15-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-8hc7q\" (UID: \"c3001455-5862-4c52-bf35-10e7e907ac15\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8hc7q" Jul 29 18:39:22.638496 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.638430 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/55b67a4d-5ec7-48d8-8b08-569f229fb028-secret-telemeter-client\") pod \"telemeter-client-5d976fc754-4z9b2\" (UID: \"55b67a4d-5ec7-48d8-8b08-569f229fb028\") " pod="openshift-monitoring/telemeter-client-5d976fc754-4z9b2" Jul 29 18:39:22.638496 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.638464 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55b67a4d-5ec7-48d8-8b08-569f229fb028-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d976fc754-4z9b2\" (UID: \"55b67a4d-5ec7-48d8-8b08-569f229fb028\") " pod="openshift-monitoring/telemeter-client-5d976fc754-4z9b2" Jul 29 18:39:22.638496 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.638492 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/55b67a4d-5ec7-48d8-8b08-569f229fb028-federate-client-tls\") pod \"telemeter-client-5d976fc754-4z9b2\" (UID: \"55b67a4d-5ec7-48d8-8b08-569f229fb028\") " pod="openshift-monitoring/telemeter-client-5d976fc754-4z9b2" Jul 29 18:39:22.638850 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.638519 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/55b67a4d-5ec7-48d8-8b08-569f229fb028-telemeter-client-tls\") pod \"telemeter-client-5d976fc754-4z9b2\" (UID: \"55b67a4d-5ec7-48d8-8b08-569f229fb028\") " pod="openshift-monitoring/telemeter-client-5d976fc754-4z9b2" Jul 29 18:39:22.638850 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.638575 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55b67a4d-5ec7-48d8-8b08-569f229fb028-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d976fc754-4z9b2\" (UID: \"55b67a4d-5ec7-48d8-8b08-569f229fb028\") " pod="openshift-monitoring/telemeter-client-5d976fc754-4z9b2" Jul 29 18:39:22.639232 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.639161 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55b67a4d-5ec7-48d8-8b08-569f229fb028-metrics-client-ca\") pod \"telemeter-client-5d976fc754-4z9b2\" (UID: \"55b67a4d-5ec7-48d8-8b08-569f229fb028\") " pod="openshift-monitoring/telemeter-client-5d976fc754-4z9b2" Jul 29 18:39:22.639232 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.639169 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55b67a4d-5ec7-48d8-8b08-569f229fb028-serving-certs-ca-bundle\") pod \"telemeter-client-5d976fc754-4z9b2\" (UID: \"55b67a4d-5ec7-48d8-8b08-569f229fb028\") " pod="openshift-monitoring/telemeter-client-5d976fc754-4z9b2" Jul 29 18:39:22.639614 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.639592 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55b67a4d-5ec7-48d8-8b08-569f229fb028-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d976fc754-4z9b2\" (UID: \"55b67a4d-5ec7-48d8-8b08-569f229fb028\") " pod="openshift-monitoring/telemeter-client-5d976fc754-4z9b2" Jul 29 18:39:22.641717 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.641672 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55b67a4d-5ec7-48d8-8b08-569f229fb028-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d976fc754-4z9b2\" (UID: \"55b67a4d-5ec7-48d8-8b08-569f229fb028\") " pod="openshift-monitoring/telemeter-client-5d976fc754-4z9b2" Jul 29 18:39:22.641810 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.641717 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/55b67a4d-5ec7-48d8-8b08-569f229fb028-secret-telemeter-client\") pod \"telemeter-client-5d976fc754-4z9b2\" (UID: \"55b67a4d-5ec7-48d8-8b08-569f229fb028\") " pod="openshift-monitoring/telemeter-client-5d976fc754-4z9b2" Jul 29 18:39:22.641868 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.641846 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/55b67a4d-5ec7-48d8-8b08-569f229fb028-federate-client-tls\") pod \"telemeter-client-5d976fc754-4z9b2\" (UID: \"55b67a4d-5ec7-48d8-8b08-569f229fb028\") " pod="openshift-monitoring/telemeter-client-5d976fc754-4z9b2" Jul 29 18:39:22.642271 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.642251 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/55b67a4d-5ec7-48d8-8b08-569f229fb028-telemeter-client-tls\") pod \"telemeter-client-5d976fc754-4z9b2\" (UID: \"55b67a4d-5ec7-48d8-8b08-569f229fb028\") " pod="openshift-monitoring/telemeter-client-5d976fc754-4z9b2" Jul 29 18:39:22.642271 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.642265 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c3001455-5862-4c52-bf35-10e7e907ac15-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-8hc7q\" (UID: \"c3001455-5862-4c52-bf35-10e7e907ac15\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8hc7q" Jul 29 18:39:22.648118 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.648092 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9js8z\" (UniqueName: \"kubernetes.io/projected/55b67a4d-5ec7-48d8-8b08-569f229fb028-kube-api-access-9js8z\") pod \"telemeter-client-5d976fc754-4z9b2\" (UID: \"55b67a4d-5ec7-48d8-8b08-569f229fb028\") " pod="openshift-monitoring/telemeter-client-5d976fc754-4z9b2" Jul 29 18:39:22.754495 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.754452 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5d976fc754-4z9b2" Jul 29 18:39:22.891062 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:22.890980 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8hc7q" Jul 29 18:39:23.480157 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.480120 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 18:39:23.487638 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.486244 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.491597 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.491526 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 29 18:39:23.491919 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.491895 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 29 18:39:23.492032 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.491985 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 29 18:39:23.492032 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.491898 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 29 18:39:23.492130 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.491908 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 29 18:39:23.492183 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.492160 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 29 18:39:23.492310 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.492288 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 29 18:39:23.492824 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.492802 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a8tqnj8r6roh6\"" Jul 29 18:39:23.492917 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.492903 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 29 18:39:23.493408 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.493374 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 29 18:39:23.493643 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.493546 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 29 18:39:23.497115 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.493458 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-k7jqr\"" Jul 29 18:39:23.497115 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.493497 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 29 18:39:23.497225 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.493650 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 29 18:39:23.497225 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.493375 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 29 18:39:23.500728 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.500710 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 29 18:39:23.500868 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.500797 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 18:39:23.501572 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.501538 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 29 18:39:23.547872 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.547832 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-config-out\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.548042 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.547882 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.548042 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.547937 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.548042 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.547993 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.548042 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.548024 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-config\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.548210 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.548055 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.548210 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.548082 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.548210 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.548108 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.548210 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.548135 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.548210 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.548170 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.548407 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.548247 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-web-config\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.548407 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.548275 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.548407 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.548298 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.548407 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.548360 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.548407 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.548395 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.548626 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.548420 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.548626 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.548446 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.548626 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.548469 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.548626 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.548491 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.548626 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.548545 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhdvp\" (UniqueName: \"kubernetes.io/projected/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-kube-api-access-vhdvp\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.649075 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.649032 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.649258 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.649089 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.649258 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.649121 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-config\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.649258 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.649148 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.649258 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.649170 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.649258 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.649193 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.649258 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.649218 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.649258 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.649249 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.649658 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.649410 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-web-config\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.649658 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.649470 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.649658 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.649502 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.649658 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.649591 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.649658 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.649630 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.649658 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.649657 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.649932 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.649680 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.649932 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.649702 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.649932 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.649729 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.649932 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.649758 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhdvp\" (UniqueName: \"kubernetes.io/projected/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-kube-api-access-vhdvp\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.649932 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.649804 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-config-out\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.649932 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.649827 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.650250 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.650230 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.652727 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.652700 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.652989 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.652967 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.652989 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.652994 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.653581 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.653359 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-config\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.653701 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.653652 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.654106 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.654078 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.654204 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.654124 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.654343 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.654321 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.654849 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.654638 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.654849 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.654642 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.654849 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.654817 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-config-out\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.655043 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.654966 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.655874 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.655858 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.656420 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.656393 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.657404 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.657379 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-web-config\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.657758 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.657717 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.657875 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.657855 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.658670 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.658646 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.659995 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.659975 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhdvp\" (UniqueName: \"kubernetes.io/projected/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-kube-api-access-vhdvp\") pod \"prometheus-k8s-0\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:23.802414 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:23.802160 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:29.545205 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:29.545177 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-559897d849-s9bxv"] Jul 29 18:39:29.547436 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:39:29.547170 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod580e8c1a_6550_4bc9_8ef2_ef25883dec93.slice/crio-0c88ed0c47016df1d5b8bef804883bf7542d205e813908e0dc477143ab1f38a3 WatchSource:0}: Error finding container 0c88ed0c47016df1d5b8bef804883bf7542d205e813908e0dc477143ab1f38a3: Status 404 returned error can't find the container with id 0c88ed0c47016df1d5b8bef804883bf7542d205e813908e0dc477143ab1f38a3 Jul 29 18:39:29.585515 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:29.578897 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5d976fc754-4z9b2"] Jul 29 18:39:29.591073 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:29.586700 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7cc9cc4c87-kfccg"] Jul 29 18:39:29.600931 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:39:29.600667 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55b67a4d_5ec7_48d8_8b08_569f229fb028.slice/crio-bdcc5f1a60295bd0e0634063ec2d519e68214d9c4ba26f6f73465f55d19445a6 WatchSource:0}: Error finding container bdcc5f1a60295bd0e0634063ec2d519e68214d9c4ba26f6f73465f55d19445a6: Status 404 returned error can't find the container with id bdcc5f1a60295bd0e0634063ec2d519e68214d9c4ba26f6f73465f55d19445a6 Jul 29 18:39:29.609922 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:29.609895 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f"] Jul 29 18:39:29.620650 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:29.620625 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-8hc7q"] Jul 29 18:39:29.625990 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:39:29.625946 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3001455_5862_4c52_bf35_10e7e907ac15.slice/crio-1cd124ff7ff61e60de9edba76d1bad7a6db0ab48e84a88e3b0a9407ee712ab8e WatchSource:0}: Error finding container 1cd124ff7ff61e60de9edba76d1bad7a6db0ab48e84a88e3b0a9407ee712ab8e: Status 404 returned error can't find the container with id 1cd124ff7ff61e60de9edba76d1bad7a6db0ab48e84a88e3b0a9407ee712ab8e Jul 29 18:39:29.777194 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:29.777154 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 18:39:29.780519 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:39:29.780487 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbba7aab3_8f0f_425d_8c68_cdf897b8a3fa.slice/crio-cf6ff0aa7d0785668fb3cfff1f32ab7171c7b0c9fd7848352c092d8f8aa6cb61 WatchSource:0}: Error finding container cf6ff0aa7d0785668fb3cfff1f32ab7171c7b0c9fd7848352c092d8f8aa6cb61: Status 404 returned error can't find the container with id cf6ff0aa7d0785668fb3cfff1f32ab7171c7b0c9fd7848352c092d8f8aa6cb61 Jul 29 18:39:30.412087 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:30.411063 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f45d7dd6-jhv6n" event={"ID":"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447","Type":"ContainerStarted","Data":"95f6e72934dfbf22c6796f63a2ad95d595bc8e5682587c9b7cbe47bbd7cd2dde"} Jul 29 18:39:30.420997 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:30.420938 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" event={"ID":"11a34d1f-bb08-4972-8c38-5552b769d385","Type":"ContainerStarted","Data":"4a84d2dd286cc7486ef1f89d5ca03a927785e9821669bb9a844f401d454d3914"} Jul 29 18:39:30.425832 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:30.425740 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-nqxhp" event={"ID":"a6d09fb3-550c-4079-aac6-29efc75fb8f3","Type":"ContainerStarted","Data":"2897ab9f6a51eac4efb621f1a006e9b64982ff584e6ab4d9486cedfbb583df4b"} Jul 29 18:39:30.426877 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:30.426792 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-nqxhp" Jul 29 18:39:30.432081 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:30.431152 2560 generic.go:356] "Generic (PLEG): container finished" podID="58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c" containerID="ed31c49dbdb177078d877cd69d158ef1187324d478ef7151dddb89f3bd09c5df" exitCode=0 Jul 29 18:39:30.432081 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:30.431260 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xnj4k" event={"ID":"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c","Type":"ContainerDied","Data":"ed31c49dbdb177078d877cd69d158ef1187324d478ef7151dddb89f3bd09c5df"} Jul 29 18:39:30.436508 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:30.436451 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa","Type":"ContainerStarted","Data":"cf6ff0aa7d0785668fb3cfff1f32ab7171c7b0c9fd7848352c092d8f8aa6cb61"} Jul 29 18:39:30.439442 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:30.439323 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8hc7q" event={"ID":"c3001455-5862-4c52-bf35-10e7e907ac15","Type":"ContainerStarted","Data":"1cd124ff7ff61e60de9edba76d1bad7a6db0ab48e84a88e3b0a9407ee712ab8e"} Jul 29 18:39:30.442303 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:30.442019 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-nqxhp" Jul 29 18:39:30.442773 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:30.442618 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84f45d7dd6-jhv6n" podStartSLOduration=2.217602156 podStartE2EDuration="13.442600926s" totalImagesPullingTime="11.22499877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:39:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:39:30.43805529 +0000 UTC m=+321.778162037" watchObservedRunningTime="2026-07-29 18:39:30.442600926 +0000 UTC m=+321.782707673" Jul 29 18:39:30.451589 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:30.451136 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559897d849-s9bxv" event={"ID":"580e8c1a-6550-4bc9-8ef2-ef25883dec93","Type":"ContainerStarted","Data":"c6397f37f8ddd2c2924c91655c860cd03171b9571389a3bfd60a0664c57aaf63"} Jul 29 18:39:30.451589 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:30.451196 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559897d849-s9bxv" event={"ID":"580e8c1a-6550-4bc9-8ef2-ef25883dec93","Type":"ContainerStarted","Data":"0c88ed0c47016df1d5b8bef804883bf7542d205e813908e0dc477143ab1f38a3"} Jul 29 18:39:30.455528 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:30.455474 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-nqxhp" podStartSLOduration=4.048612529 podStartE2EDuration="25.455455063s" totalImagesPullingTime="21.406842534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:39:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:39:30.4551356 +0000 UTC m=+321.795242348" watchObservedRunningTime="2026-07-29 18:39:30.455455063 +0000 UTC m=+321.795561810" Jul 29 18:39:30.458594 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:30.458379 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d976fc754-4z9b2" event={"ID":"55b67a4d-5ec7-48d8-8b08-569f229fb028","Type":"ContainerStarted","Data":"bdcc5f1a60295bd0e0634063ec2d519e68214d9c4ba26f6f73465f55d19445a6"} Jul 29 18:39:30.467067 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:30.466412 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n28r7" event={"ID":"1f6ff8c3-1d67-484f-af65-1f4b773b7d9c","Type":"ContainerStarted","Data":"e7c70ee4442eae5f0ac56dc96b53c1390b4b0d5aa1ab55c25c1bed36cf0c6b57"} Jul 29 18:39:30.534739 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:30.534681 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n28r7" podStartSLOduration=2.728378285 podStartE2EDuration="13.534660136s" totalImagesPullingTime="10.806281851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:39:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:39:30.533573738 +0000 UTC m=+321.873680483" watchObservedRunningTime="2026-07-29 18:39:30.534660136 +0000 UTC m=+321.874766886" Jul 29 18:39:31.480715 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:31.480621 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xnj4k" event={"ID":"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c","Type":"ContainerStarted","Data":"005a602cc9cdf17579ca17b2f1676d0d81bdd1c295e767704b8100132031de9d"} Jul 29 18:39:31.480715 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:31.480674 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xnj4k" event={"ID":"58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c","Type":"ContainerStarted","Data":"78893a4ae79391957908523d9ab742a9528a915404779ac6f156b7a609b0254d"} Jul 29 18:39:31.504131 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:31.503815 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xnj4k" podStartSLOduration=3.314957743 podStartE2EDuration="14.503790808s" totalImagesPullingTime="11.056347144s" totalInitContainerRuntime="132.485921ms" isStatefulPod=true podCreationTimestamp="2026-07-29 18:39:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:39:31.50066926 +0000 UTC m=+322.840776006" watchObservedRunningTime="2026-07-29 18:39:31.503790808 +0000 UTC m=+322.843897554" Jul 29 18:39:31.504131 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:31.503995 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-559897d849-s9bxv" podStartSLOduration=10.50398496 podStartE2EDuration="10.50398496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:39:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:39:30.567922827 +0000 UTC m=+321.908029572" watchObservedRunningTime="2026-07-29 18:39:31.50398496 +0000 UTC m=+322.844091713" Jul 29 18:39:32.328799 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:32.328682 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-559897d849-s9bxv" Jul 29 18:39:32.328799 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:32.328764 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-559897d849-s9bxv" Jul 29 18:39:32.335099 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:32.335065 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-559897d849-s9bxv" Jul 29 18:39:32.495208 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:32.495174 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-559897d849-s9bxv" Jul 29 18:39:32.556853 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:32.556820 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84f45d7dd6-jhv6n"] Jul 29 18:39:35.503164 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:35.503122 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" event={"ID":"11a34d1f-bb08-4972-8c38-5552b769d385","Type":"ContainerStarted","Data":"4e807bd5b5e4731576a11ff463062d866f1d080391b346d953a3c701876d01eb"} Jul 29 18:39:35.503729 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:35.503212 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" event={"ID":"11a34d1f-bb08-4972-8c38-5552b769d385","Type":"ContainerStarted","Data":"cc9b3fcfba18d891a9b0037977940fde67a6c7bfabf7a65a92c24130f44d130f"} Jul 29 18:39:35.503729 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:35.503251 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" event={"ID":"11a34d1f-bb08-4972-8c38-5552b769d385","Type":"ContainerStarted","Data":"6645032e072b21a1a5b9b575ff47277b0faefa3f853920c2edcfde6ff9cab153"} Jul 29 18:39:35.505001 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:35.504970 2560 generic.go:356] "Generic (PLEG): container finished" podID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerID="13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94" exitCode=0 Jul 29 18:39:35.505127 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:35.505046 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa","Type":"ContainerDied","Data":"13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94"} Jul 29 18:39:35.506881 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:35.506853 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8hc7q" event={"ID":"c3001455-5862-4c52-bf35-10e7e907ac15","Type":"ContainerStarted","Data":"92e2692e1489227604fc3630ad03ef40c522a0d6d14fde164f38722fe0344d05"} Jul 29 18:39:35.507087 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:35.507063 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8hc7q" Jul 29 18:39:35.510072 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:35.510045 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d976fc754-4z9b2" event={"ID":"55b67a4d-5ec7-48d8-8b08-569f229fb028","Type":"ContainerStarted","Data":"dd335098365def1e4fcbd554f6849424469e013cd0d62a239f54e24a731fcfad"} Jul 29 18:39:35.510155 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:35.510098 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d976fc754-4z9b2" event={"ID":"55b67a4d-5ec7-48d8-8b08-569f229fb028","Type":"ContainerStarted","Data":"3355a30917f97429ac3c3b4832d972c861e44d32b7fe6a55b8ba36fd7a803d2f"} Jul 29 18:39:35.510155 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:35.510125 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d976fc754-4z9b2" event={"ID":"55b67a4d-5ec7-48d8-8b08-569f229fb028","Type":"ContainerStarted","Data":"c8eb90eb1480c7c2e829da1b3d15264e783cc38800907873c14f0788ab7eaec7"} Jul 29 18:39:35.513363 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:35.513336 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8hc7q" Jul 29 18:39:35.567823 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:35.567760 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8hc7q" podStartSLOduration=9.658666466 podStartE2EDuration="14.567738428s" totalImagesPullingTime="4.909071962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:39:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:39:35.565615507 +0000 UTC m=+326.905722252" watchObservedRunningTime="2026-07-29 18:39:35.567738428 +0000 UTC m=+326.907845176" Jul 29 18:39:35.591171 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:35.590118 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5d976fc754-4z9b2" podStartSLOduration=8.655631856 podStartE2EDuration="13.59009713s" totalImagesPullingTime="4.934465274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:39:35.588358935 +0000 UTC m=+326.928465718" watchObservedRunningTime="2026-07-29 18:39:35.59009713 +0000 UTC m=+326.930203879" Jul 29 18:39:36.523151 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:36.522792 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" event={"ID":"11a34d1f-bb08-4972-8c38-5552b769d385","Type":"ContainerStarted","Data":"5e6d5a226e7baed93f2ff133a54cdb13acc47ea91bd6cc4182657794a668dc58"} Jul 29 18:39:37.534770 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:37.534649 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" event={"ID":"11a34d1f-bb08-4972-8c38-5552b769d385","Type":"ContainerStarted","Data":"8e5d2e622b98dfd1e9874c2ad7cb226be8b3c7c44e9dc1af0f2a263f000fb6aa"} Jul 29 18:39:37.535412 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:37.535383 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" event={"ID":"11a34d1f-bb08-4972-8c38-5552b769d385","Type":"ContainerStarted","Data":"cddfbed28ee4c296f8ccb2ebf72cf79160f1255a2c4283a7f6802045d2b3da19"} Jul 29 18:39:37.535677 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:37.535644 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" Jul 29 18:39:37.562100 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:37.562027 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" podStartSLOduration=12.340297526 podStartE2EDuration="18.562002564s" totalImagesPullingTime="6.221705038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:39:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:39:37.559451149 +0000 UTC m=+328.899557895" watchObservedRunningTime="2026-07-29 18:39:37.562002564 +0000 UTC m=+328.902109311" Jul 29 18:39:37.932213 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:37.932087 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84f45d7dd6-jhv6n" Jul 29 18:39:40.558605 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:40.558571 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa","Type":"ContainerStarted","Data":"276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c"} Jul 29 18:39:40.558997 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:40.558661 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa","Type":"ContainerStarted","Data":"9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6"} Jul 29 18:39:40.558997 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:40.558704 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa","Type":"ContainerStarted","Data":"d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f"} Jul 29 18:39:40.558997 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:40.558734 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa","Type":"ContainerStarted","Data":"1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a"} Jul 29 18:39:40.558997 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:40.558759 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa","Type":"ContainerStarted","Data":"aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a"} Jul 29 18:39:40.558997 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:40.558792 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa","Type":"ContainerStarted","Data":"99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c"} Jul 29 18:39:40.588776 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:40.588716 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=8.571479856 podStartE2EDuration="17.58869409s" totalImagesPullingTime="8.988191896s" totalInitContainerRuntime="29.022338ms" isStatefulPod=false podCreationTimestamp="2026-07-29 18:39:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:39:40.586988598 +0000 UTC m=+331.927095342" watchObservedRunningTime="2026-07-29 18:39:40.58869409 +0000 UTC m=+331.928800836" Jul 29 18:39:43.546546 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:43.546517 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7f4f999b9c-q8h5f" Jul 29 18:39:43.802654 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:43.802549 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:39:49.076169 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:49.076137 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-559897d849-s9bxv"] Jul 29 18:39:51.609198 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:51.609167 2560 generic.go:356] "Generic (PLEG): container finished" podID="e63b8244-092b-4e01-b975-3fde603facf0" containerID="7fcf55bebe919881447242b2e742a13af04bf5182725f61955b8c55a623a3406" exitCode=0 Jul 29 18:39:51.609616 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:51.609213 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xgr5t" event={"ID":"e63b8244-092b-4e01-b975-3fde603facf0","Type":"ContainerDied","Data":"7fcf55bebe919881447242b2e742a13af04bf5182725f61955b8c55a623a3406"} Jul 29 18:39:51.609616 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:51.609530 2560 scope.go:117] "RemoveContainer" containerID="7fcf55bebe919881447242b2e742a13af04bf5182725f61955b8c55a623a3406" Jul 29 18:39:52.622713 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:52.622674 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xgr5t" event={"ID":"e63b8244-092b-4e01-b975-3fde603facf0","Type":"ContainerStarted","Data":"33d54d37adc4d524e22100d3bb3fb2ca60bf05b2f863dea3aaad9c151797587c"} Jul 29 18:39:54.619665 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:54.619615 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" podUID="0c4b0ad6-e876-4580-841c-91a36f53a0f8" containerName="registry" containerID="cri-o://ccbc8fa7534eaeb643ca3c56aed01751d2a619020b012eb546973342cbee923a" gracePeriod=30 Jul 29 18:39:54.914274 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:54.914235 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:39:54.978846 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:54.978817 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0c4b0ad6-e876-4580-841c-91a36f53a0f8-installation-pull-secrets\") pod \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " Jul 29 18:39:54.979044 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:54.978872 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28c92\" (UniqueName: \"kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-kube-api-access-28c92\") pod \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " Jul 29 18:39:54.979044 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:54.978895 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls\") pod \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " Jul 29 18:39:54.979044 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:54.978923 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0c4b0ad6-e876-4580-841c-91a36f53a0f8-image-registry-private-configuration\") pod \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " Jul 29 18:39:54.979044 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:54.978975 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-bound-sa-token\") pod \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " Jul 29 18:39:54.979044 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:54.978992 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0c4b0ad6-e876-4580-841c-91a36f53a0f8-ca-trust-extracted\") pod \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " Jul 29 18:39:54.979044 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:54.979024 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-certificates\") pod \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " Jul 29 18:39:54.979362 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:54.979073 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0c4b0ad6-e876-4580-841c-91a36f53a0f8-trusted-ca\") pod \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\" (UID: \"0c4b0ad6-e876-4580-841c-91a36f53a0f8\") " Jul 29 18:39:54.979510 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:54.979477 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0c4b0ad6-e876-4580-841c-91a36f53a0f8" (UID: "0c4b0ad6-e876-4580-841c-91a36f53a0f8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:39:54.979732 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:54.979684 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c4b0ad6-e876-4580-841c-91a36f53a0f8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0c4b0ad6-e876-4580-841c-91a36f53a0f8" (UID: "0c4b0ad6-e876-4580-841c-91a36f53a0f8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:39:54.981509 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:54.981439 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c4b0ad6-e876-4580-841c-91a36f53a0f8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0c4b0ad6-e876-4580-841c-91a36f53a0f8" (UID: "0c4b0ad6-e876-4580-841c-91a36f53a0f8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:39:54.981509 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:54.981501 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0c4b0ad6-e876-4580-841c-91a36f53a0f8" (UID: "0c4b0ad6-e876-4580-841c-91a36f53a0f8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 18:39:54.981681 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:54.981614 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-kube-api-access-28c92" (OuterVolumeSpecName: "kube-api-access-28c92") pod "0c4b0ad6-e876-4580-841c-91a36f53a0f8" (UID: "0c4b0ad6-e876-4580-841c-91a36f53a0f8"). InnerVolumeSpecName "kube-api-access-28c92". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 18:39:54.981681 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:54.981628 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c4b0ad6-e876-4580-841c-91a36f53a0f8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0c4b0ad6-e876-4580-841c-91a36f53a0f8" (UID: "0c4b0ad6-e876-4580-841c-91a36f53a0f8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:39:54.981788 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:54.981777 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0c4b0ad6-e876-4580-841c-91a36f53a0f8" (UID: "0c4b0ad6-e876-4580-841c-91a36f53a0f8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 18:39:54.987445 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:54.987414 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c4b0ad6-e876-4580-841c-91a36f53a0f8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0c4b0ad6-e876-4580-841c-91a36f53a0f8" (UID: "0c4b0ad6-e876-4580-841c-91a36f53a0f8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 18:39:55.080922 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:55.080884 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0c4b0ad6-e876-4580-841c-91a36f53a0f8-trusted-ca\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:39:55.081173 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:55.081154 2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0c4b0ad6-e876-4580-841c-91a36f53a0f8-installation-pull-secrets\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:39:55.081272 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:55.081260 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28c92\" (UniqueName: \"kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-kube-api-access-28c92\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:39:55.081354 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:55.081343 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-tls\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:39:55.081434 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:55.081423 2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0c4b0ad6-e876-4580-841c-91a36f53a0f8-image-registry-private-configuration\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:39:55.081537 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:55.081524 2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c4b0ad6-e876-4580-841c-91a36f53a0f8-bound-sa-token\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:39:55.081653 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:55.081642 2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0c4b0ad6-e876-4580-841c-91a36f53a0f8-ca-trust-extracted\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:39:55.081735 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:55.081724 2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0c4b0ad6-e876-4580-841c-91a36f53a0f8-registry-certificates\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:39:55.638052 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:55.637958 2560 generic.go:356] "Generic (PLEG): container finished" podID="0c4b0ad6-e876-4580-841c-91a36f53a0f8" containerID="ccbc8fa7534eaeb643ca3c56aed01751d2a619020b012eb546973342cbee923a" exitCode=0 Jul 29 18:39:55.638052 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:55.638004 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" Jul 29 18:39:55.638052 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:55.638038 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" event={"ID":"0c4b0ad6-e876-4580-841c-91a36f53a0f8","Type":"ContainerDied","Data":"ccbc8fa7534eaeb643ca3c56aed01751d2a619020b012eb546973342cbee923a"} Jul 29 18:39:55.638655 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:55.638086 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cc9cc4c87-kfccg" event={"ID":"0c4b0ad6-e876-4580-841c-91a36f53a0f8","Type":"ContainerDied","Data":"7f773a3bdd1375eec5a5dcfd440d612662a8d78075e5e28757d024c902ac63e8"} Jul 29 18:39:55.638655 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:55.638118 2560 scope.go:117] "RemoveContainer" containerID="ccbc8fa7534eaeb643ca3c56aed01751d2a619020b012eb546973342cbee923a" Jul 29 18:39:55.646858 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:55.646841 2560 scope.go:117] "RemoveContainer" containerID="ccbc8fa7534eaeb643ca3c56aed01751d2a619020b012eb546973342cbee923a" Jul 29 18:39:55.647134 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:39:55.647114 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccbc8fa7534eaeb643ca3c56aed01751d2a619020b012eb546973342cbee923a\": container with ID starting with ccbc8fa7534eaeb643ca3c56aed01751d2a619020b012eb546973342cbee923a not found: ID does not exist" containerID="ccbc8fa7534eaeb643ca3c56aed01751d2a619020b012eb546973342cbee923a" Jul 29 18:39:55.647185 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:55.647144 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccbc8fa7534eaeb643ca3c56aed01751d2a619020b012eb546973342cbee923a"} err="failed to get container status \"ccbc8fa7534eaeb643ca3c56aed01751d2a619020b012eb546973342cbee923a\": rpc error: code = NotFound desc = could not find container \"ccbc8fa7534eaeb643ca3c56aed01751d2a619020b012eb546973342cbee923a\": container with ID starting with ccbc8fa7534eaeb643ca3c56aed01751d2a619020b012eb546973342cbee923a not found: ID does not exist" Jul 29 18:39:55.655725 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:55.655697 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7cc9cc4c87-kfccg"] Jul 29 18:39:55.659033 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:55.659009 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7cc9cc4c87-kfccg"] Jul 29 18:39:57.266506 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:57.266471 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c4b0ad6-e876-4580-841c-91a36f53a0f8" path="/var/lib/kubelet/pods/0c4b0ad6-e876-4580-841c-91a36f53a0f8/volumes" Jul 29 18:39:57.580707 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:57.580596 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-84f45d7dd6-jhv6n" podUID="f7dd3e3c-1f2b-4017-a57d-5b9a022f2447" containerName="console" containerID="cri-o://95f6e72934dfbf22c6796f63a2ad95d595bc8e5682587c9b7cbe47bbd7cd2dde" gracePeriod=15 Jul 29 18:39:57.868475 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:57.868438 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f45d7dd6-jhv6n" Jul 29 18:39:58.007270 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:58.007234 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-oauth-serving-cert\") pod \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\" (UID: \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\") " Jul 29 18:39:58.007440 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:58.007290 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-console-oauth-config\") pod \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\" (UID: \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\") " Jul 29 18:39:58.007440 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:58.007320 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-console-serving-cert\") pod \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\" (UID: \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\") " Jul 29 18:39:58.007440 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:58.007339 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-console-config\") pod \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\" (UID: \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\") " Jul 29 18:39:58.007440 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:58.007365 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48zfz\" (UniqueName: \"kubernetes.io/projected/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-kube-api-access-48zfz\") pod \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\" (UID: \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\") " Jul 29 18:39:58.007440 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:58.007424 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-service-ca\") pod \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\" (UID: \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\") " Jul 29 18:39:58.007723 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:58.007501 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-trusted-ca-bundle\") pod \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\" (UID: \"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447\") " Jul 29 18:39:58.007723 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:58.007657 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f7dd3e3c-1f2b-4017-a57d-5b9a022f2447" (UID: "f7dd3e3c-1f2b-4017-a57d-5b9a022f2447"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:39:58.007902 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:58.007868 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-console-config" (OuterVolumeSpecName: "console-config") pod "f7dd3e3c-1f2b-4017-a57d-5b9a022f2447" (UID: "f7dd3e3c-1f2b-4017-a57d-5b9a022f2447"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:39:58.007980 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:58.007920 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-service-ca" (OuterVolumeSpecName: "service-ca") pod "f7dd3e3c-1f2b-4017-a57d-5b9a022f2447" (UID: "f7dd3e3c-1f2b-4017-a57d-5b9a022f2447"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:39:58.007980 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:58.007947 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f7dd3e3c-1f2b-4017-a57d-5b9a022f2447" (UID: "f7dd3e3c-1f2b-4017-a57d-5b9a022f2447"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:39:58.008260 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:58.008240 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-trusted-ca-bundle\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:39:58.008318 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:58.008268 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-oauth-serving-cert\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:39:58.008318 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:58.008284 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-console-config\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:39:58.008318 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:58.008298 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-service-ca\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:39:58.009830 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:58.009808 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f7dd3e3c-1f2b-4017-a57d-5b9a022f2447" (UID: "f7dd3e3c-1f2b-4017-a57d-5b9a022f2447"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:39:58.009903 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:58.009834 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f7dd3e3c-1f2b-4017-a57d-5b9a022f2447" (UID: "f7dd3e3c-1f2b-4017-a57d-5b9a022f2447"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:39:58.010080 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:58.010061 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-kube-api-access-48zfz" (OuterVolumeSpecName: "kube-api-access-48zfz") pod "f7dd3e3c-1f2b-4017-a57d-5b9a022f2447" (UID: "f7dd3e3c-1f2b-4017-a57d-5b9a022f2447"). InnerVolumeSpecName "kube-api-access-48zfz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 18:39:58.108999 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:58.108908 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-console-oauth-config\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:39:58.108999 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:58.108949 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-console-serving-cert\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:39:58.108999 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:58.108963 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48zfz\" (UniqueName: \"kubernetes.io/projected/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447-kube-api-access-48zfz\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:39:58.657676 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:58.657643 2560 generic.go:356] "Generic (PLEG): container finished" podID="f7dd3e3c-1f2b-4017-a57d-5b9a022f2447" containerID="95f6e72934dfbf22c6796f63a2ad95d595bc8e5682587c9b7cbe47bbd7cd2dde" exitCode=0 Jul 29 18:39:58.658147 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:58.657691 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f45d7dd6-jhv6n" Jul 29 18:39:58.658147 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:58.657728 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f45d7dd6-jhv6n" event={"ID":"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447","Type":"ContainerDied","Data":"95f6e72934dfbf22c6796f63a2ad95d595bc8e5682587c9b7cbe47bbd7cd2dde"} Jul 29 18:39:58.658147 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:58.657776 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f45d7dd6-jhv6n" event={"ID":"f7dd3e3c-1f2b-4017-a57d-5b9a022f2447","Type":"ContainerDied","Data":"486c46d0599d5bc5c6f59d54b49ed66066ea61b87d709854c7a8375058a80095"} Jul 29 18:39:58.658147 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:58.657797 2560 scope.go:117] "RemoveContainer" containerID="95f6e72934dfbf22c6796f63a2ad95d595bc8e5682587c9b7cbe47bbd7cd2dde" Jul 29 18:39:58.666981 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:58.666965 2560 scope.go:117] "RemoveContainer" containerID="95f6e72934dfbf22c6796f63a2ad95d595bc8e5682587c9b7cbe47bbd7cd2dde" Jul 29 18:39:58.667301 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:39:58.667280 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95f6e72934dfbf22c6796f63a2ad95d595bc8e5682587c9b7cbe47bbd7cd2dde\": container with ID starting with 95f6e72934dfbf22c6796f63a2ad95d595bc8e5682587c9b7cbe47bbd7cd2dde not found: ID does not exist" containerID="95f6e72934dfbf22c6796f63a2ad95d595bc8e5682587c9b7cbe47bbd7cd2dde" Jul 29 18:39:58.667376 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:58.667312 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95f6e72934dfbf22c6796f63a2ad95d595bc8e5682587c9b7cbe47bbd7cd2dde"} err="failed to get container status \"95f6e72934dfbf22c6796f63a2ad95d595bc8e5682587c9b7cbe47bbd7cd2dde\": rpc error: code = NotFound desc = could not find container \"95f6e72934dfbf22c6796f63a2ad95d595bc8e5682587c9b7cbe47bbd7cd2dde\": container with ID starting with 95f6e72934dfbf22c6796f63a2ad95d595bc8e5682587c9b7cbe47bbd7cd2dde not found: ID does not exist" Jul 29 18:39:58.679636 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:58.679609 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84f45d7dd6-jhv6n"] Jul 29 18:39:58.683361 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:58.683336 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84f45d7dd6-jhv6n"] Jul 29 18:39:59.266730 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:39:59.266700 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7dd3e3c-1f2b-4017-a57d-5b9a022f2447" path="/var/lib/kubelet/pods/f7dd3e3c-1f2b-4017-a57d-5b9a022f2447/volumes" Jul 29 18:40:14.095528 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.095462 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-559897d849-s9bxv" podUID="580e8c1a-6550-4bc9-8ef2-ef25883dec93" containerName="console" containerID="cri-o://c6397f37f8ddd2c2924c91655c860cd03171b9571389a3bfd60a0664c57aaf63" gracePeriod=15 Jul 29 18:40:14.396827 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.396791 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559897d849-s9bxv" Jul 29 18:40:14.565720 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.565680 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/580e8c1a-6550-4bc9-8ef2-ef25883dec93-console-config\") pod \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\" (UID: \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\") " Jul 29 18:40:14.565720 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.565723 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/580e8c1a-6550-4bc9-8ef2-ef25883dec93-service-ca\") pod \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\" (UID: \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\") " Jul 29 18:40:14.565927 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.565777 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/580e8c1a-6550-4bc9-8ef2-ef25883dec93-console-oauth-config\") pod \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\" (UID: \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\") " Jul 29 18:40:14.565927 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.565879 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2ppb\" (UniqueName: \"kubernetes.io/projected/580e8c1a-6550-4bc9-8ef2-ef25883dec93-kube-api-access-z2ppb\") pod \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\" (UID: \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\") " Jul 29 18:40:14.565927 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.565919 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/580e8c1a-6550-4bc9-8ef2-ef25883dec93-oauth-serving-cert\") pod \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\" (UID: \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\") " Jul 29 18:40:14.566063 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.565941 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/580e8c1a-6550-4bc9-8ef2-ef25883dec93-trusted-ca-bundle\") pod \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\" (UID: \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\") " Jul 29 18:40:14.566063 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.565958 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/580e8c1a-6550-4bc9-8ef2-ef25883dec93-console-serving-cert\") pod \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\" (UID: \"580e8c1a-6550-4bc9-8ef2-ef25883dec93\") " Jul 29 18:40:14.566256 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.566231 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/580e8c1a-6550-4bc9-8ef2-ef25883dec93-console-config" (OuterVolumeSpecName: "console-config") pod "580e8c1a-6550-4bc9-8ef2-ef25883dec93" (UID: "580e8c1a-6550-4bc9-8ef2-ef25883dec93"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:40:14.566397 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.566358 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/580e8c1a-6550-4bc9-8ef2-ef25883dec93-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "580e8c1a-6550-4bc9-8ef2-ef25883dec93" (UID: "580e8c1a-6550-4bc9-8ef2-ef25883dec93"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:40:14.566397 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.566370 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/580e8c1a-6550-4bc9-8ef2-ef25883dec93-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "580e8c1a-6550-4bc9-8ef2-ef25883dec93" (UID: "580e8c1a-6550-4bc9-8ef2-ef25883dec93"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:40:14.566514 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.566415 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/580e8c1a-6550-4bc9-8ef2-ef25883dec93-service-ca" (OuterVolumeSpecName: "service-ca") pod "580e8c1a-6550-4bc9-8ef2-ef25883dec93" (UID: "580e8c1a-6550-4bc9-8ef2-ef25883dec93"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:40:14.567972 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.567951 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/580e8c1a-6550-4bc9-8ef2-ef25883dec93-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "580e8c1a-6550-4bc9-8ef2-ef25883dec93" (UID: "580e8c1a-6550-4bc9-8ef2-ef25883dec93"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:40:14.568066 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.567989 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/580e8c1a-6550-4bc9-8ef2-ef25883dec93-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "580e8c1a-6550-4bc9-8ef2-ef25883dec93" (UID: "580e8c1a-6550-4bc9-8ef2-ef25883dec93"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:40:14.568106 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.568062 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/580e8c1a-6550-4bc9-8ef2-ef25883dec93-kube-api-access-z2ppb" (OuterVolumeSpecName: "kube-api-access-z2ppb") pod "580e8c1a-6550-4bc9-8ef2-ef25883dec93" (UID: "580e8c1a-6550-4bc9-8ef2-ef25883dec93"). InnerVolumeSpecName "kube-api-access-z2ppb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 18:40:14.667112 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.667019 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/580e8c1a-6550-4bc9-8ef2-ef25883dec93-console-config\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:40:14.667112 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.667052 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/580e8c1a-6550-4bc9-8ef2-ef25883dec93-service-ca\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:40:14.667112 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.667061 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/580e8c1a-6550-4bc9-8ef2-ef25883dec93-console-oauth-config\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:40:14.667112 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.667070 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2ppb\" (UniqueName: \"kubernetes.io/projected/580e8c1a-6550-4bc9-8ef2-ef25883dec93-kube-api-access-z2ppb\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:40:14.667112 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.667079 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/580e8c1a-6550-4bc9-8ef2-ef25883dec93-oauth-serving-cert\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:40:14.667112 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.667089 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/580e8c1a-6550-4bc9-8ef2-ef25883dec93-trusted-ca-bundle\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:40:14.667112 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.667097 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/580e8c1a-6550-4bc9-8ef2-ef25883dec93-console-serving-cert\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:40:14.738166 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.738128 2560 generic.go:356] "Generic (PLEG): container finished" podID="580e8c1a-6550-4bc9-8ef2-ef25883dec93" containerID="c6397f37f8ddd2c2924c91655c860cd03171b9571389a3bfd60a0664c57aaf63" exitCode=0 Jul 29 18:40:14.738327 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.738203 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559897d849-s9bxv" Jul 29 18:40:14.738327 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.738221 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559897d849-s9bxv" event={"ID":"580e8c1a-6550-4bc9-8ef2-ef25883dec93","Type":"ContainerDied","Data":"c6397f37f8ddd2c2924c91655c860cd03171b9571389a3bfd60a0664c57aaf63"} Jul 29 18:40:14.738327 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.738297 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559897d849-s9bxv" event={"ID":"580e8c1a-6550-4bc9-8ef2-ef25883dec93","Type":"ContainerDied","Data":"0c88ed0c47016df1d5b8bef804883bf7542d205e813908e0dc477143ab1f38a3"} Jul 29 18:40:14.738327 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.738317 2560 scope.go:117] "RemoveContainer" containerID="c6397f37f8ddd2c2924c91655c860cd03171b9571389a3bfd60a0664c57aaf63" Jul 29 18:40:14.747136 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.747118 2560 scope.go:117] "RemoveContainer" containerID="c6397f37f8ddd2c2924c91655c860cd03171b9571389a3bfd60a0664c57aaf63" Jul 29 18:40:14.747391 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:40:14.747369 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6397f37f8ddd2c2924c91655c860cd03171b9571389a3bfd60a0664c57aaf63\": container with ID starting with c6397f37f8ddd2c2924c91655c860cd03171b9571389a3bfd60a0664c57aaf63 not found: ID does not exist" containerID="c6397f37f8ddd2c2924c91655c860cd03171b9571389a3bfd60a0664c57aaf63" Jul 29 18:40:14.747430 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.747400 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6397f37f8ddd2c2924c91655c860cd03171b9571389a3bfd60a0664c57aaf63"} err="failed to get container status \"c6397f37f8ddd2c2924c91655c860cd03171b9571389a3bfd60a0664c57aaf63\": rpc error: code = NotFound desc = could not find container \"c6397f37f8ddd2c2924c91655c860cd03171b9571389a3bfd60a0664c57aaf63\": container with ID starting with c6397f37f8ddd2c2924c91655c860cd03171b9571389a3bfd60a0664c57aaf63 not found: ID does not exist" Jul 29 18:40:14.762052 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.762022 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-559897d849-s9bxv"] Jul 29 18:40:14.770961 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:14.770939 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-559897d849-s9bxv"] Jul 29 18:40:15.266688 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:15.266657 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="580e8c1a-6550-4bc9-8ef2-ef25883dec93" path="/var/lib/kubelet/pods/580e8c1a-6550-4bc9-8ef2-ef25883dec93/volumes" Jul 29 18:40:23.033191 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:23.033159 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs\") pod \"network-metrics-daemon-94h2v\" (UID: \"1e43e1c7-433e-4559-8fa2-2c818770dc36\") " pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:40:23.035599 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:23.035576 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e43e1c7-433e-4559-8fa2-2c818770dc36-metrics-certs\") pod \"network-metrics-daemon-94h2v\" (UID: \"1e43e1c7-433e-4559-8fa2-2c818770dc36\") " pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:40:23.165635 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:23.165601 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c2rc9\"" Jul 29 18:40:23.173251 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:23.173214 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94h2v" Jul 29 18:40:23.307850 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:23.307747 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-94h2v"] Jul 29 18:40:23.310282 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:40:23.310242 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e43e1c7_433e_4559_8fa2_2c818770dc36.slice/crio-c2a1eb46706032ce9452b36136e0526c4dcb83224e92f45a61587310695d8940 WatchSource:0}: Error finding container c2a1eb46706032ce9452b36136e0526c4dcb83224e92f45a61587310695d8940: Status 404 returned error can't find the container with id c2a1eb46706032ce9452b36136e0526c4dcb83224e92f45a61587310695d8940 Jul 29 18:40:23.776093 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:23.776057 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-94h2v" event={"ID":"1e43e1c7-433e-4559-8fa2-2c818770dc36","Type":"ContainerStarted","Data":"c2a1eb46706032ce9452b36136e0526c4dcb83224e92f45a61587310695d8940"} Jul 29 18:40:23.802635 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:23.802584 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:23.821997 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:23.821974 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:24.782091 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:24.782053 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-94h2v" event={"ID":"1e43e1c7-433e-4559-8fa2-2c818770dc36","Type":"ContainerStarted","Data":"62f54b6b07624d294193f611a6389239cad37ea59ba8166749b0b170743fb2b5"} Jul 29 18:40:24.782508 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:24.782141 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-94h2v" event={"ID":"1e43e1c7-433e-4559-8fa2-2c818770dc36","Type":"ContainerStarted","Data":"e43afb404adbd832e071be8a7115311d05ef6ef9924666316585adeb3eb95576"} Jul 29 18:40:24.797745 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:24.797717 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:24.799935 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:24.799890 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-94h2v" podStartSLOduration=373.76048962 podStartE2EDuration="6m14.79987422s" totalImagesPullingTime="1.0393846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:40:24.797972742 +0000 UTC m=+376.138079488" watchObservedRunningTime="2026-07-29 18:40:24.79987422 +0000 UTC m=+376.139980965" Jul 29 18:40:41.835974 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:41.835938 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 18:40:41.836488 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:41.836244 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerName="prometheus" containerID="cri-o://99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c" gracePeriod=600 Jul 29 18:40:41.836488 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:41.836296 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerName="config-reloader" containerID="cri-o://aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a" gracePeriod=600 Jul 29 18:40:41.836488 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:41.836318 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerName="kube-rbac-proxy-web" containerID="cri-o://d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f" gracePeriod=600 Jul 29 18:40:41.836488 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:41.836258 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerName="kube-rbac-proxy" containerID="cri-o://9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6" gracePeriod=600 Jul 29 18:40:41.836488 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:41.836330 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerName="thanos-sidecar" containerID="cri-o://1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a" gracePeriod=600 Jul 29 18:40:41.836488 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:41.836284 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerName="kube-rbac-proxy-thanos" containerID="cri-o://276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c" gracePeriod=600 Jul 29 18:40:42.081071 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.080990 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:42.207914 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.207883 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " Jul 29 18:40:42.208100 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.207921 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-prometheus-k8s-rulefiles-0\") pod \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " Jul 29 18:40:42.208100 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.207944 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-prometheus-k8s-db\") pod \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " Jul 29 18:40:42.208100 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.207963 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-configmap-kubelet-serving-ca-bundle\") pod \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " Jul 29 18:40:42.208100 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.207985 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-prometheus-trusted-ca-bundle\") pod \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " Jul 29 18:40:42.208100 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.208011 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-grpc-tls\") pod \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " Jul 29 18:40:42.208419 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.208117 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-configmap-serving-certs-ca-bundle\") pod \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " Jul 29 18:40:42.208419 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.208177 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-config\") pod \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " Jul 29 18:40:42.208419 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.208214 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-web-config\") pod \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " Jul 29 18:40:42.208419 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.208244 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhdvp\" (UniqueName: \"kubernetes.io/projected/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-kube-api-access-vhdvp\") pod \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " Jul 29 18:40:42.208419 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.208279 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " Jul 29 18:40:42.208697 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.208482 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" (UID: "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:40:42.208697 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.208622 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-configmap-metrics-client-ca\") pod \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " Jul 29 18:40:42.208697 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.208670 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-prometheus-k8s-rulefiles-2\") pod \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " Jul 29 18:40:42.208854 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.208699 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-tls-assets\") pod \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " Jul 29 18:40:42.208854 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.208722 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-kube-rbac-proxy\") pod \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " Jul 29 18:40:42.208854 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.208773 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-thanos-prometheus-http-client-file\") pod \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " Jul 29 18:40:42.208854 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.208808 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-prometheus-k8s-tls\") pod \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " Jul 29 18:40:42.208854 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.208842 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-config-out\") pod \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " Jul 29 18:40:42.209101 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.208874 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-prometheus-k8s-rulefiles-1\") pod \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " Jul 29 18:40:42.209101 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.208905 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-metrics-client-certs\") pod \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\" (UID: \"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa\") " Jul 29 18:40:42.209101 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.208910 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" (UID: "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:40:42.209101 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.209048 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" (UID: "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 18:40:42.209299 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.209153 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-prometheus-k8s-db\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:40:42.209299 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.209170 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:40:42.209299 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.209184 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:40:42.209299 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.209271 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" (UID: "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:40:42.209548 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.209521 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" (UID: "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:40:42.209673 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.209647 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" (UID: "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:40:42.209831 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.209735 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" (UID: "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:40:42.210303 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.210259 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" (UID: "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:40:42.211250 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.211225 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-config" (OuterVolumeSpecName: "config") pod "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" (UID: "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:40:42.211720 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.211691 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" (UID: "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:40:42.212031 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.211995 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-kube-api-access-vhdvp" (OuterVolumeSpecName: "kube-api-access-vhdvp") pod "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" (UID: "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa"). InnerVolumeSpecName "kube-api-access-vhdvp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 18:40:42.212154 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.212131 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" (UID: "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 18:40:42.212278 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.212257 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" (UID: "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:40:42.212347 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.212295 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" (UID: "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:40:42.213028 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.213006 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" (UID: "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:40:42.213179 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.213130 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-config-out" (OuterVolumeSpecName: "config-out") pod "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" (UID: "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 18:40:42.213179 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.213154 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" (UID: "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:40:42.213326 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.213289 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" (UID: "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:40:42.213927 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.213900 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" (UID: "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:40:42.224655 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.224631 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-web-config" (OuterVolumeSpecName: "web-config") pod "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" (UID: "bba7aab3-8f0f-425d-8c68-cdf897b8a3fa"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:40:42.309532 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.309490 2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-config-out\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:40:42.309532 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.309523 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:40:42.309532 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.309534 2560 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-metrics-client-certs\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:40:42.309799 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.309544 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:40:42.309799 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.309584 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:40:42.309799 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.309595 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:40:42.309799 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.309604 2560 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-grpc-tls\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:40:42.309799 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.309613 2560 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-config\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:40:42.309799 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.309620 2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-web-config\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:40:42.309799 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.309628 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhdvp\" (UniqueName: \"kubernetes.io/projected/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-kube-api-access-vhdvp\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:40:42.309799 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.309636 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:40:42.309799 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.309645 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-configmap-metrics-client-ca\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:40:42.309799 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.309654 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:40:42.309799 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.309662 2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-tls-assets\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:40:42.309799 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.309670 2560 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-kube-rbac-proxy\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:40:42.309799 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.309679 2560 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:40:42.309799 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.309687 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:40:42.860456 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.860421 2560 generic.go:356] "Generic (PLEG): container finished" podID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerID="276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c" exitCode=0 Jul 29 18:40:42.860456 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.860450 2560 generic.go:356] "Generic (PLEG): container finished" podID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerID="9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6" exitCode=0 Jul 29 18:40:42.860456 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.860460 2560 generic.go:356] "Generic (PLEG): container finished" podID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerID="d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f" exitCode=0 Jul 29 18:40:42.860971 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.860469 2560 generic.go:356] "Generic (PLEG): container finished" podID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerID="1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a" exitCode=0 Jul 29 18:40:42.860971 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.860464 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa","Type":"ContainerDied","Data":"276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c"} Jul 29 18:40:42.860971 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.860526 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:42.860971 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.860551 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa","Type":"ContainerDied","Data":"9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6"} Jul 29 18:40:42.860971 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.860478 2560 generic.go:356] "Generic (PLEG): container finished" podID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerID="aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a" exitCode=0 Jul 29 18:40:42.860971 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.860591 2560 generic.go:356] "Generic (PLEG): container finished" podID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerID="99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c" exitCode=0 Jul 29 18:40:42.860971 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.860618 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa","Type":"ContainerDied","Data":"d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f"} Jul 29 18:40:42.860971 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.860634 2560 scope.go:117] "RemoveContainer" containerID="276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c" Jul 29 18:40:42.860971 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.860659 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa","Type":"ContainerDied","Data":"1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a"} Jul 29 18:40:42.860971 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.860698 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa","Type":"ContainerDied","Data":"aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a"} Jul 29 18:40:42.860971 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.860739 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa","Type":"ContainerDied","Data":"99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c"} Jul 29 18:40:42.860971 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.860779 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bba7aab3-8f0f-425d-8c68-cdf897b8a3fa","Type":"ContainerDied","Data":"cf6ff0aa7d0785668fb3cfff1f32ab7171c7b0c9fd7848352c092d8f8aa6cb61"} Jul 29 18:40:42.869847 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.869829 2560 scope.go:117] "RemoveContainer" containerID="9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6" Jul 29 18:40:42.877062 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.877044 2560 scope.go:117] "RemoveContainer" containerID="d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f" Jul 29 18:40:42.884274 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.884255 2560 scope.go:117] "RemoveContainer" containerID="1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a" Jul 29 18:40:42.885952 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.885928 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 18:40:42.891606 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.891584 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 18:40:42.893061 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.893046 2560 scope.go:117] "RemoveContainer" containerID="aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a" Jul 29 18:40:42.899953 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.899938 2560 scope.go:117] "RemoveContainer" containerID="99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c" Jul 29 18:40:42.907177 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.907159 2560 scope.go:117] "RemoveContainer" containerID="13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94" Jul 29 18:40:42.914091 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.914071 2560 scope.go:117] "RemoveContainer" containerID="276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c" Jul 29 18:40:42.914381 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:40:42.914362 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c\": container with ID starting with 276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c not found: ID does not exist" containerID="276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c" Jul 29 18:40:42.914453 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.914393 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c"} err="failed to get container status \"276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c\": rpc error: code = NotFound desc = could not find container \"276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c\": container with ID starting with 276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c not found: ID does not exist" Jul 29 18:40:42.914453 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.914422 2560 scope.go:117] "RemoveContainer" containerID="9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6" Jul 29 18:40:42.914718 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:40:42.914699 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6\": container with ID starting with 9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6 not found: ID does not exist" containerID="9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6" Jul 29 18:40:42.914763 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.914726 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6"} err="failed to get container status \"9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6\": rpc error: code = NotFound desc = could not find container \"9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6\": container with ID starting with 9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6 not found: ID does not exist" Jul 29 18:40:42.914763 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.914743 2560 scope.go:117] "RemoveContainer" containerID="d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f" Jul 29 18:40:42.914977 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:40:42.914959 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f\": container with ID starting with d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f not found: ID does not exist" containerID="d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f" Jul 29 18:40:42.915023 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.914982 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f"} err="failed to get container status \"d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f\": rpc error: code = NotFound desc = could not find container \"d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f\": container with ID starting with d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f not found: ID does not exist" Jul 29 18:40:42.915023 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.914997 2560 scope.go:117] "RemoveContainer" containerID="1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a" Jul 29 18:40:42.915215 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:40:42.915197 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a\": container with ID starting with 1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a not found: ID does not exist" containerID="1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a" Jul 29 18:40:42.915276 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.915224 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a"} err="failed to get container status \"1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a\": rpc error: code = NotFound desc = could not find container \"1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a\": container with ID starting with 1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a not found: ID does not exist" Jul 29 18:40:42.915276 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.915247 2560 scope.go:117] "RemoveContainer" containerID="aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a" Jul 29 18:40:42.915477 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:40:42.915461 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a\": container with ID starting with aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a not found: ID does not exist" containerID="aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a" Jul 29 18:40:42.915530 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.915480 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a"} err="failed to get container status \"aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a\": rpc error: code = NotFound desc = could not find container \"aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a\": container with ID starting with aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a not found: ID does not exist" Jul 29 18:40:42.915530 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.915493 2560 scope.go:117] "RemoveContainer" containerID="99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c" Jul 29 18:40:42.915802 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:40:42.915766 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c\": container with ID starting with 99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c not found: ID does not exist" containerID="99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c" Jul 29 18:40:42.915922 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.915807 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c"} err="failed to get container status \"99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c\": rpc error: code = NotFound desc = could not find container \"99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c\": container with ID starting with 99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c not found: ID does not exist" Jul 29 18:40:42.916157 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.916134 2560 scope.go:117] "RemoveContainer" containerID="13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94" Jul 29 18:40:42.916426 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:40:42.916407 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94\": container with ID starting with 13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94 not found: ID does not exist" containerID="13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94" Jul 29 18:40:42.916527 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.916436 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94"} err="failed to get container status \"13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94\": rpc error: code = NotFound desc = could not find container \"13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94\": container with ID starting with 13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94 not found: ID does not exist" Jul 29 18:40:42.916527 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.916453 2560 scope.go:117] "RemoveContainer" containerID="276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c" Jul 29 18:40:42.916749 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.916726 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c"} err="failed to get container status \"276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c\": rpc error: code = NotFound desc = could not find container \"276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c\": container with ID starting with 276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c not found: ID does not exist" Jul 29 18:40:42.916749 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.916750 2560 scope.go:117] "RemoveContainer" containerID="9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6" Jul 29 18:40:42.917013 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.916996 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6"} err="failed to get container status \"9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6\": rpc error: code = NotFound desc = could not find container \"9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6\": container with ID starting with 9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6 not found: ID does not exist" Jul 29 18:40:42.917074 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.917015 2560 scope.go:117] "RemoveContainer" containerID="d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f" Jul 29 18:40:42.917274 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.917256 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f"} err="failed to get container status \"d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f\": rpc error: code = NotFound desc = could not find container \"d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f\": container with ID starting with d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f not found: ID does not exist" Jul 29 18:40:42.917331 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.917275 2560 scope.go:117] "RemoveContainer" containerID="1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a" Jul 29 18:40:42.917531 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.917511 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a"} err="failed to get container status \"1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a\": rpc error: code = NotFound desc = could not find container \"1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a\": container with ID starting with 1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a not found: ID does not exist" Jul 29 18:40:42.917596 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.917532 2560 scope.go:117] "RemoveContainer" containerID="aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a" Jul 29 18:40:42.917807 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.917783 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a"} err="failed to get container status \"aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a\": rpc error: code = NotFound desc = could not find container \"aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a\": container with ID starting with aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a not found: ID does not exist" Jul 29 18:40:42.917852 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.917810 2560 scope.go:117] "RemoveContainer" containerID="99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c" Jul 29 18:40:42.917944 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.917928 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 18:40:42.918005 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.917989 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c"} err="failed to get container status \"99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c\": rpc error: code = NotFound desc = could not find container \"99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c\": container with ID starting with 99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c not found: ID does not exist" Jul 29 18:40:42.918050 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918007 2560 scope.go:117] "RemoveContainer" containerID="13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94" Jul 29 18:40:42.918189 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918171 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94"} err="failed to get container status \"13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94\": rpc error: code = NotFound desc = could not find container \"13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94\": container with ID starting with 13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94 not found: ID does not exist" Jul 29 18:40:42.918309 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918189 2560 scope.go:117] "RemoveContainer" containerID="276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c" Jul 29 18:40:42.918309 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918268 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7dd3e3c-1f2b-4017-a57d-5b9a022f2447" containerName="console" Jul 29 18:40:42.918309 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918280 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7dd3e3c-1f2b-4017-a57d-5b9a022f2447" containerName="console" Jul 29 18:40:42.918309 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918291 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerName="kube-rbac-proxy-thanos" Jul 29 18:40:42.918309 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918299 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerName="kube-rbac-proxy-thanos" Jul 29 18:40:42.918487 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918324 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerName="prometheus" Jul 29 18:40:42.918487 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918332 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerName="prometheus" Jul 29 18:40:42.918487 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918344 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerName="config-reloader" Jul 29 18:40:42.918487 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918350 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerName="config-reloader" Jul 29 18:40:42.918487 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918361 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c4b0ad6-e876-4580-841c-91a36f53a0f8" containerName="registry" Jul 29 18:40:42.918487 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918366 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c4b0ad6-e876-4580-841c-91a36f53a0f8" containerName="registry" Jul 29 18:40:42.918487 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918372 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerName="thanos-sidecar" Jul 29 18:40:42.918487 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918378 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerName="thanos-sidecar" Jul 29 18:40:42.918487 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918387 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerName="kube-rbac-proxy" Jul 29 18:40:42.918487 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918392 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerName="kube-rbac-proxy" Jul 29 18:40:42.918487 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918400 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="580e8c1a-6550-4bc9-8ef2-ef25883dec93" containerName="console" Jul 29 18:40:42.918487 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918405 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="580e8c1a-6550-4bc9-8ef2-ef25883dec93" containerName="console" Jul 29 18:40:42.918487 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918410 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerName="init-config-reloader" Jul 29 18:40:42.918487 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918415 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerName="init-config-reloader" Jul 29 18:40:42.918487 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918423 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerName="kube-rbac-proxy-web" Jul 29 18:40:42.918487 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918430 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerName="kube-rbac-proxy-web" Jul 29 18:40:42.918487 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918479 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerName="config-reloader" Jul 29 18:40:42.918487 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918487 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7dd3e3c-1f2b-4017-a57d-5b9a022f2447" containerName="console" Jul 29 18:40:42.918487 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918492 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerName="kube-rbac-proxy-web" Jul 29 18:40:42.919095 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918501 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c4b0ad6-e876-4580-841c-91a36f53a0f8" containerName="registry" Jul 29 18:40:42.919095 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918507 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerName="kube-rbac-proxy" Jul 29 18:40:42.919095 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918512 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerName="prometheus" Jul 29 18:40:42.919095 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918517 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerName="thanos-sidecar" Jul 29 18:40:42.919095 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918521 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="580e8c1a-6550-4bc9-8ef2-ef25883dec93" containerName="console" Jul 29 18:40:42.919095 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918526 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" containerName="kube-rbac-proxy-thanos" Jul 29 18:40:42.919095 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918420 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c"} err="failed to get container status \"276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c\": rpc error: code = NotFound desc = could not find container \"276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c\": container with ID starting with 276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c not found: ID does not exist" Jul 29 18:40:42.919095 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918580 2560 scope.go:117] "RemoveContainer" containerID="9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6" Jul 29 18:40:42.919095 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918845 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6"} err="failed to get container status \"9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6\": rpc error: code = NotFound desc = could not find container \"9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6\": container with ID starting with 9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6 not found: ID does not exist" Jul 29 18:40:42.919095 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.918868 2560 scope.go:117] "RemoveContainer" containerID="d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f" Jul 29 18:40:42.919399 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.919086 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f"} err="failed to get container status \"d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f\": rpc error: code = NotFound desc = could not find container \"d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f\": container with ID starting with d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f not found: ID does not exist" Jul 29 18:40:42.919399 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.919115 2560 scope.go:117] "RemoveContainer" containerID="1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a" Jul 29 18:40:42.919399 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.919342 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a"} err="failed to get container status \"1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a\": rpc error: code = NotFound desc = could not find container \"1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a\": container with ID starting with 1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a not found: ID does not exist" Jul 29 18:40:42.919399 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.919357 2560 scope.go:117] "RemoveContainer" containerID="aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a" Jul 29 18:40:42.919596 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.919581 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a"} err="failed to get container status \"aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a\": rpc error: code = NotFound desc = could not find container \"aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a\": container with ID starting with aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a not found: ID does not exist" Jul 29 18:40:42.919639 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.919597 2560 scope.go:117] "RemoveContainer" containerID="99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c" Jul 29 18:40:42.919796 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.919779 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c"} err="failed to get container status \"99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c\": rpc error: code = NotFound desc = could not find container \"99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c\": container with ID starting with 99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c not found: ID does not exist" Jul 29 18:40:42.919796 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.919798 2560 scope.go:117] "RemoveContainer" containerID="13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94" Jul 29 18:40:42.919985 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.919971 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94"} err="failed to get container status \"13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94\": rpc error: code = NotFound desc = could not find container \"13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94\": container with ID starting with 13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94 not found: ID does not exist" Jul 29 18:40:42.920044 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.919986 2560 scope.go:117] "RemoveContainer" containerID="276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c" Jul 29 18:40:42.920194 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.920180 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c"} err="failed to get container status \"276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c\": rpc error: code = NotFound desc = could not find container \"276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c\": container with ID starting with 276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c not found: ID does not exist" Jul 29 18:40:42.920237 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.920194 2560 scope.go:117] "RemoveContainer" containerID="9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6" Jul 29 18:40:42.920368 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.920353 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6"} err="failed to get container status \"9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6\": rpc error: code = NotFound desc = could not find container \"9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6\": container with ID starting with 9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6 not found: ID does not exist" Jul 29 18:40:42.920412 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.920368 2560 scope.go:117] "RemoveContainer" containerID="d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f" Jul 29 18:40:42.920613 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.920594 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f"} err="failed to get container status \"d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f\": rpc error: code = NotFound desc = could not find container \"d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f\": container with ID starting with d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f not found: ID does not exist" Jul 29 18:40:42.920674 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.920614 2560 scope.go:117] "RemoveContainer" containerID="1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a" Jul 29 18:40:42.920859 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.920843 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a"} err="failed to get container status \"1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a\": rpc error: code = NotFound desc = could not find container \"1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a\": container with ID starting with 1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a not found: ID does not exist" Jul 29 18:40:42.920903 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.920861 2560 scope.go:117] "RemoveContainer" containerID="aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a" Jul 29 18:40:42.921100 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.921074 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a"} err="failed to get container status \"aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a\": rpc error: code = NotFound desc = could not find container \"aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a\": container with ID starting with aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a not found: ID does not exist" Jul 29 18:40:42.921100 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.921101 2560 scope.go:117] "RemoveContainer" containerID="99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c" Jul 29 18:40:42.921280 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.921262 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c"} err="failed to get container status \"99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c\": rpc error: code = NotFound desc = could not find container \"99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c\": container with ID starting with 99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c not found: ID does not exist" Jul 29 18:40:42.921334 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.921281 2560 scope.go:117] "RemoveContainer" containerID="13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94" Jul 29 18:40:42.921545 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.921523 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94"} err="failed to get container status \"13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94\": rpc error: code = NotFound desc = could not find container \"13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94\": container with ID starting with 13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94 not found: ID does not exist" Jul 29 18:40:42.921631 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.921548 2560 scope.go:117] "RemoveContainer" containerID="276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c" Jul 29 18:40:42.921793 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.921778 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c"} err="failed to get container status \"276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c\": rpc error: code = NotFound desc = could not find container \"276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c\": container with ID starting with 276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c not found: ID does not exist" Jul 29 18:40:42.921847 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.921793 2560 scope.go:117] "RemoveContainer" containerID="9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6" Jul 29 18:40:42.922016 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.922000 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6"} err="failed to get container status \"9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6\": rpc error: code = NotFound desc = could not find container \"9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6\": container with ID starting with 9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6 not found: ID does not exist" Jul 29 18:40:42.922057 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.922017 2560 scope.go:117] "RemoveContainer" containerID="d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f" Jul 29 18:40:42.922219 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.922200 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f"} err="failed to get container status \"d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f\": rpc error: code = NotFound desc = could not find container \"d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f\": container with ID starting with d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f not found: ID does not exist" Jul 29 18:40:42.922280 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.922221 2560 scope.go:117] "RemoveContainer" containerID="1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a" Jul 29 18:40:42.922440 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.922425 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a"} err="failed to get container status \"1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a\": rpc error: code = NotFound desc = could not find container \"1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a\": container with ID starting with 1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a not found: ID does not exist" Jul 29 18:40:42.922512 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.922442 2560 scope.go:117] "RemoveContainer" containerID="aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a" Jul 29 18:40:42.922693 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.922670 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a"} err="failed to get container status \"aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a\": rpc error: code = NotFound desc = could not find container \"aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a\": container with ID starting with aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a not found: ID does not exist" Jul 29 18:40:42.922693 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.922691 2560 scope.go:117] "RemoveContainer" containerID="99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c" Jul 29 18:40:42.922936 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.922913 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c"} err="failed to get container status \"99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c\": rpc error: code = NotFound desc = could not find container \"99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c\": container with ID starting with 99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c not found: ID does not exist" Jul 29 18:40:42.922936 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.922934 2560 scope.go:117] "RemoveContainer" containerID="13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94" Jul 29 18:40:42.923160 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.923133 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94"} err="failed to get container status \"13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94\": rpc error: code = NotFound desc = could not find container \"13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94\": container with ID starting with 13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94 not found: ID does not exist" Jul 29 18:40:42.923160 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.923159 2560 scope.go:117] "RemoveContainer" containerID="276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c" Jul 29 18:40:42.923348 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.923333 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:42.923439 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.923423 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c"} err="failed to get container status \"276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c\": rpc error: code = NotFound desc = could not find container \"276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c\": container with ID starting with 276933fa16c2cddaf67683737766be5cc033c51deb905ba128c34a85bb79f60c not found: ID does not exist" Jul 29 18:40:42.923485 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.923440 2560 scope.go:117] "RemoveContainer" containerID="9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6" Jul 29 18:40:42.923870 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.923841 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6"} err="failed to get container status \"9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6\": rpc error: code = NotFound desc = could not find container \"9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6\": container with ID starting with 9f9399fa6b5135245a1b99a9ec284c7e41c769ec5e0ecb1d18edc397fc5201e6 not found: ID does not exist" Jul 29 18:40:42.923870 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.923867 2560 scope.go:117] "RemoveContainer" containerID="d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f" Jul 29 18:40:42.924154 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.924120 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f"} err="failed to get container status \"d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f\": rpc error: code = NotFound desc = could not find container \"d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f\": container with ID starting with d782db8263ab24a0e7544a3612fee221dca32180d96d46dfca0628e95874425f not found: ID does not exist" Jul 29 18:40:42.924154 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.924146 2560 scope.go:117] "RemoveContainer" containerID="1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a" Jul 29 18:40:42.924423 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.924397 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a"} err="failed to get container status \"1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a\": rpc error: code = NotFound desc = could not find container \"1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a\": container with ID starting with 1d9b794423df1c58adfdd6bb78d3df3dcf31096a10e2336af83c75bbd89c087a not found: ID does not exist" Jul 29 18:40:42.924484 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.924425 2560 scope.go:117] "RemoveContainer" containerID="aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a" Jul 29 18:40:42.924715 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.924694 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a"} err="failed to get container status \"aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a\": rpc error: code = NotFound desc = could not find container \"aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a\": container with ID starting with aedc9df6ad1f6ccf7b8fe06aaaba0cf6415bc79144b96a402f8d77c46660d62a not found: ID does not exist" Jul 29 18:40:42.924778 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.924718 2560 scope.go:117] "RemoveContainer" containerID="99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c" Jul 29 18:40:42.924917 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.924895 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c"} err="failed to get container status \"99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c\": rpc error: code = NotFound desc = could not find container \"99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c\": container with ID starting with 99100f414445c8496ba8be339c65db7b14057870b2f3baab3624f355d766f54c not found: ID does not exist" Jul 29 18:40:42.924997 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.924918 2560 scope.go:117] "RemoveContainer" containerID="13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94" Jul 29 18:40:42.925149 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.925124 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94"} err="failed to get container status \"13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94\": rpc error: code = NotFound desc = could not find container \"13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94\": container with ID starting with 13cb4e44ad98703fe335f22753075427eaa17f0b564d97ac48c4c98448b84f94 not found: ID does not exist" Jul 29 18:40:42.926007 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.925991 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 29 18:40:42.926007 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.926004 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 29 18:40:42.926136 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.926058 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 29 18:40:42.926429 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.926416 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 29 18:40:42.926743 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.926727 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 29 18:40:42.926796 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.926781 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 29 18:40:42.926851 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.926825 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 29 18:40:42.926903 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.926887 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 29 18:40:42.927259 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.927244 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 29 18:40:42.927749 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.927552 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 29 18:40:42.927749 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.927635 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-k7jqr\"" Jul 29 18:40:42.927749 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.927688 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a8tqnj8r6roh6\"" Jul 29 18:40:42.927749 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.927699 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 29 18:40:42.928123 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.928096 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 29 18:40:42.928339 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.928305 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 29 18:40:42.930080 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.930060 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 29 18:40:42.932194 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.932177 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 29 18:40:42.939503 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:42.939479 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 18:40:43.016252 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.016208 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/822666ae-82ef-49f9-897b-1f5cc6778a30-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.016439 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.016255 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/822666ae-82ef-49f9-897b-1f5cc6778a30-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.016439 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.016291 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/822666ae-82ef-49f9-897b-1f5cc6778a30-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.016439 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.016324 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/822666ae-82ef-49f9-897b-1f5cc6778a30-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.016439 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.016421 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/822666ae-82ef-49f9-897b-1f5cc6778a30-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.016635 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.016479 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/822666ae-82ef-49f9-897b-1f5cc6778a30-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.016635 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.016516 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/822666ae-82ef-49f9-897b-1f5cc6778a30-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.016635 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.016540 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/822666ae-82ef-49f9-897b-1f5cc6778a30-web-config\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.016635 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.016585 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/822666ae-82ef-49f9-897b-1f5cc6778a30-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.016635 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.016613 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/822666ae-82ef-49f9-897b-1f5cc6778a30-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.016792 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.016646 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/822666ae-82ef-49f9-897b-1f5cc6778a30-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.016792 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.016679 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/822666ae-82ef-49f9-897b-1f5cc6778a30-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.016792 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.016700 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bczhc\" (UniqueName: \"kubernetes.io/projected/822666ae-82ef-49f9-897b-1f5cc6778a30-kube-api-access-bczhc\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.016792 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.016734 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/822666ae-82ef-49f9-897b-1f5cc6778a30-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.016916 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.016789 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/822666ae-82ef-49f9-897b-1f5cc6778a30-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.016916 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.016827 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/822666ae-82ef-49f9-897b-1f5cc6778a30-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.016916 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.016852 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/822666ae-82ef-49f9-897b-1f5cc6778a30-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.016916 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.016872 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/822666ae-82ef-49f9-897b-1f5cc6778a30-config-out\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.016916 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.016889 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/822666ae-82ef-49f9-897b-1f5cc6778a30-config\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.016916 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.016902 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/822666ae-82ef-49f9-897b-1f5cc6778a30-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.117988 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.117908 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/822666ae-82ef-49f9-897b-1f5cc6778a30-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.117988 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.117947 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/822666ae-82ef-49f9-897b-1f5cc6778a30-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.117988 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.117964 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/822666ae-82ef-49f9-897b-1f5cc6778a30-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.117988 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.117982 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/822666ae-82ef-49f9-897b-1f5cc6778a30-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.118244 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.118002 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/822666ae-82ef-49f9-897b-1f5cc6778a30-config-out\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.118244 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.118204 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/822666ae-82ef-49f9-897b-1f5cc6778a30-config\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.118244 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.118235 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/822666ae-82ef-49f9-897b-1f5cc6778a30-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.118426 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.118292 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/822666ae-82ef-49f9-897b-1f5cc6778a30-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.118426 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.118320 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/822666ae-82ef-49f9-897b-1f5cc6778a30-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.118426 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.118382 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/822666ae-82ef-49f9-897b-1f5cc6778a30-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.118426 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.118418 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/822666ae-82ef-49f9-897b-1f5cc6778a30-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.118651 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.118460 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/822666ae-82ef-49f9-897b-1f5cc6778a30-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.118651 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.118497 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/822666ae-82ef-49f9-897b-1f5cc6778a30-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.118651 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.118538 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/822666ae-82ef-49f9-897b-1f5cc6778a30-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.118651 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.118594 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/822666ae-82ef-49f9-897b-1f5cc6778a30-web-config\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.118651 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.118622 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/822666ae-82ef-49f9-897b-1f5cc6778a30-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.118651 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.118649 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/822666ae-82ef-49f9-897b-1f5cc6778a30-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.118947 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.118689 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/822666ae-82ef-49f9-897b-1f5cc6778a30-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.118947 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.118714 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/822666ae-82ef-49f9-897b-1f5cc6778a30-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.118947 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.118718 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/822666ae-82ef-49f9-897b-1f5cc6778a30-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.118947 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.118765 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bczhc\" (UniqueName: \"kubernetes.io/projected/822666ae-82ef-49f9-897b-1f5cc6778a30-kube-api-access-bczhc\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.118947 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.118840 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/822666ae-82ef-49f9-897b-1f5cc6778a30-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.119211 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.119097 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/822666ae-82ef-49f9-897b-1f5cc6778a30-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.119211 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.119137 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/822666ae-82ef-49f9-897b-1f5cc6778a30-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.119211 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.119148 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/822666ae-82ef-49f9-897b-1f5cc6778a30-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.120797 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.120770 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/822666ae-82ef-49f9-897b-1f5cc6778a30-config-out\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.121485 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.121145 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/822666ae-82ef-49f9-897b-1f5cc6778a30-config\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.121485 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.121423 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/822666ae-82ef-49f9-897b-1f5cc6778a30-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.121827 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.121804 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/822666ae-82ef-49f9-897b-1f5cc6778a30-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.122961 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.122097 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/822666ae-82ef-49f9-897b-1f5cc6778a30-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.122961 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.122515 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/822666ae-82ef-49f9-897b-1f5cc6778a30-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.122961 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.122538 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/822666ae-82ef-49f9-897b-1f5cc6778a30-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.122961 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.122638 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/822666ae-82ef-49f9-897b-1f5cc6778a30-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.122961 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.122905 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/822666ae-82ef-49f9-897b-1f5cc6778a30-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.123298 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.123259 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/822666ae-82ef-49f9-897b-1f5cc6778a30-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.123808 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.123784 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/822666ae-82ef-49f9-897b-1f5cc6778a30-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.124013 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.123996 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/822666ae-82ef-49f9-897b-1f5cc6778a30-web-config\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.124142 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.124127 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/822666ae-82ef-49f9-897b-1f5cc6778a30-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.124733 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.124711 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/822666ae-82ef-49f9-897b-1f5cc6778a30-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.128394 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.128372 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bczhc\" (UniqueName: \"kubernetes.io/projected/822666ae-82ef-49f9-897b-1f5cc6778a30-kube-api-access-bczhc\") pod \"prometheus-k8s-0\" (UID: \"822666ae-82ef-49f9-897b-1f5cc6778a30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.234118 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.234077 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:40:43.267872 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.267836 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bba7aab3-8f0f-425d-8c68-cdf897b8a3fa" path="/var/lib/kubelet/pods/bba7aab3-8f0f-425d-8c68-cdf897b8a3fa/volumes" Jul 29 18:40:43.383819 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.383794 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 18:40:43.383943 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:40:43.383869 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod822666ae_82ef_49f9_897b_1f5cc6778a30.slice/crio-b36d3a5266908a0f6e47ef12ff5b53498133e133e5a86229e92c54ceea0d813a WatchSource:0}: Error finding container b36d3a5266908a0f6e47ef12ff5b53498133e133e5a86229e92c54ceea0d813a: Status 404 returned error can't find the container with id b36d3a5266908a0f6e47ef12ff5b53498133e133e5a86229e92c54ceea0d813a Jul 29 18:40:43.868130 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.868098 2560 generic.go:356] "Generic (PLEG): container finished" podID="822666ae-82ef-49f9-897b-1f5cc6778a30" containerID="bb21c9bb31c338c8cda18d4fbe7d0f5933ba6401a5106c321f1214bb60fda419" exitCode=0 Jul 29 18:40:43.868508 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.868159 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"822666ae-82ef-49f9-897b-1f5cc6778a30","Type":"ContainerDied","Data":"bb21c9bb31c338c8cda18d4fbe7d0f5933ba6401a5106c321f1214bb60fda419"} Jul 29 18:40:43.868508 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:43.868207 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"822666ae-82ef-49f9-897b-1f5cc6778a30","Type":"ContainerStarted","Data":"b36d3a5266908a0f6e47ef12ff5b53498133e133e5a86229e92c54ceea0d813a"} Jul 29 18:40:44.875570 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:44.875534 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"822666ae-82ef-49f9-897b-1f5cc6778a30","Type":"ContainerStarted","Data":"e13bb093d9f622f62729809ad664cf66bab70a79bb5f631efa0656861460b1dc"} Jul 29 18:40:44.876045 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:44.875633 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"822666ae-82ef-49f9-897b-1f5cc6778a30","Type":"ContainerStarted","Data":"12fee51fc363154b4a8ee84a7c7d0d7ef385e3c2265c4c637d09e5181beb14d2"} Jul 29 18:40:44.876045 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:44.875677 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"822666ae-82ef-49f9-897b-1f5cc6778a30","Type":"ContainerStarted","Data":"cf6392a183c18a47b63c644c90a2c7f36429830b662122eb3917417702825a2c"} Jul 29 18:40:44.876045 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:44.875721 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"822666ae-82ef-49f9-897b-1f5cc6778a30","Type":"ContainerStarted","Data":"d48c1645430cf12a42656b01e9669bd460483c09128fe4fc95a2a9725283e015"} Jul 29 18:40:44.876045 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:44.875758 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"822666ae-82ef-49f9-897b-1f5cc6778a30","Type":"ContainerStarted","Data":"7f6fb2336fc147ea4f7c221c2b437f53336f96d1332a61d7f52bdfc202c0bbca"} Jul 29 18:40:44.876045 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:44.875803 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"822666ae-82ef-49f9-897b-1f5cc6778a30","Type":"ContainerStarted","Data":"2a6cd69c2738f33207a23f291dad98f4defa72e67f521132a4c50943e9d42c8a"} Jul 29 18:40:44.908109 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:44.908056 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.884482085 podStartE2EDuration="2.908029844s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.547759ms" isStatefulPod=false podCreationTimestamp="2026-07-29 18:40:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:40:44.905601104 +0000 UTC m=+396.245707850" watchObservedRunningTime="2026-07-29 18:40:44.908029844 +0000 UTC m=+396.248136589" Jul 29 18:40:48.234904 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:40:48.234866 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:41:43.234647 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:41:43.234524 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:41:43.250161 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:41:43.250134 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:41:44.144682 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:41:44.144654 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 18:53:19.404215 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:19.404178 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m86wx/must-gather-vjxkg"] Jul 29 18:53:19.407622 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:19.407602 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m86wx/must-gather-vjxkg" Jul 29 18:53:19.411207 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:19.411185 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m86wx\"/\"kube-root-ca.crt\"" Jul 29 18:53:19.411329 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:19.411250 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m86wx\"/\"openshift-service-ca.crt\"" Jul 29 18:53:19.411329 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:19.411256 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-m86wx\"/\"default-dockercfg-v6bzc\"" Jul 29 18:53:19.426482 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:19.426458 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m86wx/must-gather-vjxkg"] Jul 29 18:53:19.501974 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:19.501912 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3b2d9242-71e2-467d-ace3-d62f83e5544f-must-gather-output\") pod \"must-gather-vjxkg\" (UID: \"3b2d9242-71e2-467d-ace3-d62f83e5544f\") " pod="openshift-must-gather-m86wx/must-gather-vjxkg" Jul 29 18:53:19.502140 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:19.502018 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8llg\" (UniqueName: \"kubernetes.io/projected/3b2d9242-71e2-467d-ace3-d62f83e5544f-kube-api-access-m8llg\") pod \"must-gather-vjxkg\" (UID: \"3b2d9242-71e2-467d-ace3-d62f83e5544f\") " pod="openshift-must-gather-m86wx/must-gather-vjxkg" Jul 29 18:53:19.603408 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:19.603372 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8llg\" (UniqueName: \"kubernetes.io/projected/3b2d9242-71e2-467d-ace3-d62f83e5544f-kube-api-access-m8llg\") pod \"must-gather-vjxkg\" (UID: \"3b2d9242-71e2-467d-ace3-d62f83e5544f\") " pod="openshift-must-gather-m86wx/must-gather-vjxkg" Jul 29 18:53:19.603627 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:19.603449 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3b2d9242-71e2-467d-ace3-d62f83e5544f-must-gather-output\") pod \"must-gather-vjxkg\" (UID: \"3b2d9242-71e2-467d-ace3-d62f83e5544f\") " pod="openshift-must-gather-m86wx/must-gather-vjxkg" Jul 29 18:53:19.603886 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:19.603868 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3b2d9242-71e2-467d-ace3-d62f83e5544f-must-gather-output\") pod \"must-gather-vjxkg\" (UID: \"3b2d9242-71e2-467d-ace3-d62f83e5544f\") " pod="openshift-must-gather-m86wx/must-gather-vjxkg" Jul 29 18:53:19.612067 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:19.612045 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8llg\" (UniqueName: \"kubernetes.io/projected/3b2d9242-71e2-467d-ace3-d62f83e5544f-kube-api-access-m8llg\") pod \"must-gather-vjxkg\" (UID: \"3b2d9242-71e2-467d-ace3-d62f83e5544f\") " pod="openshift-must-gather-m86wx/must-gather-vjxkg" Jul 29 18:53:19.726068 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:19.726037 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m86wx/must-gather-vjxkg" Jul 29 18:53:19.861868 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:19.861836 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m86wx/must-gather-vjxkg"] Jul 29 18:53:19.864390 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:53:19.864360 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b2d9242_71e2_467d_ace3_d62f83e5544f.slice/crio-53d8996e9ced07c49dcba53688e058639c2392ae24dfdb7ea598cafe07371644 WatchSource:0}: Error finding container 53d8996e9ced07c49dcba53688e058639c2392ae24dfdb7ea598cafe07371644: Status 404 returned error can't find the container with id 53d8996e9ced07c49dcba53688e058639c2392ae24dfdb7ea598cafe07371644 Jul 29 18:53:19.866108 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:19.866094 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 18:53:19.886248 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:19.886209 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m86wx/must-gather-vjxkg" event={"ID":"3b2d9242-71e2-467d-ace3-d62f83e5544f","Type":"ContainerStarted","Data":"53d8996e9ced07c49dcba53688e058639c2392ae24dfdb7ea598cafe07371644"} Jul 29 18:53:25.917226 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:25.917176 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m86wx/must-gather-vjxkg" event={"ID":"3b2d9242-71e2-467d-ace3-d62f83e5544f","Type":"ContainerStarted","Data":"fa8f79e5fdbc800aa1d3c8415dcbb3d4d0cfbd749238e078d35800e5d5c97a77"} Jul 29 18:53:26.928379 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:26.928333 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m86wx/must-gather-vjxkg" event={"ID":"3b2d9242-71e2-467d-ace3-d62f83e5544f","Type":"ContainerStarted","Data":"4682f2c9f8ebcd1790a41f7a473d5c96c1190cc9d0b992a09a28371e87cc7483"} Jul 29 18:53:26.944416 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:26.944362 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m86wx/must-gather-vjxkg" podStartSLOduration=2.046984026 podStartE2EDuration="7.944345465s" totalImagesPullingTime="5.897361439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:53:26.94391298 +0000 UTC m=+1158.284019725" watchObservedRunningTime="2026-07-29 18:53:26.944345465 +0000 UTC m=+1158.284452233" Jul 29 18:53:38.984862 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:38.984831 2560 generic.go:356] "Generic (PLEG): container finished" podID="3b2d9242-71e2-467d-ace3-d62f83e5544f" containerID="fa8f79e5fdbc800aa1d3c8415dcbb3d4d0cfbd749238e078d35800e5d5c97a77" exitCode=0 Jul 29 18:53:38.985277 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:38.984868 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m86wx/must-gather-vjxkg" event={"ID":"3b2d9242-71e2-467d-ace3-d62f83e5544f","Type":"ContainerDied","Data":"fa8f79e5fdbc800aa1d3c8415dcbb3d4d0cfbd749238e078d35800e5d5c97a77"} Jul 29 18:53:38.985277 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:38.985134 2560 scope.go:117] "RemoveContainer" containerID="fa8f79e5fdbc800aa1d3c8415dcbb3d4d0cfbd749238e078d35800e5d5c97a77" Jul 29 18:53:39.632869 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:39.632838 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-m86wx_must-gather-vjxkg_3b2d9242-71e2-467d-ace3-d62f83e5544f/gather/0.log" Jul 29 18:53:42.746471 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:42.746433 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-txtcd_eae5d913-e185-42ae-9bf9-beabffd3d865/global-pull-secret-syncer/0.log" Jul 29 18:53:42.857751 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:42.857719 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-p2gzm_c3013e3c-44c1-49d0-be60-1a54f6b9d891/konnectivity-agent/0.log" Jul 29 18:53:42.880878 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:42.880837 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-135.ec2.internal_12e8f3118c4c6824b49f49c364fe735b/haproxy/0.log" Jul 29 18:53:44.977934 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:44.977902 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-m86wx/must-gather-vjxkg"] Jul 29 18:53:44.978325 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:44.978081 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-m86wx/must-gather-vjxkg" podUID="3b2d9242-71e2-467d-ace3-d62f83e5544f" containerName="copy" containerID="cri-o://4682f2c9f8ebcd1790a41f7a473d5c96c1190cc9d0b992a09a28371e87cc7483" gracePeriod=2 Jul 29 18:53:44.982460 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:44.982438 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-m86wx/must-gather-vjxkg"] Jul 29 18:53:45.206935 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:45.206909 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-m86wx_must-gather-vjxkg_3b2d9242-71e2-467d-ace3-d62f83e5544f/copy/0.log" Jul 29 18:53:45.209016 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:45.209000 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m86wx/must-gather-vjxkg" Jul 29 18:53:45.211746 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:53:45.211716 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-vjxkg\" is forbidden: User \"system:node:ip-10-0-132-135.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-m86wx\": no relationship found between node 'ip-10-0-132-135.ec2.internal' and this object" podUID="3b2d9242-71e2-467d-ace3-d62f83e5544f" pod="openshift-must-gather-m86wx/must-gather-vjxkg" Jul 29 18:53:45.337957 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:45.337858 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3b2d9242-71e2-467d-ace3-d62f83e5544f-must-gather-output\") pod \"3b2d9242-71e2-467d-ace3-d62f83e5544f\" (UID: \"3b2d9242-71e2-467d-ace3-d62f83e5544f\") " Jul 29 18:53:45.337957 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:45.337903 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8llg\" (UniqueName: \"kubernetes.io/projected/3b2d9242-71e2-467d-ace3-d62f83e5544f-kube-api-access-m8llg\") pod \"3b2d9242-71e2-467d-ace3-d62f83e5544f\" (UID: \"3b2d9242-71e2-467d-ace3-d62f83e5544f\") " Jul 29 18:53:45.338252 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:45.338228 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b2d9242-71e2-467d-ace3-d62f83e5544f-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "3b2d9242-71e2-467d-ace3-d62f83e5544f" (UID: "3b2d9242-71e2-467d-ace3-d62f83e5544f"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 18:53:45.340046 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:45.340026 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b2d9242-71e2-467d-ace3-d62f83e5544f-kube-api-access-m8llg" (OuterVolumeSpecName: "kube-api-access-m8llg") pod "3b2d9242-71e2-467d-ace3-d62f83e5544f" (UID: "3b2d9242-71e2-467d-ace3-d62f83e5544f"). InnerVolumeSpecName "kube-api-access-m8llg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 18:53:45.438698 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:45.438663 2560 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3b2d9242-71e2-467d-ace3-d62f83e5544f-must-gather-output\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:53:45.438698 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:45.438694 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8llg\" (UniqueName: \"kubernetes.io/projected/3b2d9242-71e2-467d-ace3-d62f83e5544f-kube-api-access-m8llg\") on node \"ip-10-0-132-135.ec2.internal\" DevicePath \"\"" Jul 29 18:53:46.014255 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:46.014223 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-m86wx_must-gather-vjxkg_3b2d9242-71e2-467d-ace3-d62f83e5544f/copy/0.log" Jul 29 18:53:46.014670 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:46.014654 2560 generic.go:356] "Generic (PLEG): container finished" podID="3b2d9242-71e2-467d-ace3-d62f83e5544f" containerID="4682f2c9f8ebcd1790a41f7a473d5c96c1190cc9d0b992a09a28371e87cc7483" exitCode=143 Jul 29 18:53:46.014737 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:46.014714 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m86wx/must-gather-vjxkg" Jul 29 18:53:46.014810 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:46.014720 2560 scope.go:117] "RemoveContainer" containerID="4682f2c9f8ebcd1790a41f7a473d5c96c1190cc9d0b992a09a28371e87cc7483" Jul 29 18:53:46.022874 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:46.022852 2560 scope.go:117] "RemoveContainer" containerID="fa8f79e5fdbc800aa1d3c8415dcbb3d4d0cfbd749238e078d35800e5d5c97a77" Jul 29 18:53:46.034200 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:46.034179 2560 scope.go:117] "RemoveContainer" containerID="4682f2c9f8ebcd1790a41f7a473d5c96c1190cc9d0b992a09a28371e87cc7483" Jul 29 18:53:46.034482 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:53:46.034463 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4682f2c9f8ebcd1790a41f7a473d5c96c1190cc9d0b992a09a28371e87cc7483\": container with ID starting with 4682f2c9f8ebcd1790a41f7a473d5c96c1190cc9d0b992a09a28371e87cc7483 not found: ID does not exist" containerID="4682f2c9f8ebcd1790a41f7a473d5c96c1190cc9d0b992a09a28371e87cc7483" Jul 29 18:53:46.034546 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:46.034488 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4682f2c9f8ebcd1790a41f7a473d5c96c1190cc9d0b992a09a28371e87cc7483"} err="failed to get container status \"4682f2c9f8ebcd1790a41f7a473d5c96c1190cc9d0b992a09a28371e87cc7483\": rpc error: code = NotFound desc = could not find container \"4682f2c9f8ebcd1790a41f7a473d5c96c1190cc9d0b992a09a28371e87cc7483\": container with ID starting with 4682f2c9f8ebcd1790a41f7a473d5c96c1190cc9d0b992a09a28371e87cc7483 not found: ID does not exist" Jul 29 18:53:46.034546 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:46.034505 2560 scope.go:117] "RemoveContainer" containerID="fa8f79e5fdbc800aa1d3c8415dcbb3d4d0cfbd749238e078d35800e5d5c97a77" Jul 29 18:53:46.034792 ip-10-0-132-135 kubenswrapper[2560]: E0729 18:53:46.034761 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa8f79e5fdbc800aa1d3c8415dcbb3d4d0cfbd749238e078d35800e5d5c97a77\": container with ID starting with fa8f79e5fdbc800aa1d3c8415dcbb3d4d0cfbd749238e078d35800e5d5c97a77 not found: ID does not exist" containerID="fa8f79e5fdbc800aa1d3c8415dcbb3d4d0cfbd749238e078d35800e5d5c97a77" Jul 29 18:53:46.034875 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:46.034796 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa8f79e5fdbc800aa1d3c8415dcbb3d4d0cfbd749238e078d35800e5d5c97a77"} err="failed to get container status \"fa8f79e5fdbc800aa1d3c8415dcbb3d4d0cfbd749238e078d35800e5d5c97a77\": rpc error: code = NotFound desc = could not find container \"fa8f79e5fdbc800aa1d3c8415dcbb3d4d0cfbd749238e078d35800e5d5c97a77\": container with ID starting with fa8f79e5fdbc800aa1d3c8415dcbb3d4d0cfbd749238e078d35800e5d5c97a77 not found: ID does not exist" Jul 29 18:53:46.752220 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:46.752184 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-lbf7x_171dbb04-212f-4c71-a0df-fb56fff86589/cluster-monitoring-operator/0.log" Jul 29 18:53:46.894815 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:46.894782 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-8hc7q_c3001455-5862-4c52-bf35-10e7e907ac15/monitoring-plugin/0.log" Jul 29 18:53:47.143708 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:47.143627 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xnj4k_58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c/node-exporter/0.log" Jul 29 18:53:47.169270 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:47.169242 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xnj4k_58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c/kube-rbac-proxy/0.log" Jul 29 18:53:47.191186 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:47.191161 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xnj4k_58a2adbe-a8b4-49d2-a4f6-6423e4b5da8c/init-textfile/0.log" Jul 29 18:53:47.225679 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:47.225652 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-n28r7_1f6ff8c3-1d67-484f-af65-1f4b773b7d9c/kube-rbac-proxy-main/0.log" Jul 29 18:53:47.251340 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:47.251313 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-n28r7_1f6ff8c3-1d67-484f-af65-1f4b773b7d9c/kube-rbac-proxy-self/0.log" Jul 29 18:53:47.267124 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:47.267092 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b2d9242-71e2-467d-ace3-d62f83e5544f" path="/var/lib/kubelet/pods/3b2d9242-71e2-467d-ace3-d62f83e5544f/volumes" Jul 29 18:53:47.276689 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:47.276657 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-n28r7_1f6ff8c3-1d67-484f-af65-1f4b773b7d9c/openshift-state-metrics/0.log" Jul 29 18:53:47.324723 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:47.324689 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_822666ae-82ef-49f9-897b-1f5cc6778a30/prometheus/0.log" Jul 29 18:53:47.350095 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:47.350061 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_822666ae-82ef-49f9-897b-1f5cc6778a30/config-reloader/0.log" Jul 29 18:53:47.382327 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:47.382291 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_822666ae-82ef-49f9-897b-1f5cc6778a30/thanos-sidecar/0.log" Jul 29 18:53:47.411258 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:47.411181 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_822666ae-82ef-49f9-897b-1f5cc6778a30/kube-rbac-proxy-web/0.log" Jul 29 18:53:47.435114 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:47.435088 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_822666ae-82ef-49f9-897b-1f5cc6778a30/kube-rbac-proxy/0.log" Jul 29 18:53:47.461062 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:47.461035 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_822666ae-82ef-49f9-897b-1f5cc6778a30/kube-rbac-proxy-thanos/0.log" Jul 29 18:53:47.489309 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:47.489274 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_822666ae-82ef-49f9-897b-1f5cc6778a30/init-config-reloader/0.log" Jul 29 18:53:47.521643 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:47.521603 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-hz8zk_6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c/prometheus-operator/0.log" Jul 29 18:53:47.547734 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:47.547702 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-hz8zk_6a8e9bc2-5558-464b-8ef3-cde9ebf5d17c/kube-rbac-proxy/0.log" Jul 29 18:53:47.580104 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:47.580079 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-zvmk7_94d5c83d-4abf-4cff-8d92-380d696a61b0/prometheus-operator-admission-webhook/0.log" Jul 29 18:53:47.621141 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:47.621114 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d976fc754-4z9b2_55b67a4d-5ec7-48d8-8b08-569f229fb028/telemeter-client/0.log" Jul 29 18:53:47.652358 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:47.652327 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d976fc754-4z9b2_55b67a4d-5ec7-48d8-8b08-569f229fb028/reload/0.log" Jul 29 18:53:47.676430 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:47.676356 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d976fc754-4z9b2_55b67a4d-5ec7-48d8-8b08-569f229fb028/kube-rbac-proxy/0.log" Jul 29 18:53:47.711433 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:47.711396 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f4f999b9c-q8h5f_11a34d1f-bb08-4972-8c38-5552b769d385/thanos-query/0.log" Jul 29 18:53:47.733686 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:47.733656 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f4f999b9c-q8h5f_11a34d1f-bb08-4972-8c38-5552b769d385/kube-rbac-proxy-web/0.log" Jul 29 18:53:47.756669 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:47.756643 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f4f999b9c-q8h5f_11a34d1f-bb08-4972-8c38-5552b769d385/kube-rbac-proxy/0.log" Jul 29 18:53:47.779968 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:47.779943 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f4f999b9c-q8h5f_11a34d1f-bb08-4972-8c38-5552b769d385/prom-label-proxy/0.log" Jul 29 18:53:47.803961 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:47.803934 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f4f999b9c-q8h5f_11a34d1f-bb08-4972-8c38-5552b769d385/kube-rbac-proxy-rules/0.log" Jul 29 18:53:47.828154 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:47.828128 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f4f999b9c-q8h5f_11a34d1f-bb08-4972-8c38-5552b769d385/kube-rbac-proxy-metrics/0.log" Jul 29 18:53:49.085431 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:49.085391 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-l94qg_b762ab1b-627c-44b0-97c5-7d948e4ef348/networking-console-plugin/0.log" Jul 29 18:53:50.055474 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:50.055446 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-nqxhp_a6d09fb3-550c-4079-aac6-29efc75fb8f3/download-server/0.log" Jul 29 18:53:50.534130 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:50.534102 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-j2jv8_f090f40b-71fd-4bda-adbb-84233acde634/volume-data-source-validator/0.log" Jul 29 18:53:50.778415 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:50.778375 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gd9l8/perf-node-gather-daemonset-pgpqd"] Jul 29 18:53:50.778851 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:50.778834 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b2d9242-71e2-467d-ace3-d62f83e5544f" containerName="gather" Jul 29 18:53:50.778943 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:50.778853 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b2d9242-71e2-467d-ace3-d62f83e5544f" containerName="gather" Jul 29 18:53:50.778943 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:50.778862 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b2d9242-71e2-467d-ace3-d62f83e5544f" containerName="copy" Jul 29 18:53:50.778943 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:50.778870 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b2d9242-71e2-467d-ace3-d62f83e5544f" containerName="copy" Jul 29 18:53:50.779093 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:50.778951 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b2d9242-71e2-467d-ace3-d62f83e5544f" containerName="gather" Jul 29 18:53:50.779093 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:50.778968 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b2d9242-71e2-467d-ace3-d62f83e5544f" containerName="copy" Jul 29 18:53:50.782537 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:50.782516 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-pgpqd" Jul 29 18:53:50.785479 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:50.785424 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gd9l8\"/\"default-dockercfg-qsrr2\"" Jul 29 18:53:50.785615 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:50.785491 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gd9l8\"/\"kube-root-ca.crt\"" Jul 29 18:53:50.786367 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:50.786352 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gd9l8\"/\"openshift-service-ca.crt\"" Jul 29 18:53:50.790665 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:50.790642 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gd9l8/perf-node-gather-daemonset-pgpqd"] Jul 29 18:53:50.882511 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:50.882481 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/25c57701-ae16-4f9b-b4b6-7e584809a531-podres\") pod \"perf-node-gather-daemonset-pgpqd\" (UID: \"25c57701-ae16-4f9b-b4b6-7e584809a531\") " pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-pgpqd" Jul 29 18:53:50.882511 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:50.882514 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25c57701-ae16-4f9b-b4b6-7e584809a531-sys\") pod \"perf-node-gather-daemonset-pgpqd\" (UID: \"25c57701-ae16-4f9b-b4b6-7e584809a531\") " pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-pgpqd" Jul 29 18:53:50.882759 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:50.882542 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th9bh\" (UniqueName: \"kubernetes.io/projected/25c57701-ae16-4f9b-b4b6-7e584809a531-kube-api-access-th9bh\") pod \"perf-node-gather-daemonset-pgpqd\" (UID: \"25c57701-ae16-4f9b-b4b6-7e584809a531\") " pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-pgpqd" Jul 29 18:53:50.882759 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:50.882632 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/25c57701-ae16-4f9b-b4b6-7e584809a531-lib-modules\") pod \"perf-node-gather-daemonset-pgpqd\" (UID: \"25c57701-ae16-4f9b-b4b6-7e584809a531\") " pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-pgpqd" Jul 29 18:53:50.882759 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:50.882662 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/25c57701-ae16-4f9b-b4b6-7e584809a531-proc\") pod \"perf-node-gather-daemonset-pgpqd\" (UID: \"25c57701-ae16-4f9b-b4b6-7e584809a531\") " pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-pgpqd" Jul 29 18:53:50.983999 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:50.983938 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th9bh\" (UniqueName: \"kubernetes.io/projected/25c57701-ae16-4f9b-b4b6-7e584809a531-kube-api-access-th9bh\") pod \"perf-node-gather-daemonset-pgpqd\" (UID: \"25c57701-ae16-4f9b-b4b6-7e584809a531\") " pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-pgpqd" Jul 29 18:53:50.984202 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:50.984016 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/25c57701-ae16-4f9b-b4b6-7e584809a531-lib-modules\") pod \"perf-node-gather-daemonset-pgpqd\" (UID: \"25c57701-ae16-4f9b-b4b6-7e584809a531\") " pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-pgpqd" Jul 29 18:53:50.984202 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:50.984061 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/25c57701-ae16-4f9b-b4b6-7e584809a531-proc\") pod \"perf-node-gather-daemonset-pgpqd\" (UID: \"25c57701-ae16-4f9b-b4b6-7e584809a531\") " pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-pgpqd" Jul 29 18:53:50.984202 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:50.984122 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/25c57701-ae16-4f9b-b4b6-7e584809a531-podres\") pod \"perf-node-gather-daemonset-pgpqd\" (UID: \"25c57701-ae16-4f9b-b4b6-7e584809a531\") " pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-pgpqd" Jul 29 18:53:50.984202 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:50.984146 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25c57701-ae16-4f9b-b4b6-7e584809a531-sys\") pod \"perf-node-gather-daemonset-pgpqd\" (UID: \"25c57701-ae16-4f9b-b4b6-7e584809a531\") " pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-pgpqd" Jul 29 18:53:50.984378 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:50.984201 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/25c57701-ae16-4f9b-b4b6-7e584809a531-lib-modules\") pod \"perf-node-gather-daemonset-pgpqd\" (UID: \"25c57701-ae16-4f9b-b4b6-7e584809a531\") " pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-pgpqd" Jul 29 18:53:50.984378 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:50.984211 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/25c57701-ae16-4f9b-b4b6-7e584809a531-proc\") pod \"perf-node-gather-daemonset-pgpqd\" (UID: \"25c57701-ae16-4f9b-b4b6-7e584809a531\") " pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-pgpqd" Jul 29 18:53:50.984378 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:50.984229 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25c57701-ae16-4f9b-b4b6-7e584809a531-sys\") pod \"perf-node-gather-daemonset-pgpqd\" (UID: \"25c57701-ae16-4f9b-b4b6-7e584809a531\") " pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-pgpqd" Jul 29 18:53:50.984378 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:50.984246 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/25c57701-ae16-4f9b-b4b6-7e584809a531-podres\") pod \"perf-node-gather-daemonset-pgpqd\" (UID: \"25c57701-ae16-4f9b-b4b6-7e584809a531\") " pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-pgpqd" Jul 29 18:53:50.992574 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:50.992526 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-th9bh\" (UniqueName: \"kubernetes.io/projected/25c57701-ae16-4f9b-b4b6-7e584809a531-kube-api-access-th9bh\") pod \"perf-node-gather-daemonset-pgpqd\" (UID: \"25c57701-ae16-4f9b-b4b6-7e584809a531\") " pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-pgpqd" Jul 29 18:53:51.093371 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:51.093277 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-pgpqd" Jul 29 18:53:51.227250 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:51.227226 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gd9l8/perf-node-gather-daemonset-pgpqd"] Jul 29 18:53:51.229267 ip-10-0-132-135 kubenswrapper[2560]: W0729 18:53:51.229240 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod25c57701_ae16_4f9b_b4b6_7e584809a531.slice/crio-49ef9056a8cd331adee994477f79e32b6a1cb2965b4d8664d8a09914676900ca WatchSource:0}: Error finding container 49ef9056a8cd331adee994477f79e32b6a1cb2965b4d8664d8a09914676900ca: Status 404 returned error can't find the container with id 49ef9056a8cd331adee994477f79e32b6a1cb2965b4d8664d8a09914676900ca Jul 29 18:53:51.493641 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:51.493592 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tj78n_a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91/dns/0.log" Jul 29 18:53:51.514076 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:51.514046 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tj78n_a2a0e8be-b2ac-4bbf-ad58-6cf79b215b91/kube-rbac-proxy/0.log" Jul 29 18:53:51.586080 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:51.586049 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7zxz4_64c334b9-60b0-4b1b-96b3-c8caaf87f3fc/dns-node-resolver/0.log" Jul 29 18:53:52.042622 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:52.042583 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-pgpqd" event={"ID":"25c57701-ae16-4f9b-b4b6-7e584809a531","Type":"ContainerStarted","Data":"87fd95dcd119bed2c5b052a0fc12bc40fd95f8532018b24ac22d17c362eef760"} Jul 29 18:53:52.042787 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:52.042633 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-pgpqd" event={"ID":"25c57701-ae16-4f9b-b4b6-7e584809a531","Type":"ContainerStarted","Data":"49ef9056a8cd331adee994477f79e32b6a1cb2965b4d8664d8a09914676900ca"} Jul 29 18:53:52.042787 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:52.042674 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-pgpqd" Jul 29 18:53:52.060528 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:52.060480 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-pgpqd" podStartSLOduration=2.060465826 podStartE2EDuration="2.060465826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:53:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:53:52.058349263 +0000 UTC m=+1183.398456008" watchObservedRunningTime="2026-07-29 18:53:52.060465826 +0000 UTC m=+1183.400572571" Jul 29 18:53:52.097201 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:52.097174 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bn2mn_ac39ef91-ebd7-46e9-8001-55b544a7dcea/node-ca/0.log" Jul 29 18:53:53.358138 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:53.358109 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wljgs_b475136a-e94f-4558-a2c8-f1cc51174d5e/serve-healthcheck-canary/0.log" Jul 29 18:53:53.715034 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:53.715006 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2kk8l_dcd6b859-e31a-41e2-8de4-a8168822f2cd/kube-rbac-proxy/0.log" Jul 29 18:53:53.737227 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:53.737194 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2kk8l_dcd6b859-e31a-41e2-8de4-a8168822f2cd/exporter/0.log" Jul 29 18:53:53.762348 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:53.762316 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2kk8l_dcd6b859-e31a-41e2-8de4-a8168822f2cd/extractor/0.log" Jul 29 18:53:58.055856 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:53:58.055825 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-pgpqd" Jul 29 18:54:01.022590 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:54:01.022545 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f8qxk_621948c8-2ee5-4e82-b91b-b316e662af37/kube-multus-additional-cni-plugins/0.log" Jul 29 18:54:01.044517 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:54:01.044490 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f8qxk_621948c8-2ee5-4e82-b91b-b316e662af37/egress-router-binary-copy/0.log" Jul 29 18:54:01.067836 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:54:01.067806 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f8qxk_621948c8-2ee5-4e82-b91b-b316e662af37/cni-plugins/0.log" Jul 29 18:54:01.087966 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:54:01.087939 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f8qxk_621948c8-2ee5-4e82-b91b-b316e662af37/bond-cni-plugin/0.log" Jul 29 18:54:01.108350 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:54:01.108319 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f8qxk_621948c8-2ee5-4e82-b91b-b316e662af37/routeoverride-cni/0.log" Jul 29 18:54:01.132971 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:54:01.132944 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f8qxk_621948c8-2ee5-4e82-b91b-b316e662af37/whereabouts-cni-bincopy/0.log" Jul 29 18:54:01.155769 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:54:01.155744 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f8qxk_621948c8-2ee5-4e82-b91b-b316e662af37/whereabouts-cni/0.log" Jul 29 18:54:01.515188 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:54:01.515162 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bnb6z_e3f7153c-aca1-4eae-8b30-d47df7715005/kube-multus/0.log" Jul 29 18:54:01.540079 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:54:01.540052 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-94h2v_1e43e1c7-433e-4559-8fa2-2c818770dc36/network-metrics-daemon/0.log" Jul 29 18:54:01.563122 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:54:01.563099 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-94h2v_1e43e1c7-433e-4559-8fa2-2c818770dc36/kube-rbac-proxy/0.log" Jul 29 18:54:02.657092 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:54:02.657063 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nldtg_d908e5bd-1d3b-4142-a730-c1993b33b31f/ovn-controller/0.log" Jul 29 18:54:02.675690 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:54:02.675657 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nldtg_d908e5bd-1d3b-4142-a730-c1993b33b31f/ovn-acl-logging/0.log" Jul 29 18:54:02.706971 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:54:02.706938 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nldtg_d908e5bd-1d3b-4142-a730-c1993b33b31f/kube-rbac-proxy-node/0.log" Jul 29 18:54:02.731646 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:54:02.731613 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nldtg_d908e5bd-1d3b-4142-a730-c1993b33b31f/kube-rbac-proxy-ovn-metrics/0.log" Jul 29 18:54:02.749009 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:54:02.748977 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nldtg_d908e5bd-1d3b-4142-a730-c1993b33b31f/northd/0.log" Jul 29 18:54:02.770888 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:54:02.770855 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nldtg_d908e5bd-1d3b-4142-a730-c1993b33b31f/nbdb/0.log" Jul 29 18:54:02.791339 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:54:02.791308 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nldtg_d908e5bd-1d3b-4142-a730-c1993b33b31f/sbdb/0.log" Jul 29 18:54:02.848865 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:54:02.848835 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nldtg_d908e5bd-1d3b-4142-a730-c1993b33b31f/ovnkube-controller/0.log" Jul 29 18:54:04.010602 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:54:04.010551 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7d88cb55d8-kl2tw_f8172992-b0a4-4052-8f49-cea2640071ec/check-endpoints/0.log" Jul 29 18:54:04.058746 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:54:04.058719 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-rsmkr_0bd004cf-695f-4759-ad1a-daa6563fbc3a/network-check-target-container/0.log" Jul 29 18:54:05.018235 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:54:05.018211 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-w6ng5_2be38e75-d5f3-48a1-a3eb-705b9ac9b7ae/iptables-alerter/0.log" Jul 29 18:54:05.617693 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:54:05.617657 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-2k7fr_dbb024f4-9e95-49a4-968b-f161254485e2/tuned/0.log" Jul 29 18:54:07.366506 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:54:07.366476 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-5dgjv_5a486c64-b769-4520-964d-770b838d4d89/cluster-samples-operator/0.log" Jul 29 18:54:07.381880 ip-10-0-132-135 kubenswrapper[2560]: I0729 18:54:07.381844 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-5dgjv_5a486c64-b769-4520-964d-770b838d4d89/cluster-samples-operator-watch/0.log"