Jul 29 15:43:40.972881 ip-10-0-142-124 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 29 15:43:40.972895 ip-10-0-142-124 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 29 15:43:40.972904 ip-10-0-142-124 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 29 15:43:40.973199 ip-10-0-142-124 systemd[1]: Failed to start Kubernetes Kubelet. Jul 29 15:43:51.009925 ip-10-0-142-124 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 29 15:43:51.009945 ip-10-0-142-124 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot a047972aafef4d0bbc574d831235b210 -- Jul 29 15:45:50.211239 ip-10-0-142-124 systemd[1]: Starting Kubernetes Kubelet... Jul 29 15:45:50.549958 ip-10-0-142-124 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 15:45:50.549958 ip-10-0-142-124 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 29 15:45:50.549958 ip-10-0-142-124 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 15:45:50.549958 ip-10-0-142-124 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 29 15:45:50.549958 ip-10-0-142-124 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 15:45:50.552408 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.552239 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 29 15:45:50.558039 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558012 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:45:50.558039 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558035 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:45:50.558168 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558056 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:45:50.558168 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558068 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:45:50.558168 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558073 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:45:50.558168 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558078 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:45:50.558168 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558084 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:45:50.558168 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558088 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:45:50.558168 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558093 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:45:50.558168 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558097 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:45:50.558168 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558102 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:45:50.558168 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558106 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:45:50.558168 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558110 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:45:50.558168 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558115 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:45:50.558168 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558120 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:45:50.558168 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558129 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:45:50.558168 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558133 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:45:50.558168 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558137 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:45:50.558168 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558142 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:45:50.558168 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558146 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:45:50.558168 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558150 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:45:50.558168 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558154 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:45:50.558658 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558159 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:45:50.558658 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558163 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:45:50.558658 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558167 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:45:50.558658 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558172 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:45:50.558658 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558176 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:45:50.558658 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558181 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:45:50.558658 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558190 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:45:50.558658 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558195 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:45:50.558658 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558199 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:45:50.558658 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558203 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:45:50.558658 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558207 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:45:50.558658 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558212 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:45:50.558658 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558216 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:45:50.558658 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558234 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:45:50.558658 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558239 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:45:50.558658 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558244 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:45:50.558658 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558248 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:45:50.558658 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558253 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:45:50.558658 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558263 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:45:50.558658 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558267 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:45:50.559162 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558271 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:45:50.559162 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558275 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:45:50.559162 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558281 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:45:50.559162 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558285 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:45:50.559162 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558289 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:45:50.559162 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558293 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:45:50.559162 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558300 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:45:50.559162 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558305 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:45:50.559162 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558309 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:45:50.559162 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558313 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:45:50.559162 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558331 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:45:50.559162 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558337 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:45:50.559162 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558341 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:45:50.559162 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558346 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:45:50.559162 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558350 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:45:50.559162 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558354 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:45:50.559162 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558358 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:45:50.559162 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558363 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:45:50.559162 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558367 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:45:50.559162 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558378 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:45:50.559638 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558382 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:45:50.559638 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558386 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:45:50.559638 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558392 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:45:50.559638 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558439 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:45:50.559638 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558542 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:45:50.559638 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558548 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:45:50.559638 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558553 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:45:50.559638 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558556 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:45:50.559638 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558559 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:45:50.559638 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558562 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:45:50.559638 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558568 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:45:50.559638 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558572 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:45:50.559638 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558575 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:45:50.559638 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558578 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:45:50.559638 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558585 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:45:50.559638 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558588 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:45:50.559638 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558591 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:45:50.559638 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558594 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:45:50.559638 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558596 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:45:50.560115 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558599 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:45:50.560115 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558602 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:45:50.560115 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558605 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:45:50.560115 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558608 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:45:50.560115 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558611 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:45:50.560115 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558615 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:45:50.560115 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558619 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:45:50.560115 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558622 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:45:50.560115 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558625 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:45:50.560115 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558628 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:45:50.560115 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558630 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:45:50.560115 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558633 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:45:50.560115 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558636 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:45:50.560115 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558639 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:45:50.560115 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558641 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:45:50.560115 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558646 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:45:50.560115 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558651 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:45:50.560115 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.558654 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:45:50.560115 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559454 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:45:50.560597 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559462 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:45:50.560597 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559465 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:45:50.560597 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559468 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:45:50.560597 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559471 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:45:50.560597 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559474 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:45:50.560597 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559476 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:45:50.560597 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559479 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:45:50.560597 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559482 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:45:50.560597 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559484 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:45:50.560597 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559487 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:45:50.560597 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559490 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:45:50.560597 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559492 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:45:50.560597 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559495 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:45:50.560597 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559498 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:45:50.560597 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559500 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:45:50.560597 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559503 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:45:50.560597 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559506 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:45:50.560597 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559508 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:45:50.560597 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559511 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:45:50.560597 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559513 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:45:50.561101 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559516 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:45:50.561101 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559518 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:45:50.561101 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559521 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:45:50.561101 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559523 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:45:50.561101 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559526 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:45:50.561101 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559528 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:45:50.561101 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559530 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:45:50.561101 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559534 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:45:50.561101 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559536 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:45:50.561101 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559539 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:45:50.561101 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559542 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:45:50.561101 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559544 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:45:50.561101 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559547 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:45:50.561101 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559550 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:45:50.561101 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559552 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:45:50.561101 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559555 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:45:50.561101 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559557 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:45:50.561101 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559560 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:45:50.561101 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559562 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:45:50.561560 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559566 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:45:50.561560 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559569 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:45:50.561560 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559572 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:45:50.561560 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559576 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:45:50.561560 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559580 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:45:50.561560 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559583 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:45:50.561560 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559586 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:45:50.561560 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559590 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:45:50.561560 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559593 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:45:50.561560 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559596 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:45:50.561560 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559600 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:45:50.561560 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559602 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:45:50.561560 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559605 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:45:50.561560 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559607 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:45:50.561560 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559610 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:45:50.561560 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559613 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:45:50.561560 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559615 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:45:50.561560 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559618 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:45:50.561560 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559621 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:45:50.562034 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559624 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:45:50.562034 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559626 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:45:50.562034 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559629 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:45:50.562034 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559631 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:45:50.562034 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559633 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:45:50.562034 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559636 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:45:50.562034 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559638 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:45:50.562034 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559641 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:45:50.562034 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559643 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:45:50.562034 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559646 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:45:50.562034 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559648 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:45:50.562034 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559652 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:45:50.562034 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559656 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:45:50.562034 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559658 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:45:50.562034 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559661 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:45:50.562034 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559663 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:45:50.562034 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559667 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:45:50.562034 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559670 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:45:50.562034 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559672 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:45:50.562034 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559676 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:45:50.562529 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559678 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:45:50.562529 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559681 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:45:50.562529 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559684 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:45:50.562529 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559687 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:45:50.562529 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559690 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:45:50.562529 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559693 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:45:50.562529 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559695 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:45:50.562529 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559698 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:45:50.562529 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559700 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:45:50.562529 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559703 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:45:50.562529 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559705 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:45:50.562529 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559708 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:45:50.562529 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559711 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:45:50.562529 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559713 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:45:50.562529 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559716 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:45:50.562529 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559718 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:45:50.562529 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559720 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:45:50.562529 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559723 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:45:50.562529 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559725 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:45:50.562529 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.559728 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:45:50.563029 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560135 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:45:50.563029 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560140 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:45:50.563029 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560143 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:45:50.563029 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560146 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:45:50.563029 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560149 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:45:50.563029 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560151 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:45:50.563029 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560154 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:45:50.563029 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560157 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:45:50.563029 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560160 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:45:50.563029 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560163 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:45:50.563029 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560165 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:45:50.563029 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560168 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:45:50.563029 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560172 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:45:50.563029 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560175 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:45:50.563029 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560178 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:45:50.563029 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560181 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:45:50.563029 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560185 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:45:50.563029 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560188 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:45:50.563029 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560191 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:45:50.563029 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560193 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:45:50.563523 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560196 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:45:50.563523 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560199 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:45:50.563523 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560202 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:45:50.563523 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560205 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:45:50.563523 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560208 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:45:50.563523 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560211 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:45:50.563523 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560214 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:45:50.563523 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560217 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:45:50.563523 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560219 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:45:50.563523 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560222 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:45:50.563523 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560224 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:45:50.563523 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560227 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:45:50.563523 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560229 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:45:50.563523 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560232 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:45:50.563523 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560235 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:45:50.563523 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560238 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:45:50.563523 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560240 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:45:50.563523 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560244 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:45:50.563523 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560247 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:45:50.563977 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560250 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:45:50.563977 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560253 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:45:50.563977 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560256 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:45:50.563977 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560258 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:45:50.563977 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560261 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:45:50.563977 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560263 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:45:50.563977 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560266 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:45:50.563977 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560268 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:45:50.563977 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560271 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:45:50.563977 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560273 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:45:50.563977 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560279 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:45:50.563977 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560282 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:45:50.563977 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560284 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:45:50.563977 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560287 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:45:50.563977 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560289 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:45:50.563977 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560291 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:45:50.563977 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560294 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:45:50.563977 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560296 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:45:50.563977 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560298 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:45:50.563977 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560301 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:45:50.564457 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560303 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:45:50.564457 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560306 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:45:50.564457 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560308 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:45:50.564457 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560312 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:45:50.564457 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560314 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:45:50.564457 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560316 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:45:50.564457 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560319 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:45:50.564457 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560322 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:45:50.564457 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560324 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:45:50.564457 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560327 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:45:50.564457 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560329 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:45:50.564457 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560332 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:45:50.564457 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560334 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:45:50.564457 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560337 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:45:50.564457 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560339 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:45:50.564457 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560342 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:45:50.564457 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560344 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:45:50.564457 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560347 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:45:50.564457 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560349 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:45:50.564457 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560352 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:45:50.564940 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560354 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:45:50.564940 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560357 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:45:50.564940 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560359 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:45:50.564940 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560363 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:45:50.564940 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560365 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:45:50.564940 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560367 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:45:50.564940 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560370 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:45:50.564940 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560372 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:45:50.564940 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560375 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:45:50.564940 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560377 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:45:50.564940 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560379 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:45:50.564940 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560382 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:45:50.564940 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560384 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:45:50.564940 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560387 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:45:50.564940 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560389 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:45:50.564940 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560391 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:45:50.564940 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560394 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:45:50.564940 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560396 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:45:50.564940 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560398 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:45:50.564940 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.560401 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:45:50.564940 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560473 2567 flags.go:64] FLAG: --address="0.0.0.0" Jul 29 15:45:50.565488 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560481 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 29 15:45:50.565488 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560487 2567 flags.go:64] FLAG: --anonymous-auth="true" Jul 29 15:45:50.565488 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560495 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 29 15:45:50.565488 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560503 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 29 15:45:50.565488 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560506 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 29 15:45:50.565488 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560510 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 29 15:45:50.565488 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560514 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 29 15:45:50.565488 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560517 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 29 15:45:50.565488 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560520 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 29 15:45:50.565488 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560523 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 29 15:45:50.565488 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560526 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 29 15:45:50.565488 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560529 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 29 15:45:50.565488 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560531 2567 flags.go:64] FLAG: --cgroup-root="" Jul 29 15:45:50.565488 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560534 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 29 15:45:50.565488 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560539 2567 flags.go:64] FLAG: --client-ca-file="" Jul 29 15:45:50.565488 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560545 2567 flags.go:64] FLAG: --cloud-provider="external" Jul 29 15:45:50.565488 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560549 2567 flags.go:64] FLAG: --cluster-dns="[]" Jul 29 15:45:50.565488 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560556 2567 flags.go:64] FLAG: --cluster-domain="" Jul 29 15:45:50.565488 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560560 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 29 15:45:50.565488 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560565 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 29 15:45:50.565488 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560568 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 29 15:45:50.565488 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560572 2567 flags.go:64] FLAG: --container-log-max-files="5" Jul 29 15:45:50.565488 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560576 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 29 15:45:50.565488 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560579 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 29 15:45:50.566078 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560581 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 29 15:45:50.566078 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560585 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 29 15:45:50.566078 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560588 2567 flags.go:64] FLAG: --contention-profiling="false" Jul 29 15:45:50.566078 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560591 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 29 15:45:50.566078 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560593 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 29 15:45:50.566078 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560596 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 29 15:45:50.566078 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560599 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 29 15:45:50.566078 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560603 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 29 15:45:50.566078 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560606 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 29 15:45:50.566078 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560609 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 29 15:45:50.566078 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560612 2567 flags.go:64] FLAG: --enable-load-reader="false" Jul 29 15:45:50.566078 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560616 2567 flags.go:64] FLAG: --enable-server="true" Jul 29 15:45:50.566078 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560619 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 29 15:45:50.566078 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560624 2567 flags.go:64] FLAG: --event-burst="100" Jul 29 15:45:50.566078 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560627 2567 flags.go:64] FLAG: --event-qps="50" Jul 29 15:45:50.566078 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560630 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 29 15:45:50.566078 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560633 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 29 15:45:50.566078 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560635 2567 flags.go:64] FLAG: --eviction-hard="" Jul 29 15:45:50.566078 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560639 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 29 15:45:50.566078 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560642 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 29 15:45:50.566078 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560645 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 29 15:45:50.566078 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560648 2567 flags.go:64] FLAG: --eviction-soft="" Jul 29 15:45:50.566078 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560651 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 29 15:45:50.566078 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560653 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 29 15:45:50.566078 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560660 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 29 15:45:50.566707 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560664 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jul 29 15:45:50.566707 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560667 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 29 15:45:50.566707 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560670 2567 flags.go:64] FLAG: --fail-swap-on="true" Jul 29 15:45:50.566707 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560673 2567 flags.go:64] FLAG: --feature-gates="" Jul 29 15:45:50.566707 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560677 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jul 29 15:45:50.566707 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560680 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 29 15:45:50.566707 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560683 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 29 15:45:50.566707 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560686 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 29 15:45:50.566707 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560689 2567 flags.go:64] FLAG: --healthz-port="10248" Jul 29 15:45:50.566707 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560691 2567 flags.go:64] FLAG: --help="false" Jul 29 15:45:50.566707 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560694 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-142-124.ec2.internal" Jul 29 15:45:50.566707 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560697 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 29 15:45:50.566707 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560700 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jul 29 15:45:50.566707 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560703 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 29 15:45:50.566707 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560706 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 29 15:45:50.566707 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560710 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 29 15:45:50.566707 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560713 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 29 15:45:50.566707 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560715 2567 flags.go:64] FLAG: --image-service-endpoint="" Jul 29 15:45:50.566707 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560719 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 29 15:45:50.566707 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560722 2567 flags.go:64] FLAG: --kube-api-burst="100" Jul 29 15:45:50.566707 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560725 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 29 15:45:50.566707 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560728 2567 flags.go:64] FLAG: --kube-api-qps="50" Jul 29 15:45:50.566707 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560731 2567 flags.go:64] FLAG: --kube-reserved="" Jul 29 15:45:50.566707 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560733 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 29 15:45:50.567378 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560736 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 29 15:45:50.567378 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560739 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jul 29 15:45:50.567378 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560741 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 29 15:45:50.567378 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560744 2567 flags.go:64] FLAG: --lock-file="" Jul 29 15:45:50.567378 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560747 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 29 15:45:50.567378 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560749 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 29 15:45:50.567378 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560752 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 29 15:45:50.567378 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560757 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jul 29 15:45:50.567378 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560761 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 29 15:45:50.567378 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560763 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jul 29 15:45:50.567378 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560766 2567 flags.go:64] FLAG: --logging-format="text" Jul 29 15:45:50.567378 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560769 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 29 15:45:50.567378 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560772 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 29 15:45:50.567378 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560775 2567 flags.go:64] FLAG: --manifest-url="" Jul 29 15:45:50.567378 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560777 2567 flags.go:64] FLAG: --manifest-url-header="" Jul 29 15:45:50.567378 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560781 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 29 15:45:50.567378 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560784 2567 flags.go:64] FLAG: --max-open-files="1000000" Jul 29 15:45:50.567378 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560789 2567 flags.go:64] FLAG: --max-pods="110" Jul 29 15:45:50.567378 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560791 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 29 15:45:50.567378 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560794 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 29 15:45:50.567378 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560797 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jul 29 15:45:50.567378 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560800 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 29 15:45:50.567378 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560802 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 29 15:45:50.567378 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560805 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 29 15:45:50.567378 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560808 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 29 15:45:50.567991 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560818 2567 flags.go:64] FLAG: --node-status-max-images="50" Jul 29 15:45:50.567991 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560822 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 29 15:45:50.567991 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560825 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jul 29 15:45:50.567991 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560828 2567 flags.go:64] FLAG: --pod-cidr="" Jul 29 15:45:50.567991 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560831 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 29 15:45:50.567991 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560836 2567 flags.go:64] FLAG: --pod-manifest-path="" Jul 29 15:45:50.567991 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560839 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jul 29 15:45:50.567991 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560842 2567 flags.go:64] FLAG: --pods-per-core="0" Jul 29 15:45:50.567991 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560845 2567 flags.go:64] FLAG: --port="10250" Jul 29 15:45:50.567991 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560848 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 29 15:45:50.567991 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560850 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e2a281c43bcd7fb4" Jul 29 15:45:50.567991 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560854 2567 flags.go:64] FLAG: --qos-reserved="" Jul 29 15:45:50.567991 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560856 2567 flags.go:64] FLAG: --read-only-port="10255" Jul 29 15:45:50.567991 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560859 2567 flags.go:64] FLAG: --register-node="true" Jul 29 15:45:50.567991 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560862 2567 flags.go:64] FLAG: --register-with-taints="" Jul 29 15:45:50.567991 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560865 2567 flags.go:64] FLAG: --registry-burst="10" Jul 29 15:45:50.567991 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560869 2567 flags.go:64] FLAG: --registry-qps="5" Jul 29 15:45:50.567991 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560871 2567 flags.go:64] FLAG: --reserved-cpus="" Jul 29 15:45:50.567991 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560874 2567 flags.go:64] FLAG: --reserved-memory="" Jul 29 15:45:50.567991 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560878 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 29 15:45:50.567991 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560880 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 29 15:45:50.567991 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560883 2567 flags.go:64] FLAG: --rotate-certificates="false" Jul 29 15:45:50.567991 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560886 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 29 15:45:50.567991 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560888 2567 flags.go:64] FLAG: --runonce="false" Jul 29 15:45:50.567991 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560891 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 29 15:45:50.568649 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560894 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 29 15:45:50.568649 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560896 2567 flags.go:64] FLAG: --seccomp-default="false" Jul 29 15:45:50.568649 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560903 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 29 15:45:50.568649 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560906 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 29 15:45:50.568649 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560909 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 29 15:45:50.568649 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560912 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 29 15:45:50.568649 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560915 2567 flags.go:64] FLAG: --storage-driver-password="root" Jul 29 15:45:50.568649 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560918 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jul 29 15:45:50.568649 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560921 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jul 29 15:45:50.568649 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560924 2567 flags.go:64] FLAG: --storage-driver-user="root" Jul 29 15:45:50.568649 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560927 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 29 15:45:50.568649 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560943 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 29 15:45:50.568649 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560946 2567 flags.go:64] FLAG: --system-cgroups="" Jul 29 15:45:50.568649 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560949 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 29 15:45:50.568649 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560955 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 29 15:45:50.568649 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560957 2567 flags.go:64] FLAG: --tls-cert-file="" Jul 29 15:45:50.568649 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560960 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 29 15:45:50.568649 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560964 2567 flags.go:64] FLAG: --tls-min-version="" Jul 29 15:45:50.568649 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560967 2567 flags.go:64] FLAG: --tls-private-key-file="" Jul 29 15:45:50.568649 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560970 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jul 29 15:45:50.568649 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560973 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 29 15:45:50.568649 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560976 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jul 29 15:45:50.568649 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560978 2567 flags.go:64] FLAG: --v="2" Jul 29 15:45:50.568649 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560982 2567 flags.go:64] FLAG: --version="false" Jul 29 15:45:50.568649 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560987 2567 flags.go:64] FLAG: --vmodule="" Jul 29 15:45:50.569272 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560991 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 29 15:45:50.569272 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.560994 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 29 15:45:50.569272 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561113 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:45:50.569272 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561117 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:45:50.569272 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561120 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:45:50.569272 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561123 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:45:50.569272 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561125 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:45:50.569272 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561127 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:45:50.569272 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561130 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:45:50.569272 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561134 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:45:50.569272 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561136 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:45:50.569272 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561139 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:45:50.569272 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561142 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:45:50.569272 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561144 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:45:50.569272 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561147 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:45:50.569272 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561150 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:45:50.569272 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561153 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:45:50.569272 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561157 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:45:50.569272 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561161 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:45:50.569272 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561164 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:45:50.569751 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561168 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:45:50.569751 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561171 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:45:50.569751 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561175 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:45:50.569751 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561177 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:45:50.569751 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561181 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:45:50.569751 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561183 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:45:50.569751 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561186 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:45:50.569751 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561188 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:45:50.569751 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561191 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:45:50.569751 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561193 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:45:50.569751 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561195 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:45:50.569751 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561198 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:45:50.569751 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561201 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:45:50.569751 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561204 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:45:50.569751 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561206 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:45:50.569751 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561210 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:45:50.569751 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561213 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:45:50.569751 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561216 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:45:50.569751 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561219 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:45:50.570227 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561222 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:45:50.570227 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561224 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:45:50.570227 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561228 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:45:50.570227 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561231 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:45:50.570227 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561234 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:45:50.570227 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561236 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:45:50.570227 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561239 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:45:50.570227 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561241 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:45:50.570227 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561245 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:45:50.570227 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561247 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:45:50.570227 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561250 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:45:50.570227 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561253 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:45:50.570227 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561255 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:45:50.570227 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561257 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:45:50.570227 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561260 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:45:50.570227 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561262 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:45:50.570227 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561265 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:45:50.570227 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561267 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:45:50.570227 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561269 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:45:50.570696 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561272 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:45:50.570696 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561275 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:45:50.570696 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561277 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:45:50.570696 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561279 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:45:50.570696 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561282 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:45:50.570696 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561284 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:45:50.570696 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561286 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:45:50.570696 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561289 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:45:50.570696 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561292 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:45:50.570696 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561294 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:45:50.570696 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561296 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:45:50.570696 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561299 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:45:50.570696 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561301 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:45:50.570696 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561304 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:45:50.570696 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561306 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:45:50.570696 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561309 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:45:50.570696 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561312 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:45:50.570696 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561314 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:45:50.570696 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561317 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:45:50.570696 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561319 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:45:50.571192 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561322 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:45:50.571192 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561325 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:45:50.571192 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561328 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:45:50.571192 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561330 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:45:50.571192 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561333 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:45:50.571192 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561335 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:45:50.571192 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561338 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:45:50.571192 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561340 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:45:50.571192 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561343 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:45:50.571192 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561345 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:45:50.571192 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561347 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:45:50.571192 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561350 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:45:50.571192 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561352 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:45:50.571192 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561354 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:45:50.571192 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561357 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:45:50.571192 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561359 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:45:50.571192 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561362 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:45:50.571192 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561364 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:45:50.571192 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561367 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:45:50.571192 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561369 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:45:50.571684 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561373 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:45:50.571684 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561375 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:45:50.571684 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.561377 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:45:50.571684 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.561910 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 15:45:50.571684 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.568415 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 29 15:45:50.571684 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.568432 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 29 15:45:50.571684 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.569058 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 29 15:45:50.571684 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.569069 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 29 15:45:50.571684 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569127 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:45:50.571684 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569131 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:45:50.571684 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569135 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:45:50.571684 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569137 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:45:50.571684 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569140 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:45:50.571684 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569143 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:45:50.571684 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569145 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:45:50.572086 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569148 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:45:50.572086 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569150 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:45:50.572086 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569153 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:45:50.572086 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569156 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:45:50.572086 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569159 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:45:50.572086 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569161 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:45:50.572086 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569164 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:45:50.572086 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569166 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:45:50.572086 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569169 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:45:50.572086 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569171 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:45:50.572086 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569174 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:45:50.572086 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569176 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:45:50.572086 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569179 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:45:50.572086 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569181 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:45:50.572086 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569184 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:45:50.572086 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569186 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:45:50.572086 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569189 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:45:50.572086 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569194 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:45:50.572086 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569197 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:45:50.572600 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569200 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:45:50.572600 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569203 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:45:50.572600 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569207 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:45:50.572600 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569212 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:45:50.572600 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569215 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:45:50.572600 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569218 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:45:50.572600 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569222 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:45:50.572600 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569226 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:45:50.572600 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569229 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:45:50.572600 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569232 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:45:50.572600 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569235 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:45:50.572600 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569238 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:45:50.572600 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569241 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:45:50.572600 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569244 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:45:50.572600 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569247 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:45:50.572600 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569249 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:45:50.572600 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569252 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:45:50.572600 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569254 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:45:50.572600 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569257 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:45:50.573077 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569259 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:45:50.573077 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569262 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:45:50.573077 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569265 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:45:50.573077 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569267 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:45:50.573077 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569269 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:45:50.573077 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569272 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:45:50.573077 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569274 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:45:50.573077 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569277 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:45:50.573077 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569280 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:45:50.573077 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569283 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:45:50.573077 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569285 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:45:50.573077 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569288 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:45:50.573077 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569290 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:45:50.573077 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569293 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:45:50.573077 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569295 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:45:50.573077 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569298 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:45:50.573077 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569301 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:45:50.573077 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569305 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:45:50.573077 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569307 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:45:50.573077 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569310 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:45:50.573685 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569312 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:45:50.573685 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569315 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:45:50.573685 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569318 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:45:50.573685 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569320 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:45:50.573685 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569322 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:45:50.573685 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569326 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:45:50.573685 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569329 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:45:50.573685 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569332 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:45:50.573685 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569334 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:45:50.573685 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569337 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:45:50.573685 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569340 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:45:50.573685 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569342 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:45:50.573685 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569345 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:45:50.573685 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569347 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:45:50.573685 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569349 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:45:50.573685 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569352 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:45:50.573685 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569354 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:45:50.573685 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569357 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:45:50.573685 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569359 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:45:50.573685 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569361 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:45:50.574214 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569364 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:45:50.574214 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569366 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:45:50.574214 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569369 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:45:50.574214 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569371 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:45:50.574214 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569374 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:45:50.574214 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569377 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:45:50.574214 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569379 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:45:50.574214 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569382 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:45:50.574214 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569385 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:45:50.574214 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569387 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:45:50.574214 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569390 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:45:50.574214 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569393 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:45:50.574214 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569395 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:45:50.574214 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569397 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:45:50.574563 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.569403 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 15:45:50.574563 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569550 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:45:50.574563 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569556 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:45:50.574563 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569560 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:45:50.574563 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569563 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:45:50.574563 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569566 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:45:50.574563 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569569 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:45:50.574563 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569572 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:45:50.574563 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569574 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:45:50.574563 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569577 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:45:50.574563 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569580 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:45:50.574563 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569583 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:45:50.574563 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569585 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:45:50.574563 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569587 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:45:50.574563 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569590 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:45:50.575037 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569593 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:45:50.575037 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569595 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:45:50.575037 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569598 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:45:50.575037 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569600 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:45:50.575037 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569602 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:45:50.575037 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569605 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:45:50.575037 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569607 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:45:50.575037 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569609 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:45:50.575037 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569612 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:45:50.575037 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569615 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:45:50.575037 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569620 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:45:50.575037 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569623 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:45:50.575037 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569626 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:45:50.575037 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569629 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:45:50.575037 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569632 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:45:50.575037 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569634 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:45:50.575037 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569637 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:45:50.575037 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569639 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:45:50.575037 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569642 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:45:50.575525 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569644 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:45:50.575525 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569647 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:45:50.575525 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569649 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:45:50.575525 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569652 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:45:50.575525 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569654 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:45:50.575525 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569656 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:45:50.575525 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569659 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:45:50.575525 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569661 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:45:50.575525 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569663 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:45:50.575525 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569666 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:45:50.575525 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569668 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:45:50.575525 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569671 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:45:50.575525 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569673 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:45:50.575525 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569677 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:45:50.575525 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569680 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:45:50.575525 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569683 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:45:50.575525 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569686 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:45:50.575525 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569689 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:45:50.575525 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569691 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:45:50.575525 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569694 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:45:50.576262 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569697 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:45:50.576262 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569699 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:45:50.576262 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569701 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:45:50.576262 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569704 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:45:50.576262 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569706 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:45:50.576262 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569709 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:45:50.576262 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569711 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:45:50.576262 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569714 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:45:50.576262 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569723 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:45:50.576262 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569726 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:45:50.576262 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569728 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:45:50.576262 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569731 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:45:50.576262 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569733 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:45:50.576262 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569735 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:45:50.576262 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569738 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:45:50.576262 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569741 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:45:50.576262 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569744 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:45:50.576262 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569746 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:45:50.576262 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569748 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:45:50.576262 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569751 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:45:50.576967 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569753 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:45:50.576967 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569756 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:45:50.576967 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569758 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:45:50.576967 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569761 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:45:50.576967 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569763 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:45:50.576967 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569766 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:45:50.576967 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569768 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:45:50.576967 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569771 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:45:50.576967 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569773 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:45:50.576967 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569775 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:45:50.576967 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569778 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:45:50.576967 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569780 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:45:50.576967 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569783 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:45:50.576967 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569785 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:45:50.576967 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569787 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:45:50.576967 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569790 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:45:50.576967 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569793 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:45:50.576967 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569795 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:45:50.576967 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569798 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:45:50.576967 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569800 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:45:50.577686 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569803 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:45:50.577686 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569811 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:45:50.577686 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569813 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:45:50.577686 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569815 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:45:50.577686 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569818 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:45:50.577686 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:50.569822 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:45:50.577686 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.569827 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 15:45:50.577686 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.569998 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jul 29 15:45:50.577686 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.571989 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 29 15:45:50.577686 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.573106 2567 server.go:1019] "Starting client certificate rotation" Jul 29 15:45:50.577686 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.573246 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 15:45:50.577686 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.573299 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 15:45:50.577686 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.575696 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 15:45:50.578095 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.578077 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 15:45:50.588154 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.588132 2567 log.go:25] "Validated CRI v1 runtime API" Jul 29 15:45:50.589973 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.589954 2567 log.go:25] "Validated CRI v1 image API" Jul 29 15:45:50.590796 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.590780 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 29 15:45:50.593506 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.593484 2567 fs.go:135] Filesystem UUIDs: map[1e74c510-9120-476b-b0d4-6e0248e203ea:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 90f75afa-404d-4f60-976d-175df6ca1566:/dev/nvme0n1p4] Jul 29 15:45:50.593577 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.593506 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 29 15:45:50.598631 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.598492 2567 manager.go:216] Machine: {Timestamp:2026-07-29 15:45:50.597265903 +0000 UTC m=+0.280349200 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099775 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2598659dcba05059323c8777d5f0c1 SystemUUID:ec259865-9dcb-a050-5932-3c8777d5f0c1 BootID:a047972a-afef-4d0b-bc57-4d831235b210 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b5:6b:b6:bb:95 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b5:6b:b6:bb:95 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:33:60:cb:fa:cd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 29 15:45:50.598631 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.598622 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 29 15:45:50.598802 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.598734 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 29 15:45:50.600076 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.600058 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 15:45:50.601201 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.601172 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 29 15:45:50.601369 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.601208 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-124.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 29 15:45:50.602332 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.602310 2567 topology_manager.go:138] "Creating topology manager with none policy" Jul 29 15:45:50.602389 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.602335 2567 container_manager_linux.go:309] "Creating device plugin manager" Jul 29 15:45:50.602389 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.602345 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 15:45:50.602842 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.602830 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 15:45:50.603544 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.603532 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 29 15:45:50.605103 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.605090 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 29 15:45:50.605246 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.605234 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 29 15:45:50.605300 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.605273 2567 kubelet.go:486] "Attempting to sync node with API server" Jul 29 15:45:50.605300 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.605289 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 29 15:45:50.605400 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.605312 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 29 15:45:50.605400 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.605327 2567 kubelet.go:398] "Adding apiserver pod source" Jul 29 15:45:50.605400 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.605350 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 29 15:45:50.605767 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.605752 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 15:45:50.605838 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.605775 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 15:45:50.608460 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.608438 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 29 15:45:50.609988 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.609974 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 29 15:45:50.610045 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.610006 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 29 15:45:50.611231 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.611219 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 29 15:45:50.611280 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.611235 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 29 15:45:50.611280 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.611242 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 29 15:45:50.611280 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.611247 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 29 15:45:50.611280 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.611255 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 29 15:45:50.611280 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.611260 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 29 15:45:50.611280 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.611268 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 29 15:45:50.611280 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.611273 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 29 15:45:50.611280 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.611279 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 29 15:45:50.611488 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.611285 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 29 15:45:50.611488 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.611294 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 29 15:45:50.611488 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.611299 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 29 15:45:50.612445 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.612432 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 29 15:45:50.612445 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.612444 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 29 15:45:50.618707 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.615469 2567 server.go:1268] "Started kubelet" Jul 29 15:45:50.618707 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.615530 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 29 15:45:50.618707 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.615667 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 29 15:45:50.618707 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.615753 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 29 15:45:50.616353 ip-10-0-142-124 systemd[1]: Started Kubernetes Kubelet. Jul 29 15:45:50.619077 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.618772 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 29 15:45:50.619842 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.619823 2567 server.go:310] "Adding debug handlers to kubelet server" Jul 29 15:45:50.621964 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:50.621918 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 29 15:45:50.621964 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.621924 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-124.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 29 15:45:50.622107 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:50.622027 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-124.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 29 15:45:50.622107 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:50.622055 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 29 15:45:50.623087 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:50.621928 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-124.ec2.internal.18c6cd39d7bf2cb0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-124.ec2.internal,UID:ip-10-0-142-124.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-124.ec2.internal,},FirstTimestamp:2026-07-29 15:45:50.61544056 +0000 UTC m=+0.298523845,LastTimestamp:2026-07-29 15:45:50.61544056 +0000 UTC m=+0.298523845,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-124.ec2.internal,}" Jul 29 15:45:50.624018 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.624004 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 29 15:45:50.624018 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.624014 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 29 15:45:50.624178 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:50.624118 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-124.ec2.internal\" not found" Jul 29 15:45:50.624582 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.624564 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 29 15:45:50.624682 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.624661 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 29 15:45:50.624682 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.624681 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 29 15:45:50.624827 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.624769 2567 factory.go:55] Registering systemd factory Jul 29 15:45:50.624827 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.624782 2567 factory.go:223] Registration of the systemd container factory successfully Jul 29 15:45:50.624827 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.624806 2567 reconstruct.go:97] "Volume reconstruction finished" Jul 29 15:45:50.624827 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.624813 2567 reconciler.go:29] "Reconciler: start to sync state" Jul 29 15:45:50.625006 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.624985 2567 factory.go:153] Registering CRI-O factory Jul 29 15:45:50.625006 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.625001 2567 factory.go:223] Registration of the crio container factory successfully Jul 29 15:45:50.625089 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.625059 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 29 15:45:50.625089 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.625084 2567 factory.go:103] Registering Raw factory Jul 29 15:45:50.625181 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.625099 2567 manager.go:1196] Started watching for new ooms in manager Jul 29 15:45:50.626046 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.626033 2567 manager.go:349] Starting recovery of all containers Jul 29 15:45:50.626290 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:50.626263 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 29 15:45:50.626455 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:50.626428 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-124.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 29 15:45:50.626980 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.626959 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mxxmg" Jul 29 15:45:50.632516 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.632493 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mxxmg" Jul 29 15:45:50.636332 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.636315 2567 manager.go:354] Recovery completed Jul 29 15:45:50.640351 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.640337 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:45:50.642200 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.642187 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:45:50.642259 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.642217 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:45:50.642259 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.642227 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:45:50.642726 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.642710 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 29 15:45:50.642726 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.642725 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 29 15:45:50.642825 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.642729 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:45:50.642825 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.642739 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 29 15:45:50.643385 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.643371 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:45:50.643430 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.643403 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:45:50.643430 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.643419 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:45:50.644183 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.644172 2567 policy_none.go:49] "None policy: Start" Jul 29 15:45:50.644219 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.644188 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 29 15:45:50.644219 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.644199 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 29 15:45:50.645029 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.645018 2567 policy_none.go:47] "Start" Jul 29 15:45:50.674571 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.674552 2567 manager.go:337] "Starting Device Plugin manager" Jul 29 15:45:50.674674 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:50.674592 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 29 15:45:50.674674 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.674606 2567 server.go:87] "Starting device plugin registration server" Jul 29 15:45:50.674912 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.674900 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 29 15:45:50.674975 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.674915 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 29 15:45:50.675231 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.675042 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 29 15:45:50.675448 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.675289 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 29 15:45:50.675448 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.675298 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 29 15:45:50.675642 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:50.675625 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 29 15:45:50.675707 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:50.675677 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-124.ec2.internal\" not found" Jul 29 15:45:50.775185 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.775156 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:45:50.776258 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.776241 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:45:50.776319 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.776275 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:45:50.776319 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.776286 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:45:50.776319 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.776313 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-124.ec2.internal" Jul 29 15:45:50.784289 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.784269 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-124.ec2.internal" Jul 29 15:45:50.784386 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:50.784295 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-124.ec2.internal\": node \"ip-10-0-142-124.ec2.internal\" not found" Jul 29 15:45:50.804571 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:50.804501 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-124.ec2.internal\" not found" Jul 29 15:45:50.826884 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.826836 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 29 15:45:50.828304 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.828282 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 29 15:45:50.828416 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.828330 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 29 15:45:50.828416 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.828354 2567 kubelet.go:2448] "Starting kubelet main sync loop" Jul 29 15:45:50.828416 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:50.828388 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 29 15:45:50.831188 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.831171 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:45:50.905208 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:50.905158 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-124.ec2.internal\" not found" Jul 29 15:45:50.928683 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.928655 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-124.ec2.internal"] Jul 29 15:45:50.928771 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.928732 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:45:50.929731 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.929711 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:45:50.929855 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.929745 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:45:50.929855 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.929757 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:45:50.931013 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.930999 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:45:50.931153 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.931139 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal" Jul 29 15:45:50.931215 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.931175 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:45:50.931729 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.931709 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:45:50.931812 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.931741 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:45:50.931812 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.931751 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:45:50.931812 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.931709 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:45:50.931902 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.931814 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:45:50.931902 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.931825 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:45:50.932848 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.932832 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-124.ec2.internal" Jul 29 15:45:50.932894 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.932877 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:45:50.933550 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.933535 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:45:50.933628 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.933562 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:45:50.933628 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:50.933576 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:45:50.950616 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:50.950592 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-124.ec2.internal\" not found" node="ip-10-0-142-124.ec2.internal" Jul 29 15:45:50.954087 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:50.954061 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-124.ec2.internal\" not found" node="ip-10-0-142-124.ec2.internal" Jul 29 15:45:51.006161 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:51.006121 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-124.ec2.internal\" not found" Jul 29 15:45:51.027613 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:51.027576 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/35429a64cc41bf0a3ba185325ae3dc4f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal\" (UID: \"35429a64cc41bf0a3ba185325ae3dc4f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal" Jul 29 15:45:51.027613 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:51.027608 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35429a64cc41bf0a3ba185325ae3dc4f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal\" (UID: \"35429a64cc41bf0a3ba185325ae3dc4f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal" Jul 29 15:45:51.027795 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:51.027627 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/834e29422605a4563abd0c2b2da8dece-config\") pod \"kube-apiserver-proxy-ip-10-0-142-124.ec2.internal\" (UID: \"834e29422605a4563abd0c2b2da8dece\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-124.ec2.internal" Jul 29 15:45:51.106301 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:51.106212 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-124.ec2.internal\" not found" Jul 29 15:45:51.128688 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:51.128655 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/35429a64cc41bf0a3ba185325ae3dc4f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal\" (UID: \"35429a64cc41bf0a3ba185325ae3dc4f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal" Jul 29 15:45:51.128795 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:51.128695 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35429a64cc41bf0a3ba185325ae3dc4f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal\" (UID: \"35429a64cc41bf0a3ba185325ae3dc4f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal" Jul 29 15:45:51.128795 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:51.128720 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/834e29422605a4563abd0c2b2da8dece-config\") pod \"kube-apiserver-proxy-ip-10-0-142-124.ec2.internal\" (UID: \"834e29422605a4563abd0c2b2da8dece\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-124.ec2.internal" Jul 29 15:45:51.128795 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:51.128771 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/834e29422605a4563abd0c2b2da8dece-config\") pod \"kube-apiserver-proxy-ip-10-0-142-124.ec2.internal\" (UID: \"834e29422605a4563abd0c2b2da8dece\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-124.ec2.internal" Jul 29 15:45:51.128914 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:51.128771 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35429a64cc41bf0a3ba185325ae3dc4f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal\" (UID: \"35429a64cc41bf0a3ba185325ae3dc4f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal" Jul 29 15:45:51.128914 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:51.128771 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/35429a64cc41bf0a3ba185325ae3dc4f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal\" (UID: \"35429a64cc41bf0a3ba185325ae3dc4f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal" Jul 29 15:45:51.206837 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:51.206797 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-124.ec2.internal\" not found" Jul 29 15:45:51.253328 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:51.253299 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal" Jul 29 15:45:51.257178 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:51.257155 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-124.ec2.internal" Jul 29 15:45:51.307199 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:51.307158 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-124.ec2.internal\" not found" Jul 29 15:45:51.407786 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:51.407722 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-124.ec2.internal\" not found" Jul 29 15:45:51.512781 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:51.512741 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-124.ec2.internal\" not found" Jul 29 15:45:51.566475 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:51.566439 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:45:51.573091 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:51.573065 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 29 15:45:51.573212 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:51.573188 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 15:45:51.573262 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:51.573188 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 15:45:51.588947 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:51.588909 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:45:51.613736 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:51.613705 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-124.ec2.internal\" not found" Jul 29 15:45:51.636050 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:51.636007 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 15:40:51 +0000 UTC" deadline="2028-05-14 20:04:13.552107492 +0000 UTC" Jul 29 15:45:51.636050 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:51.636045 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15724h18m21.916066192s" Jul 29 15:45:51.715961 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:51.715847 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-124.ec2.internal\" not found" Jul 29 15:45:51.823109 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:51.823067 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-124.ec2.internal\" not found" Jul 29 15:45:51.924179 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:51.924147 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-124.ec2.internal\" not found" Jul 29 15:45:51.980739 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:51.980697 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35429a64cc41bf0a3ba185325ae3dc4f.slice/crio-27d909abd0bde7137ee60d22e72f712d2369b8d06143dc4434f7552d4b12d6ce WatchSource:0}: Error finding container 27d909abd0bde7137ee60d22e72f712d2369b8d06143dc4434f7552d4b12d6ce: Status 404 returned error can't find the container with id 27d909abd0bde7137ee60d22e72f712d2369b8d06143dc4434f7552d4b12d6ce Jul 29 15:45:51.985652 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:51.985635 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 15:45:52.026296 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:52.026261 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-124.ec2.internal\" not found" Jul 29 15:45:52.087375 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.087353 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:45:52.125559 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.125514 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-124.ec2.internal" Jul 29 15:45:52.134309 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.134288 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 15:45:52.135089 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.135076 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal" Jul 29 15:45:52.145732 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.145710 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 15:45:52.274875 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:52.274834 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod834e29422605a4563abd0c2b2da8dece.slice/crio-0c43fd64c73bc97e81c231a05cde39916dbd4cef5c51d8a01c3b61382b4225c0 WatchSource:0}: Error finding container 0c43fd64c73bc97e81c231a05cde39916dbd4cef5c51d8a01c3b61382b4225c0: Status 404 returned error can't find the container with id 0c43fd64c73bc97e81c231a05cde39916dbd4cef5c51d8a01c3b61382b4225c0 Jul 29 15:45:52.606444 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.606358 2567 apiserver.go:52] "Watching apiserver" Jul 29 15:45:52.613135 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.613098 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 29 15:45:52.614260 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.614214 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-g7svn","kube-system/global-pull-secret-syncer-26xnp","openshift-cluster-node-tuning-operator/tuned-gkb9q","openshift-dns/node-resolver-f9hnm","openshift-image-registry/node-ca-crwhp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal","openshift-multus/multus-additional-cni-plugins-xvdkk","openshift-multus/multus-xm7ph","openshift-multus/network-metrics-daemon-dj58l","kube-system/konnectivity-agent-tqjbj","kube-system/kube-apiserver-proxy-ip-10-0-142-124.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z64m6","openshift-network-diagnostics/network-check-target-94h8p","openshift-network-operator/iptables-alerter-cwkkf"] Jul 29 15:45:52.616215 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.616189 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xvdkk" Jul 29 15:45:52.617337 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.617311 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:45:52.617499 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:52.617415 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94h8p" podUID="b7346e04-c640-4552-832b-a57e1b0d9998" Jul 29 15:45:52.618686 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.618486 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 29 15:45:52.618686 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.618556 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 29 15:45:52.618686 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.618609 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 29 15:45:52.618686 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.618621 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 29 15:45:52.618686 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.618492 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.619049 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.618983 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 29 15:45:52.619049 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.619025 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5pd24\"" Jul 29 15:45:52.619555 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.619533 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f9hnm" Jul 29 15:45:52.621566 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.620823 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-crwhp" Jul 29 15:45:52.621566 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.621268 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 29 15:45:52.621763 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.621586 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 29 15:45:52.621763 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.621646 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-v7pbj\"" Jul 29 15:45:52.621763 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.621680 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 29 15:45:52.621763 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.621705 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 29 15:45:52.622101 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.621912 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-x6gg6\"" Jul 29 15:45:52.622684 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.622666 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 29 15:45:52.622927 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.622902 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-r5klq\"" Jul 29 15:45:52.623296 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.623274 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cwkkf" Jul 29 15:45:52.623399 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.623304 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 29 15:45:52.623862 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.623843 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 29 15:45:52.624401 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.624380 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:45:52.624502 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:52.624458 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dj58l" podUID="c5d6572b-df40-46ac-80aa-e62fb0eae0a8" Jul 29 15:45:52.625723 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.625033 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 29 15:45:52.625723 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.625237 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 29 15:45:52.625723 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.625472 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 29 15:45:52.625723 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.625691 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 29 15:45:52.626015 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.625898 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xjh5w\"" Jul 29 15:45:52.627349 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.627328 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.628590 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.628570 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:45:52.628687 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:52.628640 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26xnp" podUID="fe75348c-40b9-462d-8e9e-644aed841fae" Jul 29 15:45:52.629082 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.629064 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 29 15:45:52.629219 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.629199 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 29 15:45:52.629313 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.629297 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c8gzr\"" Jul 29 15:45:52.629395 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.629378 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 29 15:45:52.629563 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.629531 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 29 15:45:52.629661 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.629594 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 29 15:45:52.629879 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.629858 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 29 15:45:52.630872 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.630851 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tqjbj" Jul 29 15:45:52.632353 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.632335 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.632823 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.632803 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 29 15:45:52.632983 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.632957 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 29 15:45:52.633318 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.633297 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-22jgz\"" Jul 29 15:45:52.633907 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.633751 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z64m6" Jul 29 15:45:52.634482 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.634463 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 29 15:45:52.634585 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.634550 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5fzdm\"" Jul 29 15:45:52.634651 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.634623 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 15:45:52.635226 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.635210 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 29 15:45:52.635544 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.635525 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2hm92\"" Jul 29 15:45:52.636512 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.636493 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 29 15:45:52.636744 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.636728 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 29 15:45:52.638350 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.637376 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md9dd\" (UniqueName: \"kubernetes.io/projected/0bd89f55-5065-499c-a550-d7b6f62acb1f-kube-api-access-md9dd\") pod \"multus-additional-cni-plugins-xvdkk\" (UID: \"0bd89f55-5065-499c-a550-d7b6f62acb1f\") " pod="openshift-multus/multus-additional-cni-plugins-xvdkk" Jul 29 15:45:52.638350 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.637423 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4dcf8deb-1079-4f6f-9ae9-e0d84870c960-hosts-file\") pod \"node-resolver-f9hnm\" (UID: \"4dcf8deb-1079-4f6f-9ae9-e0d84870c960\") " pod="openshift-dns/node-resolver-f9hnm" Jul 29 15:45:52.638350 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.637460 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.638350 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.637543 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f2281802-4f4b-495b-8bca-8cc371df6eec-ovnkube-script-lib\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.638350 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.637595 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-node-log\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.638350 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.637624 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f2281802-4f4b-495b-8bca-8cc371df6eec-env-overrides\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.638350 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.637655 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0bd89f55-5065-499c-a550-d7b6f62acb1f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xvdkk\" (UID: \"0bd89f55-5065-499c-a550-d7b6f62acb1f\") " pod="openshift-multus/multus-additional-cni-plugins-xvdkk" Jul 29 15:45:52.638350 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.637685 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-etc-sysctl-conf\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.638350 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.637749 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rzpn\" (UniqueName: \"kubernetes.io/projected/3c2416e5-3e11-42e8-95d5-93fc1b266d71-kube-api-access-2rzpn\") pod \"iptables-alerter-cwkkf\" (UID: \"3c2416e5-3e11-42e8-95d5-93fc1b266d71\") " pod="openshift-network-operator/iptables-alerter-cwkkf" Jul 29 15:45:52.638350 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.637794 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-run-systemd\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.638350 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.637943 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-etc-sysconfig\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.638350 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.637977 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-lib-modules\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.638350 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.638122 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-var-lib-kubelet\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.638350 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.638196 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n94pw\" (UniqueName: \"kubernetes.io/projected/d91f80fe-f4fa-4484-9244-c520bc696460-kube-api-access-n94pw\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.638350 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.638256 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/70b633f9-e025-4576-a729-be5ebb65658e-serviceca\") pod \"node-ca-crwhp\" (UID: \"70b633f9-e025-4576-a729-be5ebb65658e\") " pod="openshift-image-registry/node-ca-crwhp" Jul 29 15:45:52.638350 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.638304 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-run-ovn\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.639164 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.638333 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-host-run-ovn-kubernetes\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.639164 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.638367 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0bd89f55-5065-499c-a550-d7b6f62acb1f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xvdkk\" (UID: \"0bd89f55-5065-499c-a550-d7b6f62acb1f\") " pod="openshift-multus/multus-additional-cni-plugins-xvdkk" Jul 29 15:45:52.639164 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.638423 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0bd89f55-5065-499c-a550-d7b6f62acb1f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xvdkk\" (UID: \"0bd89f55-5065-499c-a550-d7b6f62acb1f\") " pod="openshift-multus/multus-additional-cni-plugins-xvdkk" Jul 29 15:45:52.639164 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.638491 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-etc-systemd\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.639164 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.638515 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70b633f9-e025-4576-a729-be5ebb65658e-host\") pod \"node-ca-crwhp\" (UID: \"70b633f9-e025-4576-a729-be5ebb65658e\") " pod="openshift-image-registry/node-ca-crwhp" Jul 29 15:45:52.639164 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.638566 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5d6572b-df40-46ac-80aa-e62fb0eae0a8-metrics-certs\") pod \"network-metrics-daemon-dj58l\" (UID: \"c5d6572b-df40-46ac-80aa-e62fb0eae0a8\") " pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:45:52.639164 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.638608 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8gsh\" (UniqueName: \"kubernetes.io/projected/b7346e04-c640-4552-832b-a57e1b0d9998-kube-api-access-n8gsh\") pod \"network-check-target-94h8p\" (UID: \"b7346e04-c640-4552-832b-a57e1b0d9998\") " pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:45:52.639164 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.638652 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dcf8deb-1079-4f6f-9ae9-e0d84870c960-tmp-dir\") pod \"node-resolver-f9hnm\" (UID: \"4dcf8deb-1079-4f6f-9ae9-e0d84870c960\") " pod="openshift-dns/node-resolver-f9hnm" Jul 29 15:45:52.639164 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.638695 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-run\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.639164 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.638739 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3c2416e5-3e11-42e8-95d5-93fc1b266d71-iptables-alerter-script\") pod \"iptables-alerter-cwkkf\" (UID: \"3c2416e5-3e11-42e8-95d5-93fc1b266d71\") " pod="openshift-network-operator/iptables-alerter-cwkkf" Jul 29 15:45:52.639164 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.638771 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-host-kubelet\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.639164 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.638804 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0bd89f55-5065-499c-a550-d7b6f62acb1f-system-cni-dir\") pod \"multus-additional-cni-plugins-xvdkk\" (UID: \"0bd89f55-5065-499c-a550-d7b6f62acb1f\") " pod="openshift-multus/multus-additional-cni-plugins-xvdkk" Jul 29 15:45:52.639164 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.638838 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww8zr\" (UniqueName: \"kubernetes.io/projected/70b633f9-e025-4576-a729-be5ebb65658e-kube-api-access-ww8zr\") pod \"node-ca-crwhp\" (UID: \"70b633f9-e025-4576-a729-be5ebb65658e\") " pod="openshift-image-registry/node-ca-crwhp" Jul 29 15:45:52.639164 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.638900 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88pnh\" (UniqueName: \"kubernetes.io/projected/c5d6572b-df40-46ac-80aa-e62fb0eae0a8-kube-api-access-88pnh\") pod \"network-metrics-daemon-dj58l\" (UID: \"c5d6572b-df40-46ac-80aa-e62fb0eae0a8\") " pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:45:52.639164 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.638945 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0bd89f55-5065-499c-a550-d7b6f62acb1f-os-release\") pod \"multus-additional-cni-plugins-xvdkk\" (UID: \"0bd89f55-5065-499c-a550-d7b6f62acb1f\") " pod="openshift-multus/multus-additional-cni-plugins-xvdkk" Jul 29 15:45:52.639164 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.639010 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-host-cni-netd\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.639787 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.639043 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0bd89f55-5065-499c-a550-d7b6f62acb1f-cnibin\") pod \"multus-additional-cni-plugins-xvdkk\" (UID: \"0bd89f55-5065-499c-a550-d7b6f62acb1f\") " pod="openshift-multus/multus-additional-cni-plugins-xvdkk" Jul 29 15:45:52.639787 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.639080 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-etc-kubernetes\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.639787 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.639108 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-etc-sysctl-d\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.639787 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.639246 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-var-lib-openvswitch\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.639787 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.639365 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-etc-openvswitch\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.639787 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.639387 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-host-cni-bin\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.639787 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.639434 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-etc-modprobe-d\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.639787 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.639470 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d91f80fe-f4fa-4484-9244-c520bc696460-etc-tuned\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.639787 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.639493 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-systemd-units\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.639787 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.639511 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-host\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.639787 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.639542 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d91f80fe-f4fa-4484-9244-c520bc696460-tmp\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.639787 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.639559 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f2281802-4f4b-495b-8bca-8cc371df6eec-ovn-node-metrics-cert\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.639787 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.639594 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-host-slash\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.639787 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.639700 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssz57\" (UniqueName: \"kubernetes.io/projected/f2281802-4f4b-495b-8bca-8cc371df6eec-kube-api-access-ssz57\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.639787 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.639727 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3c2416e5-3e11-42e8-95d5-93fc1b266d71-host-slash\") pod \"iptables-alerter-cwkkf\" (UID: \"3c2416e5-3e11-42e8-95d5-93fc1b266d71\") " pod="openshift-network-operator/iptables-alerter-cwkkf" Jul 29 15:45:52.639787 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.639751 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98mgh\" (UniqueName: \"kubernetes.io/projected/4dcf8deb-1079-4f6f-9ae9-e0d84870c960-kube-api-access-98mgh\") pod \"node-resolver-f9hnm\" (UID: \"4dcf8deb-1079-4f6f-9ae9-e0d84870c960\") " pod="openshift-dns/node-resolver-f9hnm" Jul 29 15:45:52.640594 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.639770 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-host-run-netns\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.640594 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.639844 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f2281802-4f4b-495b-8bca-8cc371df6eec-ovnkube-config\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.640594 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.639895 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0bd89f55-5065-499c-a550-d7b6f62acb1f-cni-binary-copy\") pod \"multus-additional-cni-plugins-xvdkk\" (UID: \"0bd89f55-5065-499c-a550-d7b6f62acb1f\") " pod="openshift-multus/multus-additional-cni-plugins-xvdkk" Jul 29 15:45:52.640594 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.639930 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-sys\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.640594 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.639993 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-run-openvswitch\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.640594 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.640034 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-log-socket\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.664921 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.664890 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-r8lkm" Jul 29 15:45:52.670256 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.670228 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-r8lkm" Jul 29 15:45:52.725712 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.725672 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 29 15:45:52.740661 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.740618 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-node-log\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.740661 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.740659 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-multus-conf-dir\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.740897 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.740683 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f2281802-4f4b-495b-8bca-8cc371df6eec-env-overrides\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.740897 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.740708 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0bd89f55-5065-499c-a550-d7b6f62acb1f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xvdkk\" (UID: \"0bd89f55-5065-499c-a550-d7b6f62acb1f\") " pod="openshift-multus/multus-additional-cni-plugins-xvdkk" Jul 29 15:45:52.740897 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.740732 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-etc-sysctl-conf\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.740897 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.740756 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rzpn\" (UniqueName: \"kubernetes.io/projected/3c2416e5-3e11-42e8-95d5-93fc1b266d71-kube-api-access-2rzpn\") pod \"iptables-alerter-cwkkf\" (UID: \"3c2416e5-3e11-42e8-95d5-93fc1b266d71\") " pod="openshift-network-operator/iptables-alerter-cwkkf" Jul 29 15:45:52.740897 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.740759 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-node-log\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.740897 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.740776 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-run-systemd\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.740897 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.740800 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c0a75f9d-b980-4b9e-b4c5-fdf114c2f202-sys-fs\") pod \"aws-ebs-csi-driver-node-z64m6\" (UID: \"c0a75f9d-b980-4b9e-b4c5-fdf114c2f202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z64m6" Jul 29 15:45:52.740897 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.740819 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-hostroot\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.740897 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.740859 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-etc-sysconfig\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.740897 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.740893 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-lib-modules\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.741549 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.740913 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-var-lib-kubelet\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.741549 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.740931 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n94pw\" (UniqueName: \"kubernetes.io/projected/d91f80fe-f4fa-4484-9244-c520bc696460-kube-api-access-n94pw\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.741549 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.740954 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/70b633f9-e025-4576-a729-be5ebb65658e-serviceca\") pod \"node-ca-crwhp\" (UID: \"70b633f9-e025-4576-a729-be5ebb65658e\") " pod="openshift-image-registry/node-ca-crwhp" Jul 29 15:45:52.741549 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.740993 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-run-ovn\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.741549 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.740974 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-etc-sysctl-conf\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.741549 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.741017 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-host-run-ovn-kubernetes\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.741549 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.741064 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fe75348c-40b9-462d-8e9e-644aed841fae-kubelet-config\") pod \"global-pull-secret-syncer-26xnp\" (UID: \"fe75348c-40b9-462d-8e9e-644aed841fae\") " pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:45:52.741549 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.741074 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-etc-sysconfig\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.741549 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.741086 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-host-run-ovn-kubernetes\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.741549 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.741096 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-var-lib-kubelet\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.741549 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.741191 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-lib-modules\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.741549 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.741224 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0bd89f55-5065-499c-a550-d7b6f62acb1f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xvdkk\" (UID: \"0bd89f55-5065-499c-a550-d7b6f62acb1f\") " pod="openshift-multus/multus-additional-cni-plugins-xvdkk" Jul 29 15:45:52.741549 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.741227 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-run-systemd\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.741549 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.741254 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-run-ovn\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.741549 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.741352 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f2281802-4f4b-495b-8bca-8cc371df6eec-env-overrides\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.741549 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.741365 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0bd89f55-5065-499c-a550-d7b6f62acb1f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xvdkk\" (UID: \"0bd89f55-5065-499c-a550-d7b6f62acb1f\") " pod="openshift-multus/multus-additional-cni-plugins-xvdkk" Jul 29 15:45:52.741549 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.741399 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-etc-systemd\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.742536 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.741440 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70b633f9-e025-4576-a729-be5ebb65658e-host\") pod \"node-ca-crwhp\" (UID: \"70b633f9-e025-4576-a729-be5ebb65658e\") " pod="openshift-image-registry/node-ca-crwhp" Jul 29 15:45:52.742536 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.741468 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5d6572b-df40-46ac-80aa-e62fb0eae0a8-metrics-certs\") pod \"network-metrics-daemon-dj58l\" (UID: \"c5d6572b-df40-46ac-80aa-e62fb0eae0a8\") " pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:45:52.742536 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.741482 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0bd89f55-5065-499c-a550-d7b6f62acb1f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xvdkk\" (UID: \"0bd89f55-5065-499c-a550-d7b6f62acb1f\") " pod="openshift-multus/multus-additional-cni-plugins-xvdkk" Jul 29 15:45:52.742536 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.741508 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-etc-systemd\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.742536 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.741485 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0bd89f55-5065-499c-a550-d7b6f62acb1f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xvdkk\" (UID: \"0bd89f55-5065-499c-a550-d7b6f62acb1f\") " pod="openshift-multus/multus-additional-cni-plugins-xvdkk" Jul 29 15:45:52.742536 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.741497 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-multus-socket-dir-parent\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.742536 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.741533 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70b633f9-e025-4576-a729-be5ebb65658e-host\") pod \"node-ca-crwhp\" (UID: \"70b633f9-e025-4576-a729-be5ebb65658e\") " pod="openshift-image-registry/node-ca-crwhp" Jul 29 15:45:52.742536 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.741571 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-host-var-lib-kubelet\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.742536 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.741638 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8gsh\" (UniqueName: \"kubernetes.io/projected/b7346e04-c640-4552-832b-a57e1b0d9998-kube-api-access-n8gsh\") pod \"network-check-target-94h8p\" (UID: \"b7346e04-c640-4552-832b-a57e1b0d9998\") " pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:45:52.742536 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:52.741671 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:45:52.742536 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.741691 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dcf8deb-1079-4f6f-9ae9-e0d84870c960-tmp-dir\") pod \"node-resolver-f9hnm\" (UID: \"4dcf8deb-1079-4f6f-9ae9-e0d84870c960\") " pod="openshift-dns/node-resolver-f9hnm" Jul 29 15:45:52.742536 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.741716 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/70b633f9-e025-4576-a729-be5ebb65658e-serviceca\") pod \"node-ca-crwhp\" (UID: \"70b633f9-e025-4576-a729-be5ebb65658e\") " pod="openshift-image-registry/node-ca-crwhp" Jul 29 15:45:52.742536 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:52.741764 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5d6572b-df40-46ac-80aa-e62fb0eae0a8-metrics-certs podName:c5d6572b-df40-46ac-80aa-e62fb0eae0a8 nodeName:}" failed. No retries permitted until 2026-07-29 15:45:53.241725021 +0000 UTC m=+2.924808311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c5d6572b-df40-46ac-80aa-e62fb0eae0a8-metrics-certs") pod "network-metrics-daemon-dj58l" (UID: "c5d6572b-df40-46ac-80aa-e62fb0eae0a8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:45:52.742536 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.741852 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c0a75f9d-b980-4b9e-b4c5-fdf114c2f202-device-dir\") pod \"aws-ebs-csi-driver-node-z64m6\" (UID: \"c0a75f9d-b980-4b9e-b4c5-fdf114c2f202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z64m6" Jul 29 15:45:52.742536 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.741890 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76l5s\" (UniqueName: \"kubernetes.io/projected/c0a75f9d-b980-4b9e-b4c5-fdf114c2f202-kube-api-access-76l5s\") pod \"aws-ebs-csi-driver-node-z64m6\" (UID: \"c0a75f9d-b980-4b9e-b4c5-fdf114c2f202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z64m6" Jul 29 15:45:52.742536 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.741891 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0bd89f55-5065-499c-a550-d7b6f62acb1f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xvdkk\" (UID: \"0bd89f55-5065-499c-a550-d7b6f62acb1f\") " pod="openshift-multus/multus-additional-cni-plugins-xvdkk" Jul 29 15:45:52.742536 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.741917 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-run\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.743430 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.741948 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3c2416e5-3e11-42e8-95d5-93fc1b266d71-iptables-alerter-script\") pod \"iptables-alerter-cwkkf\" (UID: \"3c2416e5-3e11-42e8-95d5-93fc1b266d71\") " pod="openshift-network-operator/iptables-alerter-cwkkf" Jul 29 15:45:52.743430 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.741978 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-host-kubelet\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.743430 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742017 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe75348c-40b9-462d-8e9e-644aed841fae-original-pull-secret\") pod \"global-pull-secret-syncer-26xnp\" (UID: \"fe75348c-40b9-462d-8e9e-644aed841fae\") " pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:45:52.743430 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742034 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-multus-cni-dir\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.743430 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742014 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dcf8deb-1079-4f6f-9ae9-e0d84870c960-tmp-dir\") pod \"node-resolver-f9hnm\" (UID: \"4dcf8deb-1079-4f6f-9ae9-e0d84870c960\") " pod="openshift-dns/node-resolver-f9hnm" Jul 29 15:45:52.743430 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742058 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0bd89f55-5065-499c-a550-d7b6f62acb1f-system-cni-dir\") pod \"multus-additional-cni-plugins-xvdkk\" (UID: \"0bd89f55-5065-499c-a550-d7b6f62acb1f\") " pod="openshift-multus/multus-additional-cni-plugins-xvdkk" Jul 29 15:45:52.743430 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742066 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-host-kubelet\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.743430 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742082 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-run\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.743430 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742087 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww8zr\" (UniqueName: \"kubernetes.io/projected/70b633f9-e025-4576-a729-be5ebb65658e-kube-api-access-ww8zr\") pod \"node-ca-crwhp\" (UID: \"70b633f9-e025-4576-a729-be5ebb65658e\") " pod="openshift-image-registry/node-ca-crwhp" Jul 29 15:45:52.743430 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742112 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88pnh\" (UniqueName: \"kubernetes.io/projected/c5d6572b-df40-46ac-80aa-e62fb0eae0a8-kube-api-access-88pnh\") pod \"network-metrics-daemon-dj58l\" (UID: \"c5d6572b-df40-46ac-80aa-e62fb0eae0a8\") " pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:45:52.743430 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742143 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0bd89f55-5065-499c-a550-d7b6f62acb1f-system-cni-dir\") pod \"multus-additional-cni-plugins-xvdkk\" (UID: \"0bd89f55-5065-499c-a550-d7b6f62acb1f\") " pod="openshift-multus/multus-additional-cni-plugins-xvdkk" Jul 29 15:45:52.743430 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742150 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06c8dbb9-0046-48c8-a509-07078d3e19e2-cni-binary-copy\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.743430 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742170 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxblw\" (UniqueName: \"kubernetes.io/projected/06c8dbb9-0046-48c8-a509-07078d3e19e2-kube-api-access-jxblw\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.743430 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742191 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0bd89f55-5065-499c-a550-d7b6f62acb1f-os-release\") pod \"multus-additional-cni-plugins-xvdkk\" (UID: \"0bd89f55-5065-499c-a550-d7b6f62acb1f\") " pod="openshift-multus/multus-additional-cni-plugins-xvdkk" Jul 29 15:45:52.743430 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742215 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-host-run-multus-certs\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.743430 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742266 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-host-cni-netd\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.743430 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742288 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0bd89f55-5065-499c-a550-d7b6f62acb1f-cnibin\") pod \"multus-additional-cni-plugins-xvdkk\" (UID: \"0bd89f55-5065-499c-a550-d7b6f62acb1f\") " pod="openshift-multus/multus-additional-cni-plugins-xvdkk" Jul 29 15:45:52.744316 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742322 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-etc-kubernetes\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.744316 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742340 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-etc-sysctl-d\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.744316 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742356 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-var-lib-openvswitch\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.744316 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742360 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0bd89f55-5065-499c-a550-d7b6f62acb1f-os-release\") pod \"multus-additional-cni-plugins-xvdkk\" (UID: \"0bd89f55-5065-499c-a550-d7b6f62acb1f\") " pod="openshift-multus/multus-additional-cni-plugins-xvdkk" Jul 29 15:45:52.744316 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742371 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-etc-openvswitch\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.744316 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742396 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-host-cni-bin\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.744316 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742415 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-etc-modprobe-d\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.744316 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742416 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0bd89f55-5065-499c-a550-d7b6f62acb1f-cnibin\") pod \"multus-additional-cni-plugins-xvdkk\" (UID: \"0bd89f55-5065-499c-a550-d7b6f62acb1f\") " pod="openshift-multus/multus-additional-cni-plugins-xvdkk" Jul 29 15:45:52.744316 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742433 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3c2416e5-3e11-42e8-95d5-93fc1b266d71-iptables-alerter-script\") pod \"iptables-alerter-cwkkf\" (UID: \"3c2416e5-3e11-42e8-95d5-93fc1b266d71\") " pod="openshift-network-operator/iptables-alerter-cwkkf" Jul 29 15:45:52.744316 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742430 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d91f80fe-f4fa-4484-9244-c520bc696460-etc-tuned\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.744316 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742480 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-host-cni-netd\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.744316 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742512 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-systemd-units\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.744316 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742548 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c0a75f9d-b980-4b9e-b4c5-fdf114c2f202-socket-dir\") pod \"aws-ebs-csi-driver-node-z64m6\" (UID: \"c0a75f9d-b980-4b9e-b4c5-fdf114c2f202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z64m6" Jul 29 15:45:52.744316 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742549 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-etc-kubernetes\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.744316 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742595 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-systemd-units\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.744316 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742628 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-var-lib-openvswitch\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.744316 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742658 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-host-cni-bin\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.744836 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742660 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-etc-sysctl-d\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.744836 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742684 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-etc-openvswitch\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.744836 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742696 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-host\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.744836 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742723 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d91f80fe-f4fa-4484-9244-c520bc696460-tmp\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.744836 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742717 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 29 15:45:52.744836 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742727 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-etc-modprobe-d\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.744836 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742758 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f2281802-4f4b-495b-8bca-8cc371df6eec-ovn-node-metrics-cert\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.744836 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742791 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c0a75f9d-b980-4b9e-b4c5-fdf114c2f202-registration-dir\") pod \"aws-ebs-csi-driver-node-z64m6\" (UID: \"c0a75f9d-b980-4b9e-b4c5-fdf114c2f202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z64m6" Jul 29 15:45:52.744836 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742811 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-host-slash\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.744836 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742829 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssz57\" (UniqueName: \"kubernetes.io/projected/f2281802-4f4b-495b-8bca-8cc371df6eec-kube-api-access-ssz57\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.744836 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742859 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c1f386b0-39d7-4422-98d7-b62d212d6b62-konnectivity-ca\") pod \"konnectivity-agent-tqjbj\" (UID: \"c1f386b0-39d7-4422-98d7-b62d212d6b62\") " pod="kube-system/konnectivity-agent-tqjbj" Jul 29 15:45:52.744836 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742876 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3c2416e5-3e11-42e8-95d5-93fc1b266d71-host-slash\") pod \"iptables-alerter-cwkkf\" (UID: \"3c2416e5-3e11-42e8-95d5-93fc1b266d71\") " pod="openshift-network-operator/iptables-alerter-cwkkf" Jul 29 15:45:52.744836 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742893 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98mgh\" (UniqueName: \"kubernetes.io/projected/4dcf8deb-1079-4f6f-9ae9-e0d84870c960-kube-api-access-98mgh\") pod \"node-resolver-f9hnm\" (UID: \"4dcf8deb-1079-4f6f-9ae9-e0d84870c960\") " pod="openshift-dns/node-resolver-f9hnm" Jul 29 15:45:52.744836 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742908 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-host-run-netns\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.744836 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742925 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f2281802-4f4b-495b-8bca-8cc371df6eec-ovnkube-config\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.744836 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742941 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c0a75f9d-b980-4b9e-b4c5-fdf114c2f202-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z64m6\" (UID: \"c0a75f9d-b980-4b9e-b4c5-fdf114c2f202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z64m6" Jul 29 15:45:52.744836 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742976 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fe75348c-40b9-462d-8e9e-644aed841fae-dbus\") pod \"global-pull-secret-syncer-26xnp\" (UID: \"fe75348c-40b9-462d-8e9e-644aed841fae\") " pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:45:52.745494 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.742995 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c1f386b0-39d7-4422-98d7-b62d212d6b62-agent-certs\") pod \"konnectivity-agent-tqjbj\" (UID: \"c1f386b0-39d7-4422-98d7-b62d212d6b62\") " pod="kube-system/konnectivity-agent-tqjbj" Jul 29 15:45:52.745494 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.743092 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-host-run-netns\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.745494 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.743094 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-host\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.745494 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.743119 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-system-cni-dir\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.745494 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.743172 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0bd89f55-5065-499c-a550-d7b6f62acb1f-cni-binary-copy\") pod \"multus-additional-cni-plugins-xvdkk\" (UID: \"0bd89f55-5065-499c-a550-d7b6f62acb1f\") " pod="openshift-multus/multus-additional-cni-plugins-xvdkk" Jul 29 15:45:52.745494 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.743207 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-sys\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.745494 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.743234 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-run-openvswitch\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.745494 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.743281 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d91f80fe-f4fa-4484-9244-c520bc696460-sys\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.745494 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.743328 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-run-openvswitch\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.745494 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.743361 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3c2416e5-3e11-42e8-95d5-93fc1b266d71-host-slash\") pod \"iptables-alerter-cwkkf\" (UID: \"3c2416e5-3e11-42e8-95d5-93fc1b266d71\") " pod="openshift-network-operator/iptables-alerter-cwkkf" Jul 29 15:45:52.745494 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.743404 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-log-socket\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.745494 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.743448 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-host-run-k8s-cni-cncf-io\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.745494 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.743486 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-host-run-netns\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.745494 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.743520 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-host-var-lib-cni-multus\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.745494 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.743546 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06c8dbb9-0046-48c8-a509-07078d3e19e2-multus-daemon-config\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.745494 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.743582 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md9dd\" (UniqueName: \"kubernetes.io/projected/0bd89f55-5065-499c-a550-d7b6f62acb1f-kube-api-access-md9dd\") pod \"multus-additional-cni-plugins-xvdkk\" (UID: \"0bd89f55-5065-499c-a550-d7b6f62acb1f\") " pod="openshift-multus/multus-additional-cni-plugins-xvdkk" Jul 29 15:45:52.745494 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.743637 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-log-socket\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.746243 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.743639 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c0a75f9d-b980-4b9e-b4c5-fdf114c2f202-etc-selinux\") pod \"aws-ebs-csi-driver-node-z64m6\" (UID: \"c0a75f9d-b980-4b9e-b4c5-fdf114c2f202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z64m6" Jul 29 15:45:52.746243 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.743671 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-host-slash\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.746243 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.743673 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-os-release\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.746243 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.743684 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0bd89f55-5065-499c-a550-d7b6f62acb1f-cni-binary-copy\") pod \"multus-additional-cni-plugins-xvdkk\" (UID: \"0bd89f55-5065-499c-a550-d7b6f62acb1f\") " pod="openshift-multus/multus-additional-cni-plugins-xvdkk" Jul 29 15:45:52.746243 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.743704 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4dcf8deb-1079-4f6f-9ae9-e0d84870c960-hosts-file\") pod \"node-resolver-f9hnm\" (UID: \"4dcf8deb-1079-4f6f-9ae9-e0d84870c960\") " pod="openshift-dns/node-resolver-f9hnm" Jul 29 15:45:52.746243 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.743731 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-cnibin\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.746243 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.743757 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-host-var-lib-cni-bin\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.746243 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.743783 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-etc-kubernetes\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.746243 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.743812 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.746243 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.743847 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f2281802-4f4b-495b-8bca-8cc371df6eec-ovnkube-script-lib\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.746243 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.743901 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f2281802-4f4b-495b-8bca-8cc371df6eec-ovnkube-config\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.746243 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.743966 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2281802-4f4b-495b-8bca-8cc371df6eec-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.746243 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.744216 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4dcf8deb-1079-4f6f-9ae9-e0d84870c960-hosts-file\") pod \"node-resolver-f9hnm\" (UID: \"4dcf8deb-1079-4f6f-9ae9-e0d84870c960\") " pod="openshift-dns/node-resolver-f9hnm" Jul 29 15:45:52.746243 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.744808 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f2281802-4f4b-495b-8bca-8cc371df6eec-ovnkube-script-lib\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.746847 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.746463 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d91f80fe-f4fa-4484-9244-c520bc696460-etc-tuned\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.746847 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.746519 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f2281802-4f4b-495b-8bca-8cc371df6eec-ovn-node-metrics-cert\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.746847 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.746708 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d91f80fe-f4fa-4484-9244-c520bc696460-tmp\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.748632 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.748609 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n94pw\" (UniqueName: \"kubernetes.io/projected/d91f80fe-f4fa-4484-9244-c520bc696460-kube-api-access-n94pw\") pod \"tuned-gkb9q\" (UID: \"d91f80fe-f4fa-4484-9244-c520bc696460\") " pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.748967 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.748948 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rzpn\" (UniqueName: \"kubernetes.io/projected/3c2416e5-3e11-42e8-95d5-93fc1b266d71-kube-api-access-2rzpn\") pod \"iptables-alerter-cwkkf\" (UID: \"3c2416e5-3e11-42e8-95d5-93fc1b266d71\") " pod="openshift-network-operator/iptables-alerter-cwkkf" Jul 29 15:45:52.753253 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:52.753233 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:45:52.753370 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:52.753260 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:45:52.753370 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:52.753278 2567 projected.go:196] Error preparing data for projected volume kube-api-access-n8gsh for pod openshift-network-diagnostics/network-check-target-94h8p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:45:52.753370 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:52.753343 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7346e04-c640-4552-832b-a57e1b0d9998-kube-api-access-n8gsh podName:b7346e04-c640-4552-832b-a57e1b0d9998 nodeName:}" failed. No retries permitted until 2026-07-29 15:45:53.253325907 +0000 UTC m=+2.936409196 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-n8gsh" (UniqueName: "kubernetes.io/projected/b7346e04-c640-4552-832b-a57e1b0d9998-kube-api-access-n8gsh") pod "network-check-target-94h8p" (UID: "b7346e04-c640-4552-832b-a57e1b0d9998") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:45:52.755998 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.755951 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww8zr\" (UniqueName: \"kubernetes.io/projected/70b633f9-e025-4576-a729-be5ebb65658e-kube-api-access-ww8zr\") pod \"node-ca-crwhp\" (UID: \"70b633f9-e025-4576-a729-be5ebb65658e\") " pod="openshift-image-registry/node-ca-crwhp" Jul 29 15:45:52.758781 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.758761 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88pnh\" (UniqueName: \"kubernetes.io/projected/c5d6572b-df40-46ac-80aa-e62fb0eae0a8-kube-api-access-88pnh\") pod \"network-metrics-daemon-dj58l\" (UID: \"c5d6572b-df40-46ac-80aa-e62fb0eae0a8\") " pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:45:52.759652 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.759631 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98mgh\" (UniqueName: \"kubernetes.io/projected/4dcf8deb-1079-4f6f-9ae9-e0d84870c960-kube-api-access-98mgh\") pod \"node-resolver-f9hnm\" (UID: \"4dcf8deb-1079-4f6f-9ae9-e0d84870c960\") " pod="openshift-dns/node-resolver-f9hnm" Jul 29 15:45:52.760017 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.759972 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssz57\" (UniqueName: \"kubernetes.io/projected/f2281802-4f4b-495b-8bca-8cc371df6eec-kube-api-access-ssz57\") pod \"ovnkube-node-g7svn\" (UID: \"f2281802-4f4b-495b-8bca-8cc371df6eec\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.760133 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.760103 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-md9dd\" (UniqueName: \"kubernetes.io/projected/0bd89f55-5065-499c-a550-d7b6f62acb1f-kube-api-access-md9dd\") pod \"multus-additional-cni-plugins-xvdkk\" (UID: \"0bd89f55-5065-499c-a550-d7b6f62acb1f\") " pod="openshift-multus/multus-additional-cni-plugins-xvdkk" Jul 29 15:45:52.833108 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.833053 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal" event={"ID":"35429a64cc41bf0a3ba185325ae3dc4f","Type":"ContainerStarted","Data":"27d909abd0bde7137ee60d22e72f712d2369b8d06143dc4434f7552d4b12d6ce"} Jul 29 15:45:52.834040 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.834005 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-124.ec2.internal" event={"ID":"834e29422605a4563abd0c2b2da8dece","Type":"ContainerStarted","Data":"0c43fd64c73bc97e81c231a05cde39916dbd4cef5c51d8a01c3b61382b4225c0"} Jul 29 15:45:52.844184 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844156 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c0a75f9d-b980-4b9e-b4c5-fdf114c2f202-registration-dir\") pod \"aws-ebs-csi-driver-node-z64m6\" (UID: \"c0a75f9d-b980-4b9e-b4c5-fdf114c2f202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z64m6" Jul 29 15:45:52.844184 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844189 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c1f386b0-39d7-4422-98d7-b62d212d6b62-konnectivity-ca\") pod \"konnectivity-agent-tqjbj\" (UID: \"c1f386b0-39d7-4422-98d7-b62d212d6b62\") " pod="kube-system/konnectivity-agent-tqjbj" Jul 29 15:45:52.844431 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844207 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c0a75f9d-b980-4b9e-b4c5-fdf114c2f202-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z64m6\" (UID: \"c0a75f9d-b980-4b9e-b4c5-fdf114c2f202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z64m6" Jul 29 15:45:52.844431 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844225 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fe75348c-40b9-462d-8e9e-644aed841fae-dbus\") pod \"global-pull-secret-syncer-26xnp\" (UID: \"fe75348c-40b9-462d-8e9e-644aed841fae\") " pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:45:52.844431 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844249 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c1f386b0-39d7-4422-98d7-b62d212d6b62-agent-certs\") pod \"konnectivity-agent-tqjbj\" (UID: \"c1f386b0-39d7-4422-98d7-b62d212d6b62\") " pod="kube-system/konnectivity-agent-tqjbj" Jul 29 15:45:52.844431 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844271 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-system-cni-dir\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.844431 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844298 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-host-run-k8s-cni-cncf-io\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.844431 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844308 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c0a75f9d-b980-4b9e-b4c5-fdf114c2f202-registration-dir\") pod \"aws-ebs-csi-driver-node-z64m6\" (UID: \"c0a75f9d-b980-4b9e-b4c5-fdf114c2f202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z64m6" Jul 29 15:45:52.844431 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844322 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-host-run-netns\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.844431 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844334 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c0a75f9d-b980-4b9e-b4c5-fdf114c2f202-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z64m6\" (UID: \"c0a75f9d-b980-4b9e-b4c5-fdf114c2f202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z64m6" Jul 29 15:45:52.844431 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844357 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-host-var-lib-cni-multus\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.844431 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844386 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06c8dbb9-0046-48c8-a509-07078d3e19e2-multus-daemon-config\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.844431 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844414 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c0a75f9d-b980-4b9e-b4c5-fdf114c2f202-etc-selinux\") pod \"aws-ebs-csi-driver-node-z64m6\" (UID: \"c0a75f9d-b980-4b9e-b4c5-fdf114c2f202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z64m6" Jul 29 15:45:52.844431 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844424 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fe75348c-40b9-462d-8e9e-644aed841fae-dbus\") pod \"global-pull-secret-syncer-26xnp\" (UID: \"fe75348c-40b9-462d-8e9e-644aed841fae\") " pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:45:52.845092 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844440 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-os-release\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.845092 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844446 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-host-run-k8s-cni-cncf-io\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.845092 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844469 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-cnibin\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.845092 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844491 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-host-var-lib-cni-multus\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.845092 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844494 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-host-var-lib-cni-bin\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.845092 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844414 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-system-cni-dir\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.845092 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844527 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-etc-kubernetes\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.845092 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844556 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-multus-conf-dir\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.845092 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844589 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c0a75f9d-b980-4b9e-b4c5-fdf114c2f202-sys-fs\") pod \"aws-ebs-csi-driver-node-z64m6\" (UID: \"c0a75f9d-b980-4b9e-b4c5-fdf114c2f202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z64m6" Jul 29 15:45:52.845092 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844597 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-cnibin\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.845092 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844559 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-os-release\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.845092 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844638 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-etc-kubernetes\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.845092 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844663 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c0a75f9d-b980-4b9e-b4c5-fdf114c2f202-sys-fs\") pod \"aws-ebs-csi-driver-node-z64m6\" (UID: \"c0a75f9d-b980-4b9e-b4c5-fdf114c2f202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z64m6" Jul 29 15:45:52.845092 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844669 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-hostroot\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.845092 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844714 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-multus-conf-dir\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.845092 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844616 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-hostroot\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.845092 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844765 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fe75348c-40b9-462d-8e9e-644aed841fae-kubelet-config\") pod \"global-pull-secret-syncer-26xnp\" (UID: \"fe75348c-40b9-462d-8e9e-644aed841fae\") " pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:45:52.845092 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844770 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c0a75f9d-b980-4b9e-b4c5-fdf114c2f202-etc-selinux\") pod \"aws-ebs-csi-driver-node-z64m6\" (UID: \"c0a75f9d-b980-4b9e-b4c5-fdf114c2f202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z64m6" Jul 29 15:45:52.845898 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844810 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-multus-socket-dir-parent\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.845898 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844813 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-host-var-lib-cni-bin\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.845898 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844358 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-host-run-netns\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.845898 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844835 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-host-var-lib-kubelet\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.845898 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844846 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c1f386b0-39d7-4422-98d7-b62d212d6b62-konnectivity-ca\") pod \"konnectivity-agent-tqjbj\" (UID: \"c1f386b0-39d7-4422-98d7-b62d212d6b62\") " pod="kube-system/konnectivity-agent-tqjbj" Jul 29 15:45:52.845898 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844872 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-multus-socket-dir-parent\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.845898 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844874 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c0a75f9d-b980-4b9e-b4c5-fdf114c2f202-device-dir\") pod \"aws-ebs-csi-driver-node-z64m6\" (UID: \"c0a75f9d-b980-4b9e-b4c5-fdf114c2f202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z64m6" Jul 29 15:45:52.845898 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844885 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fe75348c-40b9-462d-8e9e-644aed841fae-kubelet-config\") pod \"global-pull-secret-syncer-26xnp\" (UID: \"fe75348c-40b9-462d-8e9e-644aed841fae\") " pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:45:52.845898 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844916 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76l5s\" (UniqueName: \"kubernetes.io/projected/c0a75f9d-b980-4b9e-b4c5-fdf114c2f202-kube-api-access-76l5s\") pod \"aws-ebs-csi-driver-node-z64m6\" (UID: \"c0a75f9d-b980-4b9e-b4c5-fdf114c2f202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z64m6" Jul 29 15:45:52.845898 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844946 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe75348c-40b9-462d-8e9e-644aed841fae-original-pull-secret\") pod \"global-pull-secret-syncer-26xnp\" (UID: \"fe75348c-40b9-462d-8e9e-644aed841fae\") " pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:45:52.845898 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844974 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-multus-cni-dir\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.845898 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844917 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-host-var-lib-kubelet\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.845898 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.844916 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c0a75f9d-b980-4b9e-b4c5-fdf114c2f202-device-dir\") pod \"aws-ebs-csi-driver-node-z64m6\" (UID: \"c0a75f9d-b980-4b9e-b4c5-fdf114c2f202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z64m6" Jul 29 15:45:52.845898 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.845003 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06c8dbb9-0046-48c8-a509-07078d3e19e2-cni-binary-copy\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.845898 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.845065 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxblw\" (UniqueName: \"kubernetes.io/projected/06c8dbb9-0046-48c8-a509-07078d3e19e2-kube-api-access-jxblw\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.845898 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.845080 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-multus-cni-dir\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.845898 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.845096 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-host-run-multus-certs\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.846770 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.845130 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c0a75f9d-b980-4b9e-b4c5-fdf114c2f202-socket-dir\") pod \"aws-ebs-csi-driver-node-z64m6\" (UID: \"c0a75f9d-b980-4b9e-b4c5-fdf114c2f202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z64m6" Jul 29 15:45:52.846770 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.845185 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06c8dbb9-0046-48c8-a509-07078d3e19e2-multus-daemon-config\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.846770 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:52.845194 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:45:52.846770 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.845200 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06c8dbb9-0046-48c8-a509-07078d3e19e2-host-run-multus-certs\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.846770 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:52.845274 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe75348c-40b9-462d-8e9e-644aed841fae-original-pull-secret podName:fe75348c-40b9-462d-8e9e-644aed841fae nodeName:}" failed. No retries permitted until 2026-07-29 15:45:53.345251869 +0000 UTC m=+3.028335143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe75348c-40b9-462d-8e9e-644aed841fae-original-pull-secret") pod "global-pull-secret-syncer-26xnp" (UID: "fe75348c-40b9-462d-8e9e-644aed841fae") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:45:52.846770 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.845373 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c0a75f9d-b980-4b9e-b4c5-fdf114c2f202-socket-dir\") pod \"aws-ebs-csi-driver-node-z64m6\" (UID: \"c0a75f9d-b980-4b9e-b4c5-fdf114c2f202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z64m6" Jul 29 15:45:52.846770 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.845456 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06c8dbb9-0046-48c8-a509-07078d3e19e2-cni-binary-copy\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.847427 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.847406 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c1f386b0-39d7-4422-98d7-b62d212d6b62-agent-certs\") pod \"konnectivity-agent-tqjbj\" (UID: \"c1f386b0-39d7-4422-98d7-b62d212d6b62\") " pod="kube-system/konnectivity-agent-tqjbj" Jul 29 15:45:52.853509 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.853486 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxblw\" (UniqueName: \"kubernetes.io/projected/06c8dbb9-0046-48c8-a509-07078d3e19e2-kube-api-access-jxblw\") pod \"multus-xm7ph\" (UID: \"06c8dbb9-0046-48c8-a509-07078d3e19e2\") " pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.853614 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.853529 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76l5s\" (UniqueName: \"kubernetes.io/projected/c0a75f9d-b980-4b9e-b4c5-fdf114c2f202-kube-api-access-76l5s\") pod \"aws-ebs-csi-driver-node-z64m6\" (UID: \"c0a75f9d-b980-4b9e-b4c5-fdf114c2f202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z64m6" Jul 29 15:45:52.931108 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.930999 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xvdkk" Jul 29 15:45:52.940496 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.940466 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" Jul 29 15:45:52.948883 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.948849 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f9hnm" Jul 29 15:45:52.954706 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.954682 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-crwhp" Jul 29 15:45:52.963338 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.963310 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cwkkf" Jul 29 15:45:52.971189 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.971166 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:45:52.979065 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.979044 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tqjbj" Jul 29 15:45:52.987672 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.987648 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xm7ph" Jul 29 15:45:52.993486 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:52.993463 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z64m6" Jul 29 15:45:53.022611 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:53.022574 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:45:53.199093 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:53.199048 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dcf8deb_1079_4f6f_9ae9_e0d84870c960.slice/crio-47e51bbbdaaf6b6c98c1e04e535e8a169430489c79a34b7e305b0b0a3489224c WatchSource:0}: Error finding container 47e51bbbdaaf6b6c98c1e04e535e8a169430489c79a34b7e305b0b0a3489224c: Status 404 returned error can't find the container with id 47e51bbbdaaf6b6c98c1e04e535e8a169430489c79a34b7e305b0b0a3489224c Jul 29 15:45:53.201199 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:45:53.201109 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06c8dbb9_0046_48c8_a509_07078d3e19e2.slice/crio-47797544ee08f8e9990abe979becd3a613d312a570be3a2b28ff19ec7aef334f WatchSource:0}: Error finding container 47797544ee08f8e9990abe979becd3a613d312a570be3a2b28ff19ec7aef334f: Status 404 returned error can't find the container with id 47797544ee08f8e9990abe979becd3a613d312a570be3a2b28ff19ec7aef334f Jul 29 15:45:53.249263 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:53.249237 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5d6572b-df40-46ac-80aa-e62fb0eae0a8-metrics-certs\") pod \"network-metrics-daemon-dj58l\" (UID: \"c5d6572b-df40-46ac-80aa-e62fb0eae0a8\") " pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:45:53.249376 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:53.249362 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:45:53.249436 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:53.249425 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5d6572b-df40-46ac-80aa-e62fb0eae0a8-metrics-certs podName:c5d6572b-df40-46ac-80aa-e62fb0eae0a8 nodeName:}" failed. No retries permitted until 2026-07-29 15:45:54.249405529 +0000 UTC m=+3.932488805 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c5d6572b-df40-46ac-80aa-e62fb0eae0a8-metrics-certs") pod "network-metrics-daemon-dj58l" (UID: "c5d6572b-df40-46ac-80aa-e62fb0eae0a8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:45:53.310569 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:53.310538 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:45:53.349841 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:53.349805 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8gsh\" (UniqueName: \"kubernetes.io/projected/b7346e04-c640-4552-832b-a57e1b0d9998-kube-api-access-n8gsh\") pod \"network-check-target-94h8p\" (UID: \"b7346e04-c640-4552-832b-a57e1b0d9998\") " pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:45:53.350041 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:53.349859 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe75348c-40b9-462d-8e9e-644aed841fae-original-pull-secret\") pod \"global-pull-secret-syncer-26xnp\" (UID: \"fe75348c-40b9-462d-8e9e-644aed841fae\") " pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:45:53.350041 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:53.349997 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:45:53.350041 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:53.350023 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:45:53.350041 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:53.350042 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:45:53.350195 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:53.350053 2567 projected.go:196] Error preparing data for projected volume kube-api-access-n8gsh for pod openshift-network-diagnostics/network-check-target-94h8p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:45:53.350195 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:53.350058 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe75348c-40b9-462d-8e9e-644aed841fae-original-pull-secret podName:fe75348c-40b9-462d-8e9e-644aed841fae nodeName:}" failed. No retries permitted until 2026-07-29 15:45:54.350044065 +0000 UTC m=+4.033127338 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe75348c-40b9-462d-8e9e-644aed841fae-original-pull-secret") pod "global-pull-secret-syncer-26xnp" (UID: "fe75348c-40b9-462d-8e9e-644aed841fae") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:45:53.350195 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:53.350104 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7346e04-c640-4552-832b-a57e1b0d9998-kube-api-access-n8gsh podName:b7346e04-c640-4552-832b-a57e1b0d9998 nodeName:}" failed. No retries permitted until 2026-07-29 15:45:54.350086384 +0000 UTC m=+4.033169680 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-n8gsh" (UniqueName: "kubernetes.io/projected/b7346e04-c640-4552-832b-a57e1b0d9998-kube-api-access-n8gsh") pod "network-check-target-94h8p" (UID: "b7346e04-c640-4552-832b-a57e1b0d9998") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:45:53.673162 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:53.673116 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 15:40:53 +0000 UTC" deadline="2028-05-04 08:52:10.613988536 +0000 UTC" Jul 29 15:45:53.673162 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:53.673156 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15473h6m16.940837372s" Jul 29 15:45:53.829559 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:53.829453 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:45:53.829728 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:53.829603 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94h8p" podUID="b7346e04-c640-4552-832b-a57e1b0d9998" Jul 29 15:45:53.846080 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:53.845477 2567 generic.go:356] "Generic (PLEG): container finished" podID="35429a64cc41bf0a3ba185325ae3dc4f" containerID="6e7a43185d7001b7ef21254132fd5c8b5c8319f884a99ce725a5092eb2b9d164" exitCode=0 Jul 29 15:45:53.846080 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:53.845570 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal" event={"ID":"35429a64cc41bf0a3ba185325ae3dc4f","Type":"ContainerDied","Data":"6e7a43185d7001b7ef21254132fd5c8b5c8319f884a99ce725a5092eb2b9d164"} Jul 29 15:45:53.848461 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:53.848340 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" event={"ID":"f2281802-4f4b-495b-8bca-8cc371df6eec","Type":"ContainerStarted","Data":"f814868a1c5ee9e1d21fc3beef0cb50b9e69adeb189e0cce4da70ac000274228"} Jul 29 15:45:53.853686 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:53.853647 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z64m6" event={"ID":"c0a75f9d-b980-4b9e-b4c5-fdf114c2f202","Type":"ContainerStarted","Data":"468a12364e6b7132a8a196ea9f245946d21bcb5e21eec840494b0b7632f5660a"} Jul 29 15:45:53.859096 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:53.859041 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" event={"ID":"d91f80fe-f4fa-4484-9244-c520bc696460","Type":"ContainerStarted","Data":"6d61c7d1fb5b66404dacc75626b72f0aca1d099ccb05a733d9e36dcf6614ddbd"} Jul 29 15:45:53.865431 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:53.865403 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvdkk" event={"ID":"0bd89f55-5065-499c-a550-d7b6f62acb1f","Type":"ContainerStarted","Data":"b90fc675fbff15245d59ed5022f498163f158b6d405e892aaef4e3fd1a89f4b6"} Jul 29 15:45:53.872510 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:53.872471 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-crwhp" event={"ID":"70b633f9-e025-4576-a729-be5ebb65658e","Type":"ContainerStarted","Data":"0a16bb3561e0f0679ed2f33e4722bdedc123a250e7955d760af87d82f44c2603"} Jul 29 15:45:53.879056 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:53.879002 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f9hnm" event={"ID":"4dcf8deb-1079-4f6f-9ae9-e0d84870c960","Type":"ContainerStarted","Data":"47e51bbbdaaf6b6c98c1e04e535e8a169430489c79a34b7e305b0b0a3489224c"} Jul 29 15:45:53.889184 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:53.889154 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cwkkf" event={"ID":"3c2416e5-3e11-42e8-95d5-93fc1b266d71","Type":"ContainerStarted","Data":"cd7b3b63a03034653635de8cfd802e2681014cbaaf607168738a3899a1147a60"} Jul 29 15:45:53.893875 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:53.893841 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tqjbj" event={"ID":"c1f386b0-39d7-4422-98d7-b62d212d6b62","Type":"ContainerStarted","Data":"2893e19a00023639312bdf7bcd6dd0b8736f02c331e1fb4864dc6e531b6b946e"} Jul 29 15:45:53.898267 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:53.898233 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xm7ph" event={"ID":"06c8dbb9-0046-48c8-a509-07078d3e19e2","Type":"ContainerStarted","Data":"47797544ee08f8e9990abe979becd3a613d312a570be3a2b28ff19ec7aef334f"} Jul 29 15:45:54.256404 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:54.256297 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5d6572b-df40-46ac-80aa-e62fb0eae0a8-metrics-certs\") pod \"network-metrics-daemon-dj58l\" (UID: \"c5d6572b-df40-46ac-80aa-e62fb0eae0a8\") " pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:45:54.256629 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:54.256517 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:45:54.256629 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:54.256587 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5d6572b-df40-46ac-80aa-e62fb0eae0a8-metrics-certs podName:c5d6572b-df40-46ac-80aa-e62fb0eae0a8 nodeName:}" failed. No retries permitted until 2026-07-29 15:45:56.256566958 +0000 UTC m=+5.939650238 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c5d6572b-df40-46ac-80aa-e62fb0eae0a8-metrics-certs") pod "network-metrics-daemon-dj58l" (UID: "c5d6572b-df40-46ac-80aa-e62fb0eae0a8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:45:54.357077 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:54.357008 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8gsh\" (UniqueName: \"kubernetes.io/projected/b7346e04-c640-4552-832b-a57e1b0d9998-kube-api-access-n8gsh\") pod \"network-check-target-94h8p\" (UID: \"b7346e04-c640-4552-832b-a57e1b0d9998\") " pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:45:54.357077 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:54.357062 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe75348c-40b9-462d-8e9e-644aed841fae-original-pull-secret\") pod \"global-pull-secret-syncer-26xnp\" (UID: \"fe75348c-40b9-462d-8e9e-644aed841fae\") " pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:45:54.357324 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:54.357227 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:45:54.357324 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:54.357298 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe75348c-40b9-462d-8e9e-644aed841fae-original-pull-secret podName:fe75348c-40b9-462d-8e9e-644aed841fae nodeName:}" failed. No retries permitted until 2026-07-29 15:45:56.357278556 +0000 UTC m=+6.040361833 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe75348c-40b9-462d-8e9e-644aed841fae-original-pull-secret") pod "global-pull-secret-syncer-26xnp" (UID: "fe75348c-40b9-462d-8e9e-644aed841fae") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:45:54.357763 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:54.357742 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:45:54.357840 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:54.357775 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:45:54.357840 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:54.357791 2567 projected.go:196] Error preparing data for projected volume kube-api-access-n8gsh for pod openshift-network-diagnostics/network-check-target-94h8p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:45:54.357939 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:54.357841 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7346e04-c640-4552-832b-a57e1b0d9998-kube-api-access-n8gsh podName:b7346e04-c640-4552-832b-a57e1b0d9998 nodeName:}" failed. No retries permitted until 2026-07-29 15:45:56.357824861 +0000 UTC m=+6.040908138 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-n8gsh" (UniqueName: "kubernetes.io/projected/b7346e04-c640-4552-832b-a57e1b0d9998-kube-api-access-n8gsh") pod "network-check-target-94h8p" (UID: "b7346e04-c640-4552-832b-a57e1b0d9998") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:45:54.674351 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:54.674232 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 15:40:53 +0000 UTC" deadline="2028-01-06 15:10:18.41583187 +0000 UTC" Jul 29 15:45:54.674351 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:54.674298 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12623h24m23.741538608s" Jul 29 15:45:54.831820 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:54.831776 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:45:54.832023 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:54.831927 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26xnp" podUID="fe75348c-40b9-462d-8e9e-644aed841fae" Jul 29 15:45:54.832378 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:54.832358 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:45:54.832502 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:54.832475 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dj58l" podUID="c5d6572b-df40-46ac-80aa-e62fb0eae0a8" Jul 29 15:45:54.905032 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:54.904964 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal" event={"ID":"35429a64cc41bf0a3ba185325ae3dc4f","Type":"ContainerStarted","Data":"73a05e2eed05335ccfcbbd29773c932638e157918565e893ab0ddae3e6459aa1"} Jul 29 15:45:54.923678 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:54.923205 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal" podStartSLOduration=2.923180677 podStartE2EDuration="2.923180677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:45:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:45:54.922594061 +0000 UTC m=+4.605677383" watchObservedRunningTime="2026-07-29 15:45:54.923180677 +0000 UTC m=+4.606263975" Jul 29 15:45:55.829939 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:55.829474 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:45:55.829939 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:55.829607 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94h8p" podUID="b7346e04-c640-4552-832b-a57e1b0d9998" Jul 29 15:45:56.277521 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:56.277419 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5d6572b-df40-46ac-80aa-e62fb0eae0a8-metrics-certs\") pod \"network-metrics-daemon-dj58l\" (UID: \"c5d6572b-df40-46ac-80aa-e62fb0eae0a8\") " pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:45:56.277702 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:56.277590 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:45:56.277702 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:56.277675 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5d6572b-df40-46ac-80aa-e62fb0eae0a8-metrics-certs podName:c5d6572b-df40-46ac-80aa-e62fb0eae0a8 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:00.277650473 +0000 UTC m=+9.960733767 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c5d6572b-df40-46ac-80aa-e62fb0eae0a8-metrics-certs") pod "network-metrics-daemon-dj58l" (UID: "c5d6572b-df40-46ac-80aa-e62fb0eae0a8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:45:56.378195 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:56.378149 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8gsh\" (UniqueName: \"kubernetes.io/projected/b7346e04-c640-4552-832b-a57e1b0d9998-kube-api-access-n8gsh\") pod \"network-check-target-94h8p\" (UID: \"b7346e04-c640-4552-832b-a57e1b0d9998\") " pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:45:56.378390 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:56.378206 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe75348c-40b9-462d-8e9e-644aed841fae-original-pull-secret\") pod \"global-pull-secret-syncer-26xnp\" (UID: \"fe75348c-40b9-462d-8e9e-644aed841fae\") " pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:45:56.378390 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:56.378331 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:45:56.378537 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:56.378394 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe75348c-40b9-462d-8e9e-644aed841fae-original-pull-secret podName:fe75348c-40b9-462d-8e9e-644aed841fae nodeName:}" failed. No retries permitted until 2026-07-29 15:46:00.378376336 +0000 UTC m=+10.061459629 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe75348c-40b9-462d-8e9e-644aed841fae-original-pull-secret") pod "global-pull-secret-syncer-26xnp" (UID: "fe75348c-40b9-462d-8e9e-644aed841fae") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:45:56.378848 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:56.378827 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:45:56.378947 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:56.378851 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:45:56.378947 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:56.378864 2567 projected.go:196] Error preparing data for projected volume kube-api-access-n8gsh for pod openshift-network-diagnostics/network-check-target-94h8p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:45:56.378947 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:56.378914 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7346e04-c640-4552-832b-a57e1b0d9998-kube-api-access-n8gsh podName:b7346e04-c640-4552-832b-a57e1b0d9998 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:00.378898011 +0000 UTC m=+10.061981286 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-n8gsh" (UniqueName: "kubernetes.io/projected/b7346e04-c640-4552-832b-a57e1b0d9998-kube-api-access-n8gsh") pod "network-check-target-94h8p" (UID: "b7346e04-c640-4552-832b-a57e1b0d9998") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:45:56.831341 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:56.831308 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:45:56.831876 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:56.831449 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26xnp" podUID="fe75348c-40b9-462d-8e9e-644aed841fae" Jul 29 15:45:56.831951 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:56.831906 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:45:56.832098 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:56.831998 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dj58l" podUID="c5d6572b-df40-46ac-80aa-e62fb0eae0a8" Jul 29 15:45:57.829396 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:57.829356 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:45:57.829587 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:57.829496 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94h8p" podUID="b7346e04-c640-4552-832b-a57e1b0d9998" Jul 29 15:45:58.829299 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:58.829219 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:45:58.829704 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:58.829358 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dj58l" podUID="c5d6572b-df40-46ac-80aa-e62fb0eae0a8" Jul 29 15:45:58.829771 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:58.829748 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:45:58.829873 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:58.829850 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26xnp" podUID="fe75348c-40b9-462d-8e9e-644aed841fae" Jul 29 15:45:59.828784 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:45:59.828749 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:45:59.828964 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:45:59.828890 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94h8p" podUID="b7346e04-c640-4552-832b-a57e1b0d9998" Jul 29 15:46:00.313527 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:00.313446 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5d6572b-df40-46ac-80aa-e62fb0eae0a8-metrics-certs\") pod \"network-metrics-daemon-dj58l\" (UID: \"c5d6572b-df40-46ac-80aa-e62fb0eae0a8\") " pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:46:00.313975 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:00.313605 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:00.313975 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:00.313678 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5d6572b-df40-46ac-80aa-e62fb0eae0a8-metrics-certs podName:c5d6572b-df40-46ac-80aa-e62fb0eae0a8 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:08.313656707 +0000 UTC m=+17.996739998 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c5d6572b-df40-46ac-80aa-e62fb0eae0a8-metrics-certs") pod "network-metrics-daemon-dj58l" (UID: "c5d6572b-df40-46ac-80aa-e62fb0eae0a8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:00.414854 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:00.414812 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8gsh\" (UniqueName: \"kubernetes.io/projected/b7346e04-c640-4552-832b-a57e1b0d9998-kube-api-access-n8gsh\") pod \"network-check-target-94h8p\" (UID: \"b7346e04-c640-4552-832b-a57e1b0d9998\") " pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:46:00.415041 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:00.414868 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe75348c-40b9-462d-8e9e-644aed841fae-original-pull-secret\") pod \"global-pull-secret-syncer-26xnp\" (UID: \"fe75348c-40b9-462d-8e9e-644aed841fae\") " pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:46:00.415041 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:00.415018 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:00.415179 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:00.415082 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe75348c-40b9-462d-8e9e-644aed841fae-original-pull-secret podName:fe75348c-40b9-462d-8e9e-644aed841fae nodeName:}" failed. No retries permitted until 2026-07-29 15:46:08.415063149 +0000 UTC m=+18.098146425 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe75348c-40b9-462d-8e9e-644aed841fae-original-pull-secret") pod "global-pull-secret-syncer-26xnp" (UID: "fe75348c-40b9-462d-8e9e-644aed841fae") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:00.415508 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:00.415486 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:46:00.415508 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:00.415508 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:46:00.415656 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:00.415518 2567 projected.go:196] Error preparing data for projected volume kube-api-access-n8gsh for pod openshift-network-diagnostics/network-check-target-94h8p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:00.415656 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:00.415552 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7346e04-c640-4552-832b-a57e1b0d9998-kube-api-access-n8gsh podName:b7346e04-c640-4552-832b-a57e1b0d9998 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:08.415541696 +0000 UTC m=+18.098624968 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-n8gsh" (UniqueName: "kubernetes.io/projected/b7346e04-c640-4552-832b-a57e1b0d9998-kube-api-access-n8gsh") pod "network-check-target-94h8p" (UID: "b7346e04-c640-4552-832b-a57e1b0d9998") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:00.833032 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:00.829350 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:46:00.833032 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:00.829405 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:46:00.833032 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:00.829506 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26xnp" podUID="fe75348c-40b9-462d-8e9e-644aed841fae" Jul 29 15:46:00.833032 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:00.831894 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dj58l" podUID="c5d6572b-df40-46ac-80aa-e62fb0eae0a8" Jul 29 15:46:01.829610 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:01.829571 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:46:01.830056 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:01.829703 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94h8p" podUID="b7346e04-c640-4552-832b-a57e1b0d9998" Jul 29 15:46:02.832237 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:02.831678 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:46:02.832237 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:02.831787 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26xnp" podUID="fe75348c-40b9-462d-8e9e-644aed841fae" Jul 29 15:46:02.832237 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:02.832104 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:46:02.832237 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:02.832182 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dj58l" podUID="c5d6572b-df40-46ac-80aa-e62fb0eae0a8" Jul 29 15:46:03.828810 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:03.828772 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:46:03.828947 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:03.828905 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94h8p" podUID="b7346e04-c640-4552-832b-a57e1b0d9998" Jul 29 15:46:04.829551 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:04.829505 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:46:04.829986 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:04.829504 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:46:04.829986 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:04.829661 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26xnp" podUID="fe75348c-40b9-462d-8e9e-644aed841fae" Jul 29 15:46:04.829986 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:04.829721 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dj58l" podUID="c5d6572b-df40-46ac-80aa-e62fb0eae0a8" Jul 29 15:46:05.829074 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:05.829044 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:46:05.829228 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:05.829136 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94h8p" podUID="b7346e04-c640-4552-832b-a57e1b0d9998" Jul 29 15:46:06.829153 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:06.829124 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:46:06.829646 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:06.829122 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:46:06.829646 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:06.829253 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dj58l" podUID="c5d6572b-df40-46ac-80aa-e62fb0eae0a8" Jul 29 15:46:06.829646 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:06.829345 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26xnp" podUID="fe75348c-40b9-462d-8e9e-644aed841fae" Jul 29 15:46:07.829573 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:07.829528 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:46:07.830027 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:07.829666 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94h8p" podUID="b7346e04-c640-4552-832b-a57e1b0d9998" Jul 29 15:46:08.376744 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:08.376697 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5d6572b-df40-46ac-80aa-e62fb0eae0a8-metrics-certs\") pod \"network-metrics-daemon-dj58l\" (UID: \"c5d6572b-df40-46ac-80aa-e62fb0eae0a8\") " pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:46:08.376971 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:08.376904 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:08.377057 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:08.376985 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5d6572b-df40-46ac-80aa-e62fb0eae0a8-metrics-certs podName:c5d6572b-df40-46ac-80aa-e62fb0eae0a8 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:24.37696841 +0000 UTC m=+34.060051683 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c5d6572b-df40-46ac-80aa-e62fb0eae0a8-metrics-certs") pod "network-metrics-daemon-dj58l" (UID: "c5d6572b-df40-46ac-80aa-e62fb0eae0a8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:08.477312 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:08.477270 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8gsh\" (UniqueName: \"kubernetes.io/projected/b7346e04-c640-4552-832b-a57e1b0d9998-kube-api-access-n8gsh\") pod \"network-check-target-94h8p\" (UID: \"b7346e04-c640-4552-832b-a57e1b0d9998\") " pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:46:08.477505 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:08.477325 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe75348c-40b9-462d-8e9e-644aed841fae-original-pull-secret\") pod \"global-pull-secret-syncer-26xnp\" (UID: \"fe75348c-40b9-462d-8e9e-644aed841fae\") " pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:46:08.477505 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:08.477454 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:08.477505 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:08.477470 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:46:08.477505 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:08.477497 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:46:08.477505 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:08.477511 2567 projected.go:196] Error preparing data for projected volume kube-api-access-n8gsh for pod openshift-network-diagnostics/network-check-target-94h8p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:08.477752 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:08.477523 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe75348c-40b9-462d-8e9e-644aed841fae-original-pull-secret podName:fe75348c-40b9-462d-8e9e-644aed841fae nodeName:}" failed. No retries permitted until 2026-07-29 15:46:24.477503112 +0000 UTC m=+34.160586387 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe75348c-40b9-462d-8e9e-644aed841fae-original-pull-secret") pod "global-pull-secret-syncer-26xnp" (UID: "fe75348c-40b9-462d-8e9e-644aed841fae") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:08.477752 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:08.477562 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7346e04-c640-4552-832b-a57e1b0d9998-kube-api-access-n8gsh podName:b7346e04-c640-4552-832b-a57e1b0d9998 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:24.477547238 +0000 UTC m=+34.160630513 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-n8gsh" (UniqueName: "kubernetes.io/projected/b7346e04-c640-4552-832b-a57e1b0d9998-kube-api-access-n8gsh") pod "network-check-target-94h8p" (UID: "b7346e04-c640-4552-832b-a57e1b0d9998") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:08.829367 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:08.829260 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:46:08.829367 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:08.829284 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:46:08.829613 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:08.829410 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dj58l" podUID="c5d6572b-df40-46ac-80aa-e62fb0eae0a8" Jul 29 15:46:08.829613 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:08.829556 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26xnp" podUID="fe75348c-40b9-462d-8e9e-644aed841fae" Jul 29 15:46:09.829535 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:09.829496 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:46:09.829703 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:09.829636 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94h8p" podUID="b7346e04-c640-4552-832b-a57e1b0d9998" Jul 29 15:46:10.830611 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:10.830134 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:46:10.830611 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:10.830254 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26xnp" podUID="fe75348c-40b9-462d-8e9e-644aed841fae" Jul 29 15:46:10.830611 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:10.830311 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:46:10.830611 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:10.830444 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dj58l" podUID="c5d6572b-df40-46ac-80aa-e62fb0eae0a8" Jul 29 15:46:11.829096 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:11.829048 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:46:11.829271 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:11.829167 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94h8p" podUID="b7346e04-c640-4552-832b-a57e1b0d9998" Jul 29 15:46:12.832047 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:12.831858 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:46:12.832713 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:12.831912 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:46:12.832713 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:12.832126 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dj58l" podUID="c5d6572b-df40-46ac-80aa-e62fb0eae0a8" Jul 29 15:46:12.832713 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:12.832187 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26xnp" podUID="fe75348c-40b9-462d-8e9e-644aed841fae" Jul 29 15:46:12.944553 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:12.944511 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xm7ph" event={"ID":"06c8dbb9-0046-48c8-a509-07078d3e19e2","Type":"ContainerStarted","Data":"542848f0584a94cc768e1654e75ac2c981fee29e34b00c4829bd0d6f76c27b5c"} Jul 29 15:46:12.947703 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:12.947672 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" event={"ID":"f2281802-4f4b-495b-8bca-8cc371df6eec","Type":"ContainerStarted","Data":"37677db1928bc72941ae521f79e3522f89da2c69cbc2caffb66cd8e37c77bbf6"} Jul 29 15:46:12.947819 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:12.947769 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" event={"ID":"f2281802-4f4b-495b-8bca-8cc371df6eec","Type":"ContainerStarted","Data":"aac68217b19a86e9e0bdbe7c9cf2ce5f4450f7cd2dd26f3e10bfb1b016de5830"} Jul 29 15:46:12.947819 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:12.947814 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" event={"ID":"f2281802-4f4b-495b-8bca-8cc371df6eec","Type":"ContainerStarted","Data":"a18d03776fc14fffe2d76d04311d8a18913a73cc4e55d147e7f91b9e5bce165a"} Jul 29 15:46:12.948980 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:12.948453 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" event={"ID":"f2281802-4f4b-495b-8bca-8cc371df6eec","Type":"ContainerStarted","Data":"573040b1bfd84eb4114893ccfd5d4eb0660c9717918cbf730ba3d674a8edcd10"} Jul 29 15:46:12.952949 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:12.952907 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z64m6" event={"ID":"c0a75f9d-b980-4b9e-b4c5-fdf114c2f202","Type":"ContainerStarted","Data":"a566872f7c273511f5ee4f2a6f955af86112e236e14eff607d1437c4747a6672"} Jul 29 15:46:12.954264 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:12.954244 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" event={"ID":"d91f80fe-f4fa-4484-9244-c520bc696460","Type":"ContainerStarted","Data":"7668eb3ea602e28b48f6e4f978b8faee73d1e00155875f927cb26432f7ffe3c7"} Jul 29 15:46:12.955664 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:12.955640 2567 generic.go:356] "Generic (PLEG): container finished" podID="0bd89f55-5065-499c-a550-d7b6f62acb1f" containerID="aed6c8ba3ec0979172a18ff7a98d50c8eb96aafcb0d79559e784a6ea032cba1e" exitCode=0 Jul 29 15:46:12.955764 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:12.955719 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvdkk" event={"ID":"0bd89f55-5065-499c-a550-d7b6f62acb1f","Type":"ContainerDied","Data":"aed6c8ba3ec0979172a18ff7a98d50c8eb96aafcb0d79559e784a6ea032cba1e"} Jul 29 15:46:12.957036 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:12.957014 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-crwhp" event={"ID":"70b633f9-e025-4576-a729-be5ebb65658e","Type":"ContainerStarted","Data":"a9d712eae8d76ba0d927c2161a7c1e3b5ce34ba387b482824b6a4220917c5f86"} Jul 29 15:46:12.958516 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:12.958493 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f9hnm" event={"ID":"4dcf8deb-1079-4f6f-9ae9-e0d84870c960","Type":"ContainerStarted","Data":"3a6fd9a3f22fc1046d8318dd48dc15508c038c5dd47ce404cee327be0b2ce686"} Jul 29 15:46:12.959878 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:12.959857 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-124.ec2.internal" event={"ID":"834e29422605a4563abd0c2b2da8dece","Type":"ContainerStarted","Data":"c39e59d48e174c232fe342fb8a9c238786489015c0bd9f633b467edbc987afee"} Jul 29 15:46:12.961149 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:12.961130 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tqjbj" event={"ID":"c1f386b0-39d7-4422-98d7-b62d212d6b62","Type":"ContainerStarted","Data":"6b5f6c38ec3105ce00786f8c8125a1f902b0e104ed2177c29a0d4fe4d0531389"} Jul 29 15:46:12.984195 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:12.984152 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xm7ph" podStartSLOduration=2.764461081 podStartE2EDuration="21.984138847s" totalImagesPullingTime="19.219677766s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:45:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:46:12.969259393 +0000 UTC m=+22.652342683" watchObservedRunningTime="2026-07-29 15:46:12.984138847 +0000 UTC m=+22.667222141" Jul 29 15:46:12.984317 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:12.984299 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-124.ec2.internal" podStartSLOduration=20.984295729 podStartE2EDuration="20.984295729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:45:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:46:12.983855161 +0000 UTC m=+22.666938454" watchObservedRunningTime="2026-07-29 15:46:12.984295729 +0000 UTC m=+22.667379023" Jul 29 15:46:13.038632 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:13.038583 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-crwhp" podStartSLOduration=2.8904682790000003 podStartE2EDuration="22.038568852s" totalImagesPullingTime="19.148100573s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:45:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:46:13.038376869 +0000 UTC m=+22.721460163" watchObservedRunningTime="2026-07-29 15:46:13.038568852 +0000 UTC m=+22.721652147" Jul 29 15:46:13.082366 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:13.082321 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gkb9q" podStartSLOduration=2.930516489 podStartE2EDuration="22.08230638s" totalImagesPullingTime="19.151789891s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:45:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:46:13.059400211 +0000 UTC m=+22.742483515" watchObservedRunningTime="2026-07-29 15:46:13.08230638 +0000 UTC m=+22.765389674" Jul 29 15:46:13.103613 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:13.103555 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-f9hnm" podStartSLOduration=2.932216553 podStartE2EDuration="22.103537951s" totalImagesPullingTime="19.171321398s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:45:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:46:13.082482436 +0000 UTC m=+22.765565731" watchObservedRunningTime="2026-07-29 15:46:13.103537951 +0000 UTC m=+22.786621245" Jul 29 15:46:13.829191 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:13.829154 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:46:13.829331 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:13.829253 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94h8p" podUID="b7346e04-c640-4552-832b-a57e1b0d9998" Jul 29 15:46:13.965174 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:13.964922 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cwkkf" event={"ID":"3c2416e5-3e11-42e8-95d5-93fc1b266d71","Type":"ContainerStarted","Data":"e4b0a8112ecc75115a8dc45769e0be15db1d4e833aeb6d1adf1be4d69acc32e5"} Jul 29 15:46:13.969126 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:13.968965 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" event={"ID":"f2281802-4f4b-495b-8bca-8cc371df6eec","Type":"ContainerStarted","Data":"84265eea37b209f11711eecce4558130b5dd041781406fd70ffb29bc59557ec7"} Jul 29 15:46:13.969126 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:13.969057 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" event={"ID":"f2281802-4f4b-495b-8bca-8cc371df6eec","Type":"ContainerStarted","Data":"bcef1a71ca6b1aa48a228315ea4d7fc8357c83620d9ccd695abfe8e92ab95867"} Jul 29 15:46:13.980011 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:13.979969 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cwkkf" podStartSLOduration=3.821746953 podStartE2EDuration="22.979953444s" totalImagesPullingTime="19.158206491s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:45:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:46:13.979874544 +0000 UTC m=+23.662957839" watchObservedRunningTime="2026-07-29 15:46:13.979953444 +0000 UTC m=+23.663036735" Jul 29 15:46:13.980469 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:13.980447 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tqjbj" podStartSLOduration=3.825473328 podStartE2EDuration="22.980439974s" totalImagesPullingTime="19.154966646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:45:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:46:13.103877132 +0000 UTC m=+22.786960426" watchObservedRunningTime="2026-07-29 15:46:13.980439974 +0000 UTC m=+23.663523268" Jul 29 15:46:14.037124 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:14.037097 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 29 15:46:14.689928 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:14.689807 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T15:46:14.037118613Z","UUID":"0b827609-9802-4d32-b2ff-2dc25d162924","Handler":null,"Name":"","Endpoint":""} Jul 29 15:46:14.691751 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:14.691727 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 29 15:46:14.691861 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:14.691788 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 29 15:46:14.829205 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:14.829172 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:46:14.829369 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:14.829303 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dj58l" podUID="c5d6572b-df40-46ac-80aa-e62fb0eae0a8" Jul 29 15:46:14.829369 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:14.829354 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:46:14.829493 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:14.829461 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26xnp" podUID="fe75348c-40b9-462d-8e9e-644aed841fae" Jul 29 15:46:14.974058 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:14.974021 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z64m6" event={"ID":"c0a75f9d-b980-4b9e-b4c5-fdf114c2f202","Type":"ContainerStarted","Data":"e821fd728b56ea35509e39a865b23ff58106e45a2b736766956d09105b9ad08b"} Jul 29 15:46:15.829744 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:15.829487 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:46:15.829985 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:15.829853 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94h8p" podUID="b7346e04-c640-4552-832b-a57e1b0d9998" Jul 29 15:46:15.980950 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:15.980894 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" event={"ID":"f2281802-4f4b-495b-8bca-8cc371df6eec","Type":"ContainerStarted","Data":"7cd8e6a742846e9c9aa5d64c3ca266176cd1cb7d7fc17c5f7d7a1553f35fd9b8"} Jul 29 15:46:15.983325 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:15.983298 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z64m6" event={"ID":"c0a75f9d-b980-4b9e-b4c5-fdf114c2f202","Type":"ContainerStarted","Data":"e9bb9fbf512a1415f11e5a067947985e4a32d6262309f4309b38f8dfe1908ce1"} Jul 29 15:46:15.999354 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:15.999295 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z64m6" podStartSLOduration=3.60093392 podStartE2EDuration="24.999271708s" totalImagesPullingTime="21.398337788s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:45:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:46:15.99919708 +0000 UTC m=+25.682280381" watchObservedRunningTime="2026-07-29 15:46:15.999271708 +0000 UTC m=+25.682355003" Jul 29 15:46:16.252260 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:16.252181 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tqjbj" Jul 29 15:46:16.252911 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:16.252890 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tqjbj" Jul 29 15:46:16.829490 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:16.829460 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:46:16.829712 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:16.829461 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:46:16.829712 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:16.829585 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dj58l" podUID="c5d6572b-df40-46ac-80aa-e62fb0eae0a8" Jul 29 15:46:16.829712 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:16.829649 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26xnp" podUID="fe75348c-40b9-462d-8e9e-644aed841fae" Jul 29 15:46:16.985927 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:16.985884 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tqjbj" Jul 29 15:46:16.986499 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:16.986371 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tqjbj" Jul 29 15:46:17.829040 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:17.829008 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:46:17.829195 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:17.829112 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94h8p" podUID="b7346e04-c640-4552-832b-a57e1b0d9998" Jul 29 15:46:17.993410 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:17.993231 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" event={"ID":"f2281802-4f4b-495b-8bca-8cc371df6eec","Type":"ContainerStarted","Data":"6db581943e3037ebb15421250a38bb69967bd310472fd351d8a73fc343f6c768"} Jul 29 15:46:18.026503 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:18.026354 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" podStartSLOduration=7.80959581 podStartE2EDuration="27.026339982s" totalImagesPullingTime="19.216744172s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:45:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:46:18.026208758 +0000 UTC m=+27.709292053" watchObservedRunningTime="2026-07-29 15:46:18.026339982 +0000 UTC m=+27.709423305" Jul 29 15:46:18.831628 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:18.831600 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:46:18.831805 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:18.831712 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dj58l" podUID="c5d6572b-df40-46ac-80aa-e62fb0eae0a8" Jul 29 15:46:18.831805 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:18.831762 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:46:18.831874 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:18.831844 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26xnp" podUID="fe75348c-40b9-462d-8e9e-644aed841fae" Jul 29 15:46:18.996710 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:18.996623 2567 generic.go:356] "Generic (PLEG): container finished" podID="0bd89f55-5065-499c-a550-d7b6f62acb1f" containerID="a75e4e62df55843da66fab5af8a37c4ad59021269711c772114483a29db5997f" exitCode=0 Jul 29 15:46:18.997191 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:18.996717 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvdkk" event={"ID":"0bd89f55-5065-499c-a550-d7b6f62acb1f","Type":"ContainerDied","Data":"a75e4e62df55843da66fab5af8a37c4ad59021269711c772114483a29db5997f"} Jul 29 15:46:18.997257 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:18.997243 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:46:18.997314 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:18.997301 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:46:18.997376 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:18.997343 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:46:19.013670 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:19.013644 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:46:19.013827 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:19.013746 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:46:19.829458 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:19.829428 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:46:19.829696 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:19.829533 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94h8p" podUID="b7346e04-c640-4552-832b-a57e1b0d9998" Jul 29 15:46:20.166471 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:20.166133 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dj58l"] Jul 29 15:46:20.166844 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:20.166578 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:46:20.166844 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:20.166687 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dj58l" podUID="c5d6572b-df40-46ac-80aa-e62fb0eae0a8" Jul 29 15:46:20.169895 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:20.169717 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-94h8p"] Jul 29 15:46:20.169895 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:20.169824 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:46:20.170135 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:20.169965 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94h8p" podUID="b7346e04-c640-4552-832b-a57e1b0d9998" Jul 29 15:46:20.170401 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:20.170383 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-26xnp"] Jul 29 15:46:20.170499 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:20.170463 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:46:20.170585 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:20.170565 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26xnp" podUID="fe75348c-40b9-462d-8e9e-644aed841fae" Jul 29 15:46:21.002201 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:21.002170 2567 generic.go:356] "Generic (PLEG): container finished" podID="0bd89f55-5065-499c-a550-d7b6f62acb1f" containerID="cd377ff187694f7ad76089bf1976c5f67b4600690d957469a6905458f43c8ec7" exitCode=0 Jul 29 15:46:21.002364 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:21.002203 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvdkk" event={"ID":"0bd89f55-5065-499c-a550-d7b6f62acb1f","Type":"ContainerDied","Data":"cd377ff187694f7ad76089bf1976c5f67b4600690d957469a6905458f43c8ec7"} Jul 29 15:46:21.829662 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:21.829625 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:46:21.829662 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:21.829654 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:46:21.830270 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:21.829665 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:46:21.830270 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:21.829746 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dj58l" podUID="c5d6572b-df40-46ac-80aa-e62fb0eae0a8" Jul 29 15:46:21.830270 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:21.829884 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26xnp" podUID="fe75348c-40b9-462d-8e9e-644aed841fae" Jul 29 15:46:21.830270 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:21.829989 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94h8p" podUID="b7346e04-c640-4552-832b-a57e1b0d9998" Jul 29 15:46:22.007328 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:22.007301 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvdkk" event={"ID":"0bd89f55-5065-499c-a550-d7b6f62acb1f","Type":"ContainerStarted","Data":"6b454c4dec16ab6dcf4ad763e6363807ac42647ef8cdeedec44bb9a2c0c3ed29"} Jul 29 15:46:23.012059 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:23.012027 2567 generic.go:356] "Generic (PLEG): container finished" podID="0bd89f55-5065-499c-a550-d7b6f62acb1f" containerID="6b454c4dec16ab6dcf4ad763e6363807ac42647ef8cdeedec44bb9a2c0c3ed29" exitCode=0 Jul 29 15:46:23.012521 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:23.012075 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvdkk" event={"ID":"0bd89f55-5065-499c-a550-d7b6f62acb1f","Type":"ContainerDied","Data":"6b454c4dec16ab6dcf4ad763e6363807ac42647ef8cdeedec44bb9a2c0c3ed29"} Jul 29 15:46:23.828895 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:23.828864 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:46:23.829114 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:23.828864 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:46:23.829114 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:23.829009 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dj58l" podUID="c5d6572b-df40-46ac-80aa-e62fb0eae0a8" Jul 29 15:46:23.829114 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:23.828864 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:46:23.829114 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:23.829068 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94h8p" podUID="b7346e04-c640-4552-832b-a57e1b0d9998" Jul 29 15:46:23.829329 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:23.829201 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26xnp" podUID="fe75348c-40b9-462d-8e9e-644aed841fae" Jul 29 15:46:24.399801 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:24.399759 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5d6572b-df40-46ac-80aa-e62fb0eae0a8-metrics-certs\") pod \"network-metrics-daemon-dj58l\" (UID: \"c5d6572b-df40-46ac-80aa-e62fb0eae0a8\") " pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:46:24.400297 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:24.399953 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:24.400297 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:24.400031 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5d6572b-df40-46ac-80aa-e62fb0eae0a8-metrics-certs podName:c5d6572b-df40-46ac-80aa-e62fb0eae0a8 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:56.400010382 +0000 UTC m=+66.083093655 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c5d6572b-df40-46ac-80aa-e62fb0eae0a8-metrics-certs") pod "network-metrics-daemon-dj58l" (UID: "c5d6572b-df40-46ac-80aa-e62fb0eae0a8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:24.500477 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:24.500439 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8gsh\" (UniqueName: \"kubernetes.io/projected/b7346e04-c640-4552-832b-a57e1b0d9998-kube-api-access-n8gsh\") pod \"network-check-target-94h8p\" (UID: \"b7346e04-c640-4552-832b-a57e1b0d9998\") " pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:46:24.500647 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:24.500485 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe75348c-40b9-462d-8e9e-644aed841fae-original-pull-secret\") pod \"global-pull-secret-syncer-26xnp\" (UID: \"fe75348c-40b9-462d-8e9e-644aed841fae\") " pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:46:24.500647 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:24.500619 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:24.500647 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:24.500638 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:46:24.500840 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:24.500661 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:46:24.500840 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:24.500674 2567 projected.go:196] Error preparing data for projected volume kube-api-access-n8gsh for pod openshift-network-diagnostics/network-check-target-94h8p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:24.500840 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:24.500693 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe75348c-40b9-462d-8e9e-644aed841fae-original-pull-secret podName:fe75348c-40b9-462d-8e9e-644aed841fae nodeName:}" failed. No retries permitted until 2026-07-29 15:46:56.500675161 +0000 UTC m=+66.183758441 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe75348c-40b9-462d-8e9e-644aed841fae-original-pull-secret") pod "global-pull-secret-syncer-26xnp" (UID: "fe75348c-40b9-462d-8e9e-644aed841fae") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:24.500840 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:24.500761 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7346e04-c640-4552-832b-a57e1b0d9998-kube-api-access-n8gsh podName:b7346e04-c640-4552-832b-a57e1b0d9998 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:56.50074986 +0000 UTC m=+66.183833131 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-n8gsh" (UniqueName: "kubernetes.io/projected/b7346e04-c640-4552-832b-a57e1b0d9998-kube-api-access-n8gsh") pod "network-check-target-94h8p" (UID: "b7346e04-c640-4552-832b-a57e1b0d9998") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:25.161588 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.161508 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeReady" Jul 29 15:46:25.161751 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.161659 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 29 15:46:25.204611 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.204574 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8lkvv"] Jul 29 15:46:25.207977 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.207955 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8lkvv" Jul 29 15:46:25.210345 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.210320 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 29 15:46:25.210576 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.210555 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 29 15:46:25.210985 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.210967 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6tw4d"] Jul 29 15:46:25.211101 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.211080 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wwm9h\"" Jul 29 15:46:25.214268 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.214251 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6tw4d" Jul 29 15:46:25.216138 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.216117 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 29 15:46:25.216342 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.216323 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 29 15:46:25.216420 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.216370 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 29 15:46:25.216473 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.216456 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rpsss\"" Jul 29 15:46:25.218384 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.218356 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8lkvv"] Jul 29 15:46:25.224118 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.224094 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6tw4d"] Jul 29 15:46:25.305896 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.305854 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b-tmp-dir\") pod \"dns-default-8lkvv\" (UID: \"9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b\") " pod="openshift-dns/dns-default-8lkvv" Jul 29 15:46:25.306073 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.305945 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rz74\" (UniqueName: \"kubernetes.io/projected/c2010b07-9481-44e2-83d2-041556d8c913-kube-api-access-7rz74\") pod \"ingress-canary-6tw4d\" (UID: \"c2010b07-9481-44e2-83d2-041556d8c913\") " pod="openshift-ingress-canary/ingress-canary-6tw4d" Jul 29 15:46:25.306073 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.306002 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b-metrics-tls\") pod \"dns-default-8lkvv\" (UID: \"9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b\") " pod="openshift-dns/dns-default-8lkvv" Jul 29 15:46:25.306073 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.306027 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2010b07-9481-44e2-83d2-041556d8c913-cert\") pod \"ingress-canary-6tw4d\" (UID: \"c2010b07-9481-44e2-83d2-041556d8c913\") " pod="openshift-ingress-canary/ingress-canary-6tw4d" Jul 29 15:46:25.306244 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.306088 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b-config-volume\") pod \"dns-default-8lkvv\" (UID: \"9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b\") " pod="openshift-dns/dns-default-8lkvv" Jul 29 15:46:25.306244 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.306123 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwdpq\" (UniqueName: \"kubernetes.io/projected/9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b-kube-api-access-rwdpq\") pod \"dns-default-8lkvv\" (UID: \"9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b\") " pod="openshift-dns/dns-default-8lkvv" Jul 29 15:46:25.407268 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.407224 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b-tmp-dir\") pod \"dns-default-8lkvv\" (UID: \"9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b\") " pod="openshift-dns/dns-default-8lkvv" Jul 29 15:46:25.407679 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.407285 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rz74\" (UniqueName: \"kubernetes.io/projected/c2010b07-9481-44e2-83d2-041556d8c913-kube-api-access-7rz74\") pod \"ingress-canary-6tw4d\" (UID: \"c2010b07-9481-44e2-83d2-041556d8c913\") " pod="openshift-ingress-canary/ingress-canary-6tw4d" Jul 29 15:46:25.407679 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.407314 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b-metrics-tls\") pod \"dns-default-8lkvv\" (UID: \"9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b\") " pod="openshift-dns/dns-default-8lkvv" Jul 29 15:46:25.407679 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.407338 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2010b07-9481-44e2-83d2-041556d8c913-cert\") pod \"ingress-canary-6tw4d\" (UID: \"c2010b07-9481-44e2-83d2-041556d8c913\") " pod="openshift-ingress-canary/ingress-canary-6tw4d" Jul 29 15:46:25.407679 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.407395 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b-config-volume\") pod \"dns-default-8lkvv\" (UID: \"9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b\") " pod="openshift-dns/dns-default-8lkvv" Jul 29 15:46:25.407679 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.407446 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwdpq\" (UniqueName: \"kubernetes.io/projected/9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b-kube-api-access-rwdpq\") pod \"dns-default-8lkvv\" (UID: \"9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b\") " pod="openshift-dns/dns-default-8lkvv" Jul 29 15:46:25.407679 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.407566 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b-tmp-dir\") pod \"dns-default-8lkvv\" (UID: \"9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b\") " pod="openshift-dns/dns-default-8lkvv" Jul 29 15:46:25.407679 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:25.407682 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:46:25.407958 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:25.407732 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b-metrics-tls podName:9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b nodeName:}" failed. No retries permitted until 2026-07-29 15:46:25.907716723 +0000 UTC m=+35.590799998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b-metrics-tls") pod "dns-default-8lkvv" (UID: "9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b") : secret "dns-default-metrics-tls" not found Jul 29 15:46:25.408654 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.408631 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b-config-volume\") pod \"dns-default-8lkvv\" (UID: \"9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b\") " pod="openshift-dns/dns-default-8lkvv" Jul 29 15:46:25.412845 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.412782 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2010b07-9481-44e2-83d2-041556d8c913-cert\") pod \"ingress-canary-6tw4d\" (UID: \"c2010b07-9481-44e2-83d2-041556d8c913\") " pod="openshift-ingress-canary/ingress-canary-6tw4d" Jul 29 15:46:25.416294 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.416267 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwdpq\" (UniqueName: \"kubernetes.io/projected/9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b-kube-api-access-rwdpq\") pod \"dns-default-8lkvv\" (UID: \"9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b\") " pod="openshift-dns/dns-default-8lkvv" Jul 29 15:46:25.416638 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.416615 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rz74\" (UniqueName: \"kubernetes.io/projected/c2010b07-9481-44e2-83d2-041556d8c913-kube-api-access-7rz74\") pod \"ingress-canary-6tw4d\" (UID: \"c2010b07-9481-44e2-83d2-041556d8c913\") " pod="openshift-ingress-canary/ingress-canary-6tw4d" Jul 29 15:46:25.528819 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.528784 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6tw4d" Jul 29 15:46:25.829050 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.828965 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:46:25.829050 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.828999 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:46:25.829300 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.829279 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:46:25.832154 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.831326 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 15:46:25.832154 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.831324 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 15:46:25.832154 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.831770 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s67m5\"" Jul 29 15:46:25.832154 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.831836 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dcxh7\"" Jul 29 15:46:25.832154 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.831985 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 15:46:25.832154 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.832064 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 15:46:25.911394 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:25.911358 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b-metrics-tls\") pod \"dns-default-8lkvv\" (UID: \"9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b\") " pod="openshift-dns/dns-default-8lkvv" Jul 29 15:46:25.911602 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:25.911516 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:46:25.911602 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:25.911591 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b-metrics-tls podName:9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b nodeName:}" failed. No retries permitted until 2026-07-29 15:46:26.911570066 +0000 UTC m=+36.594653337 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b-metrics-tls") pod "dns-default-8lkvv" (UID: "9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b") : secret "dns-default-metrics-tls" not found Jul 29 15:46:26.918616 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:26.918434 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b-metrics-tls\") pod \"dns-default-8lkvv\" (UID: \"9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b\") " pod="openshift-dns/dns-default-8lkvv" Jul 29 15:46:26.918965 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:26.918583 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:46:26.918965 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:26.918766 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b-metrics-tls podName:9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b nodeName:}" failed. No retries permitted until 2026-07-29 15:46:28.91874424 +0000 UTC m=+38.601827513 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b-metrics-tls") pod "dns-default-8lkvv" (UID: "9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b") : secret "dns-default-metrics-tls" not found Jul 29 15:46:26.931756 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:26.931413 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6tw4d"] Jul 29 15:46:26.937712 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:46:26.937684 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2010b07_9481_44e2_83d2_041556d8c913.slice/crio-e2c29982450bcaba93d2b8db6989d3385264cc8b0ef256e1cc3ff420f0a27cdf WatchSource:0}: Error finding container e2c29982450bcaba93d2b8db6989d3385264cc8b0ef256e1cc3ff420f0a27cdf: Status 404 returned error can't find the container with id e2c29982450bcaba93d2b8db6989d3385264cc8b0ef256e1cc3ff420f0a27cdf Jul 29 15:46:27.025875 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:27.025833 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvdkk" event={"ID":"0bd89f55-5065-499c-a550-d7b6f62acb1f","Type":"ContainerStarted","Data":"c67d5693252e4e5d8b6faffc791c685404faa6229000f1954a3b1bfce4fd935c"} Jul 29 15:46:27.027065 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:27.027040 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6tw4d" event={"ID":"c2010b07-9481-44e2-83d2-041556d8c913","Type":"ContainerStarted","Data":"e2c29982450bcaba93d2b8db6989d3385264cc8b0ef256e1cc3ff420f0a27cdf"} Jul 29 15:46:28.033128 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:28.033088 2567 generic.go:356] "Generic (PLEG): container finished" podID="0bd89f55-5065-499c-a550-d7b6f62acb1f" containerID="c67d5693252e4e5d8b6faffc791c685404faa6229000f1954a3b1bfce4fd935c" exitCode=0 Jul 29 15:46:28.033563 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:28.033145 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvdkk" event={"ID":"0bd89f55-5065-499c-a550-d7b6f62acb1f","Type":"ContainerDied","Data":"c67d5693252e4e5d8b6faffc791c685404faa6229000f1954a3b1bfce4fd935c"} Jul 29 15:46:28.934439 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:28.934228 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b-metrics-tls\") pod \"dns-default-8lkvv\" (UID: \"9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b\") " pod="openshift-dns/dns-default-8lkvv" Jul 29 15:46:28.934630 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:28.934399 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:46:28.934630 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:28.934585 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b-metrics-tls podName:9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b nodeName:}" failed. No retries permitted until 2026-07-29 15:46:32.934558879 +0000 UTC m=+42.617642155 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b-metrics-tls") pod "dns-default-8lkvv" (UID: "9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b") : secret "dns-default-metrics-tls" not found Jul 29 15:46:29.037848 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:29.037814 2567 generic.go:356] "Generic (PLEG): container finished" podID="0bd89f55-5065-499c-a550-d7b6f62acb1f" containerID="46fa97fa7494bc852c4db5a973cc939579c7b22b4a5542a18db0202b9a6e651a" exitCode=0 Jul 29 15:46:29.038241 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:29.037863 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvdkk" event={"ID":"0bd89f55-5065-499c-a550-d7b6f62acb1f","Type":"ContainerDied","Data":"46fa97fa7494bc852c4db5a973cc939579c7b22b4a5542a18db0202b9a6e651a"} Jul 29 15:46:30.045070 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:30.044969 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvdkk" event={"ID":"0bd89f55-5065-499c-a550-d7b6f62acb1f","Type":"ContainerStarted","Data":"8a21692ad247521680a524bdb2b7382e99c72c7c7258063225709688263488d6"} Jul 29 15:46:30.046308 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:30.046287 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6tw4d" event={"ID":"c2010b07-9481-44e2-83d2-041556d8c913","Type":"ContainerStarted","Data":"94e85ed69d4655600256e8f21c2e5bcca3af5b5d64b9820c16cb077970e5644a"} Jul 29 15:46:30.067874 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:30.067826 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xvdkk" podStartSLOduration=9.036457489 podStartE2EDuration="39.067811479s" totalImagesPullingTime="30.03135399s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:45:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:46:30.066918657 +0000 UTC m=+39.750001974" watchObservedRunningTime="2026-07-29 15:46:30.067811479 +0000 UTC m=+39.750894771" Jul 29 15:46:30.081356 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:30.081311 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6tw4d" podStartSLOduration=2.665306535 podStartE2EDuration="5.081297751s" totalImagesPullingTime="2.415991216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:46:30.0805686 +0000 UTC m=+39.763651904" watchObservedRunningTime="2026-07-29 15:46:30.081297751 +0000 UTC m=+39.764381044" Jul 29 15:46:30.910449 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:30.910413 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lgb2h"] Jul 29 15:46:30.940634 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:30.940604 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lgb2h"] Jul 29 15:46:30.940857 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:30.940750 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lgb2h" Jul 29 15:46:30.943572 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:30.943543 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 29 15:46:30.943764 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:30.943750 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 29 15:46:30.943836 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:30.943793 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 29 15:46:30.944333 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:30.944320 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 29 15:46:30.944424 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:30.944408 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mbt76\"" Jul 29 15:46:31.050727 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:31.050694 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-data-volume\") pod \"insights-runtime-extractor-lgb2h\" (UID: \"7d2163b3-00f3-4ff6-8b0f-66c8706f8614\") " pod="openshift-insights/insights-runtime-extractor-lgb2h" Jul 29 15:46:31.051118 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:31.050749 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lgb2h\" (UID: \"7d2163b3-00f3-4ff6-8b0f-66c8706f8614\") " pod="openshift-insights/insights-runtime-extractor-lgb2h" Jul 29 15:46:31.051118 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:31.050806 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lgb2h\" (UID: \"7d2163b3-00f3-4ff6-8b0f-66c8706f8614\") " pod="openshift-insights/insights-runtime-extractor-lgb2h" Jul 29 15:46:31.051118 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:31.050830 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-crio-socket\") pod \"insights-runtime-extractor-lgb2h\" (UID: \"7d2163b3-00f3-4ff6-8b0f-66c8706f8614\") " pod="openshift-insights/insights-runtime-extractor-lgb2h" Jul 29 15:46:31.051118 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:31.050845 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk7b7\" (UniqueName: \"kubernetes.io/projected/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-kube-api-access-vk7b7\") pod \"insights-runtime-extractor-lgb2h\" (UID: \"7d2163b3-00f3-4ff6-8b0f-66c8706f8614\") " pod="openshift-insights/insights-runtime-extractor-lgb2h" Jul 29 15:46:31.151842 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:31.151813 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lgb2h\" (UID: \"7d2163b3-00f3-4ff6-8b0f-66c8706f8614\") " pod="openshift-insights/insights-runtime-extractor-lgb2h" Jul 29 15:46:31.152005 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:31.151978 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:46:31.152044 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:31.152016 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lgb2h\" (UID: \"7d2163b3-00f3-4ff6-8b0f-66c8706f8614\") " pod="openshift-insights/insights-runtime-extractor-lgb2h" Jul 29 15:46:31.152044 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:31.152038 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-insights-runtime-extractor-tls podName:7d2163b3-00f3-4ff6-8b0f-66c8706f8614 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:31.652021165 +0000 UTC m=+41.335104437 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lgb2h" (UID: "7d2163b3-00f3-4ff6-8b0f-66c8706f8614") : secret "insights-runtime-extractor-tls" not found Jul 29 15:46:31.152159 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:31.152085 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:46:31.152159 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:31.152084 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-crio-socket\") pod \"insights-runtime-extractor-lgb2h\" (UID: \"7d2163b3-00f3-4ff6-8b0f-66c8706f8614\") " pod="openshift-insights/insights-runtime-extractor-lgb2h" Jul 29 15:46:31.152159 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:31.152156 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-kube-rbac-proxy-cm podName:7d2163b3-00f3-4ff6-8b0f-66c8706f8614 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:31.652139243 +0000 UTC m=+41.335222518 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lgb2h" (UID: "7d2163b3-00f3-4ff6-8b0f-66c8706f8614") : configmap "kube-rbac-proxy" not found Jul 29 15:46:31.152300 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:31.152172 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk7b7\" (UniqueName: \"kubernetes.io/projected/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-kube-api-access-vk7b7\") pod \"insights-runtime-extractor-lgb2h\" (UID: \"7d2163b3-00f3-4ff6-8b0f-66c8706f8614\") " pod="openshift-insights/insights-runtime-extractor-lgb2h" Jul 29 15:46:31.152300 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:31.152178 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-crio-socket\") pod \"insights-runtime-extractor-lgb2h\" (UID: \"7d2163b3-00f3-4ff6-8b0f-66c8706f8614\") " pod="openshift-insights/insights-runtime-extractor-lgb2h" Jul 29 15:46:31.152300 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:31.152287 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-data-volume\") pod \"insights-runtime-extractor-lgb2h\" (UID: \"7d2163b3-00f3-4ff6-8b0f-66c8706f8614\") " pod="openshift-insights/insights-runtime-extractor-lgb2h" Jul 29 15:46:31.152645 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:31.152629 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-data-volume\") pod \"insights-runtime-extractor-lgb2h\" (UID: \"7d2163b3-00f3-4ff6-8b0f-66c8706f8614\") " pod="openshift-insights/insights-runtime-extractor-lgb2h" Jul 29 15:46:31.166307 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:31.166241 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk7b7\" (UniqueName: \"kubernetes.io/projected/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-kube-api-access-vk7b7\") pod \"insights-runtime-extractor-lgb2h\" (UID: \"7d2163b3-00f3-4ff6-8b0f-66c8706f8614\") " pod="openshift-insights/insights-runtime-extractor-lgb2h" Jul 29 15:46:31.630945 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:31.630854 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-njm82"] Jul 29 15:46:31.649748 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:31.649713 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-njm82"] Jul 29 15:46:31.649877 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:31.649826 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-njm82" Jul 29 15:46:31.653800 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:31.653774 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 29 15:46:31.653800 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:31.653792 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-8slgf\"" Jul 29 15:46:31.654028 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:31.653772 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 29 15:46:31.654531 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:31.654510 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lgb2h\" (UID: \"7d2163b3-00f3-4ff6-8b0f-66c8706f8614\") " pod="openshift-insights/insights-runtime-extractor-lgb2h" Jul 29 15:46:31.654646 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:31.654565 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lgb2h\" (UID: \"7d2163b3-00f3-4ff6-8b0f-66c8706f8614\") " pod="openshift-insights/insights-runtime-extractor-lgb2h" Jul 29 15:46:31.654646 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:31.654619 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:46:31.654751 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:31.654655 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:46:31.654751 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:31.654662 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-kube-rbac-proxy-cm podName:7d2163b3-00f3-4ff6-8b0f-66c8706f8614 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:32.654650122 +0000 UTC m=+42.337733394 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lgb2h" (UID: "7d2163b3-00f3-4ff6-8b0f-66c8706f8614") : configmap "kube-rbac-proxy" not found Jul 29 15:46:31.654751 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:31.654724 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-insights-runtime-extractor-tls podName:7d2163b3-00f3-4ff6-8b0f-66c8706f8614 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:32.65470567 +0000 UTC m=+42.337788949 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lgb2h" (UID: "7d2163b3-00f3-4ff6-8b0f-66c8706f8614") : secret "insights-runtime-extractor-tls" not found Jul 29 15:46:31.755430 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:31.755388 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpkk8\" (UniqueName: \"kubernetes.io/projected/5c955d50-e915-4254-8574-c95022df6c85-kube-api-access-hpkk8\") pod \"migrator-6865c9967-njm82\" (UID: \"5c955d50-e915-4254-8574-c95022df6c85\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-njm82" Jul 29 15:46:31.856139 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:31.856096 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpkk8\" (UniqueName: \"kubernetes.io/projected/5c955d50-e915-4254-8574-c95022df6c85-kube-api-access-hpkk8\") pod \"migrator-6865c9967-njm82\" (UID: \"5c955d50-e915-4254-8574-c95022df6c85\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-njm82" Jul 29 15:46:31.864285 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:31.864260 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpkk8\" (UniqueName: \"kubernetes.io/projected/5c955d50-e915-4254-8574-c95022df6c85-kube-api-access-hpkk8\") pod \"migrator-6865c9967-njm82\" (UID: \"5c955d50-e915-4254-8574-c95022df6c85\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-njm82" Jul 29 15:46:31.961389 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:31.961356 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-njm82" Jul 29 15:46:32.097194 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:32.097155 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-njm82"] Jul 29 15:46:32.100248 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:46:32.100222 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c955d50_e915_4254_8574_c95022df6c85.slice/crio-369680cac08a71dc9ada3ffdfb5fabec2c340dffd087eaefd9947c9004653a0b WatchSource:0}: Error finding container 369680cac08a71dc9ada3ffdfb5fabec2c340dffd087eaefd9947c9004653a0b: Status 404 returned error can't find the container with id 369680cac08a71dc9ada3ffdfb5fabec2c340dffd087eaefd9947c9004653a0b Jul 29 15:46:32.662865 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:32.662824 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lgb2h\" (UID: \"7d2163b3-00f3-4ff6-8b0f-66c8706f8614\") " pod="openshift-insights/insights-runtime-extractor-lgb2h" Jul 29 15:46:32.663058 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:32.662889 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lgb2h\" (UID: \"7d2163b3-00f3-4ff6-8b0f-66c8706f8614\") " pod="openshift-insights/insights-runtime-extractor-lgb2h" Jul 29 15:46:32.663058 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:32.662996 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:46:32.663058 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:32.662998 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:46:32.663058 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:32.663050 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-kube-rbac-proxy-cm podName:7d2163b3-00f3-4ff6-8b0f-66c8706f8614 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:34.663036111 +0000 UTC m=+44.346119383 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lgb2h" (UID: "7d2163b3-00f3-4ff6-8b0f-66c8706f8614") : configmap "kube-rbac-proxy" not found Jul 29 15:46:32.663195 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:32.663063 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-insights-runtime-extractor-tls podName:7d2163b3-00f3-4ff6-8b0f-66c8706f8614 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:34.66305681 +0000 UTC m=+44.346140081 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lgb2h" (UID: "7d2163b3-00f3-4ff6-8b0f-66c8706f8614") : secret "insights-runtime-extractor-tls" not found Jul 29 15:46:32.966405 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:32.966361 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b-metrics-tls\") pod \"dns-default-8lkvv\" (UID: \"9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b\") " pod="openshift-dns/dns-default-8lkvv" Jul 29 15:46:32.966592 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:32.966516 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:46:32.966592 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:32.966583 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b-metrics-tls podName:9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b nodeName:}" failed. No retries permitted until 2026-07-29 15:46:40.966567836 +0000 UTC m=+50.649651107 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b-metrics-tls") pod "dns-default-8lkvv" (UID: "9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b") : secret "dns-default-metrics-tls" not found Jul 29 15:46:33.055236 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:33.055194 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-njm82" event={"ID":"5c955d50-e915-4254-8574-c95022df6c85","Type":"ContainerStarted","Data":"369680cac08a71dc9ada3ffdfb5fabec2c340dffd087eaefd9947c9004653a0b"} Jul 29 15:46:33.062373 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:33.062344 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f9hnm_4dcf8deb-1079-4f6f-9ae9-e0d84870c960/dns-node-resolver/0.log" Jul 29 15:46:33.529865 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:33.529815 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-w7ksq"] Jul 29 15:46:33.547432 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:33.547407 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-w7ksq"] Jul 29 15:46:33.547650 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:33.547497 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-w7ksq" Jul 29 15:46:33.549498 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:33.549479 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 29 15:46:33.549928 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:33.549915 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-kwdcc\"" Jul 29 15:46:33.550067 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:33.550044 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 29 15:46:33.550141 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:33.550050 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 29 15:46:33.550329 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:33.550313 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 29 15:46:33.672546 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:33.672512 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fe6199f1-e1e1-4d2d-90c3-4caceb8b665d-signing-cabundle\") pod \"service-ca-658d7b7c78-w7ksq\" (UID: \"fe6199f1-e1e1-4d2d-90c3-4caceb8b665d\") " pod="openshift-service-ca/service-ca-658d7b7c78-w7ksq" Jul 29 15:46:33.672546 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:33.672551 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqp7v\" (UniqueName: \"kubernetes.io/projected/fe6199f1-e1e1-4d2d-90c3-4caceb8b665d-kube-api-access-nqp7v\") pod \"service-ca-658d7b7c78-w7ksq\" (UID: \"fe6199f1-e1e1-4d2d-90c3-4caceb8b665d\") " pod="openshift-service-ca/service-ca-658d7b7c78-w7ksq" Jul 29 15:46:33.672754 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:33.672723 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fe6199f1-e1e1-4d2d-90c3-4caceb8b665d-signing-key\") pod \"service-ca-658d7b7c78-w7ksq\" (UID: \"fe6199f1-e1e1-4d2d-90c3-4caceb8b665d\") " pod="openshift-service-ca/service-ca-658d7b7c78-w7ksq" Jul 29 15:46:33.773514 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:33.773475 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fe6199f1-e1e1-4d2d-90c3-4caceb8b665d-signing-key\") pod \"service-ca-658d7b7c78-w7ksq\" (UID: \"fe6199f1-e1e1-4d2d-90c3-4caceb8b665d\") " pod="openshift-service-ca/service-ca-658d7b7c78-w7ksq" Jul 29 15:46:33.773514 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:33.773520 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fe6199f1-e1e1-4d2d-90c3-4caceb8b665d-signing-cabundle\") pod \"service-ca-658d7b7c78-w7ksq\" (UID: \"fe6199f1-e1e1-4d2d-90c3-4caceb8b665d\") " pod="openshift-service-ca/service-ca-658d7b7c78-w7ksq" Jul 29 15:46:33.773687 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:33.773535 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqp7v\" (UniqueName: \"kubernetes.io/projected/fe6199f1-e1e1-4d2d-90c3-4caceb8b665d-kube-api-access-nqp7v\") pod \"service-ca-658d7b7c78-w7ksq\" (UID: \"fe6199f1-e1e1-4d2d-90c3-4caceb8b665d\") " pod="openshift-service-ca/service-ca-658d7b7c78-w7ksq" Jul 29 15:46:33.774096 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:33.774077 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fe6199f1-e1e1-4d2d-90c3-4caceb8b665d-signing-cabundle\") pod \"service-ca-658d7b7c78-w7ksq\" (UID: \"fe6199f1-e1e1-4d2d-90c3-4caceb8b665d\") " pod="openshift-service-ca/service-ca-658d7b7c78-w7ksq" Jul 29 15:46:33.776040 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:33.776021 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fe6199f1-e1e1-4d2d-90c3-4caceb8b665d-signing-key\") pod \"service-ca-658d7b7c78-w7ksq\" (UID: \"fe6199f1-e1e1-4d2d-90c3-4caceb8b665d\") " pod="openshift-service-ca/service-ca-658d7b7c78-w7ksq" Jul 29 15:46:33.781619 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:33.781565 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqp7v\" (UniqueName: \"kubernetes.io/projected/fe6199f1-e1e1-4d2d-90c3-4caceb8b665d-kube-api-access-nqp7v\") pod \"service-ca-658d7b7c78-w7ksq\" (UID: \"fe6199f1-e1e1-4d2d-90c3-4caceb8b665d\") " pod="openshift-service-ca/service-ca-658d7b7c78-w7ksq" Jul 29 15:46:33.855605 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:33.855569 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-w7ksq" Jul 29 15:46:33.871594 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:33.871560 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-crwhp_70b633f9-e025-4576-a729-be5ebb65658e/node-ca/0.log" Jul 29 15:46:33.995947 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:33.995868 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-w7ksq"] Jul 29 15:46:33.999101 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:46:33.999060 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe6199f1_e1e1_4d2d_90c3_4caceb8b665d.slice/crio-dfbdcdfac7d88b297eab14caecdbafb5127f45c2a7852f91639d2edb256c662b WatchSource:0}: Error finding container dfbdcdfac7d88b297eab14caecdbafb5127f45c2a7852f91639d2edb256c662b: Status 404 returned error can't find the container with id dfbdcdfac7d88b297eab14caecdbafb5127f45c2a7852f91639d2edb256c662b Jul 29 15:46:34.058748 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:34.058711 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-njm82" event={"ID":"5c955d50-e915-4254-8574-c95022df6c85","Type":"ContainerStarted","Data":"bdfc4123b5134cbe273daf80f0ceee3828e7e7373fc9f1a7ba05ed29fe32c95e"} Jul 29 15:46:34.059752 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:34.059722 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-w7ksq" event={"ID":"fe6199f1-e1e1-4d2d-90c3-4caceb8b665d","Type":"ContainerStarted","Data":"dfbdcdfac7d88b297eab14caecdbafb5127f45c2a7852f91639d2edb256c662b"} Jul 29 15:46:34.463126 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:34.463101 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6tw4d_c2010b07-9481-44e2-83d2-041556d8c913/serve-healthcheck-canary/0.log" Jul 29 15:46:34.679826 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:34.679793 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lgb2h\" (UID: \"7d2163b3-00f3-4ff6-8b0f-66c8706f8614\") " pod="openshift-insights/insights-runtime-extractor-lgb2h" Jul 29 15:46:34.680260 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:34.679867 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lgb2h\" (UID: \"7d2163b3-00f3-4ff6-8b0f-66c8706f8614\") " pod="openshift-insights/insights-runtime-extractor-lgb2h" Jul 29 15:46:34.680260 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:34.680006 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:46:34.680260 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:34.680080 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-kube-rbac-proxy-cm podName:7d2163b3-00f3-4ff6-8b0f-66c8706f8614 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:38.680064575 +0000 UTC m=+48.363147847 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lgb2h" (UID: "7d2163b3-00f3-4ff6-8b0f-66c8706f8614") : configmap "kube-rbac-proxy" not found Jul 29 15:46:34.680260 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:34.680016 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:46:34.680260 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:34.680174 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-insights-runtime-extractor-tls podName:7d2163b3-00f3-4ff6-8b0f-66c8706f8614 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:38.680155307 +0000 UTC m=+48.363238581 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lgb2h" (UID: "7d2163b3-00f3-4ff6-8b0f-66c8706f8614") : secret "insights-runtime-extractor-tls" not found Jul 29 15:46:35.065013 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:35.064973 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-njm82" event={"ID":"5c955d50-e915-4254-8574-c95022df6c85","Type":"ContainerStarted","Data":"4af15480e9aff45aae2c12e348d1628d018ade2b5ac85e7cc941f9f0e880ea8e"} Jul 29 15:46:35.084476 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:35.083890 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-njm82" podStartSLOduration=2.314715381 podStartE2EDuration="4.083871659s" totalImagesPullingTime="1.769156278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:46:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:46:35.083248933 +0000 UTC m=+44.766332228" watchObservedRunningTime="2026-07-29 15:46:35.083871659 +0000 UTC m=+44.766954953" Jul 29 15:46:37.071776 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:37.071734 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-w7ksq" event={"ID":"fe6199f1-e1e1-4d2d-90c3-4caceb8b665d","Type":"ContainerStarted","Data":"b64e6c124f83e74ea9f7099e117180fccf4ecf890370c2b6869d1abf973ce5c5"} Jul 29 15:46:37.088642 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:37.088594 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-w7ksq" podStartSLOduration=1.5399330770000002 podStartE2EDuration="4.088578238s" totalImagesPullingTime="2.548645161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:46:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:46:37.087389787 +0000 UTC m=+46.770473092" watchObservedRunningTime="2026-07-29 15:46:37.088578238 +0000 UTC m=+46.771661532" Jul 29 15:46:38.712951 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:38.712888 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lgb2h\" (UID: \"7d2163b3-00f3-4ff6-8b0f-66c8706f8614\") " pod="openshift-insights/insights-runtime-extractor-lgb2h" Jul 29 15:46:38.713377 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:38.713007 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:46:38.713377 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:38.713007 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lgb2h\" (UID: \"7d2163b3-00f3-4ff6-8b0f-66c8706f8614\") " pod="openshift-insights/insights-runtime-extractor-lgb2h" Jul 29 15:46:38.713377 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:38.713072 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-kube-rbac-proxy-cm podName:7d2163b3-00f3-4ff6-8b0f-66c8706f8614 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:46.713054831 +0000 UTC m=+56.396138103 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lgb2h" (UID: "7d2163b3-00f3-4ff6-8b0f-66c8706f8614") : configmap "kube-rbac-proxy" not found Jul 29 15:46:38.713377 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:38.713094 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:46:38.713377 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:38.713166 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-insights-runtime-extractor-tls podName:7d2163b3-00f3-4ff6-8b0f-66c8706f8614 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:46.713145417 +0000 UTC m=+56.396228689 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lgb2h" (UID: "7d2163b3-00f3-4ff6-8b0f-66c8706f8614") : secret "insights-runtime-extractor-tls" not found Jul 29 15:46:41.030860 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:41.030822 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b-metrics-tls\") pod \"dns-default-8lkvv\" (UID: \"9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b\") " pod="openshift-dns/dns-default-8lkvv" Jul 29 15:46:41.031269 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:41.030949 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:46:41.031269 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:41.031014 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b-metrics-tls podName:9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b nodeName:}" failed. No retries permitted until 2026-07-29 15:46:57.031000642 +0000 UTC m=+66.714083914 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b-metrics-tls") pod "dns-default-8lkvv" (UID: "9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b") : secret "dns-default-metrics-tls" not found Jul 29 15:46:46.777918 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:46.777876 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lgb2h\" (UID: \"7d2163b3-00f3-4ff6-8b0f-66c8706f8614\") " pod="openshift-insights/insights-runtime-extractor-lgb2h" Jul 29 15:46:46.778500 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:46.777992 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lgb2h\" (UID: \"7d2163b3-00f3-4ff6-8b0f-66c8706f8614\") " pod="openshift-insights/insights-runtime-extractor-lgb2h" Jul 29 15:46:46.778500 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:46.778089 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:46:46.778500 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:46:46.778159 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-insights-runtime-extractor-tls podName:7d2163b3-00f3-4ff6-8b0f-66c8706f8614 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:02.77814456 +0000 UTC m=+72.461227831 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lgb2h" (UID: "7d2163b3-00f3-4ff6-8b0f-66c8706f8614") : secret "insights-runtime-extractor-tls" not found Jul 29 15:46:46.778500 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:46.778455 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lgb2h\" (UID: \"7d2163b3-00f3-4ff6-8b0f-66c8706f8614\") " pod="openshift-insights/insights-runtime-extractor-lgb2h" Jul 29 15:46:51.016240 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:51.016213 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g7svn" Jul 29 15:46:53.657810 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.657774 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6747dd66f4-qz9fg"] Jul 29 15:46:53.660928 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.660909 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6747dd66f4-qz9fg" Jul 29 15:46:53.664538 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.664519 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 29 15:46:53.664678 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.664660 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-6m6k5\"" Jul 29 15:46:53.664749 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.664734 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 29 15:46:53.667507 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.667484 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 29 15:46:53.667608 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.667528 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 29 15:46:53.686140 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.686116 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6747dd66f4-qz9fg"] Jul 29 15:46:53.730012 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.729975 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkmpr\" (UniqueName: \"kubernetes.io/projected/55e5e0df-2f29-4bb7-b2f5-e0b92fba710a-kube-api-access-pkmpr\") pod \"managed-serviceaccount-addon-agent-6747dd66f4-qz9fg\" (UID: \"55e5e0df-2f29-4bb7-b2f5-e0b92fba710a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6747dd66f4-qz9fg" Jul 29 15:46:53.730177 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.730026 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/55e5e0df-2f29-4bb7-b2f5-e0b92fba710a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6747dd66f4-qz9fg\" (UID: \"55e5e0df-2f29-4bb7-b2f5-e0b92fba710a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6747dd66f4-qz9fg" Jul 29 15:46:53.796694 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.794442 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7cc4c4f75c-jp5jj"] Jul 29 15:46:53.797421 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.797404 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" Jul 29 15:46:53.800454 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.800433 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q86fs\"" Jul 29 15:46:53.800665 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.800652 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 29 15:46:53.800966 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.800925 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 29 15:46:53.801077 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.800989 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 29 15:46:53.807815 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.807797 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 29 15:46:53.811776 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.811758 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cc4c4f75c-jp5jj"] Jul 29 15:46:53.831349 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.831326 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b12eb6e7-0ceb-4ccd-a52e-52d944d53551-image-registry-private-configuration\") pod \"image-registry-7cc4c4f75c-jp5jj\" (UID: \"b12eb6e7-0ceb-4ccd-a52e-52d944d53551\") " pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" Jul 29 15:46:53.831491 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.831368 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b12eb6e7-0ceb-4ccd-a52e-52d944d53551-registry-certificates\") pod \"image-registry-7cc4c4f75c-jp5jj\" (UID: \"b12eb6e7-0ceb-4ccd-a52e-52d944d53551\") " pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" Jul 29 15:46:53.831491 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.831454 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b12eb6e7-0ceb-4ccd-a52e-52d944d53551-registry-tls\") pod \"image-registry-7cc4c4f75c-jp5jj\" (UID: \"b12eb6e7-0ceb-4ccd-a52e-52d944d53551\") " pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" Jul 29 15:46:53.831599 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.831493 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxc6k\" (UniqueName: \"kubernetes.io/projected/b12eb6e7-0ceb-4ccd-a52e-52d944d53551-kube-api-access-vxc6k\") pod \"image-registry-7cc4c4f75c-jp5jj\" (UID: \"b12eb6e7-0ceb-4ccd-a52e-52d944d53551\") " pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" Jul 29 15:46:53.831599 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.831527 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b12eb6e7-0ceb-4ccd-a52e-52d944d53551-ca-trust-extracted\") pod \"image-registry-7cc4c4f75c-jp5jj\" (UID: \"b12eb6e7-0ceb-4ccd-a52e-52d944d53551\") " pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" Jul 29 15:46:53.831683 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.831606 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkmpr\" (UniqueName: \"kubernetes.io/projected/55e5e0df-2f29-4bb7-b2f5-e0b92fba710a-kube-api-access-pkmpr\") pod \"managed-serviceaccount-addon-agent-6747dd66f4-qz9fg\" (UID: \"55e5e0df-2f29-4bb7-b2f5-e0b92fba710a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6747dd66f4-qz9fg" Jul 29 15:46:53.831683 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.831622 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b12eb6e7-0ceb-4ccd-a52e-52d944d53551-trusted-ca\") pod \"image-registry-7cc4c4f75c-jp5jj\" (UID: \"b12eb6e7-0ceb-4ccd-a52e-52d944d53551\") " pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" Jul 29 15:46:53.831683 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.831659 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b12eb6e7-0ceb-4ccd-a52e-52d944d53551-bound-sa-token\") pod \"image-registry-7cc4c4f75c-jp5jj\" (UID: \"b12eb6e7-0ceb-4ccd-a52e-52d944d53551\") " pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" Jul 29 15:46:53.831683 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.831677 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/55e5e0df-2f29-4bb7-b2f5-e0b92fba710a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6747dd66f4-qz9fg\" (UID: \"55e5e0df-2f29-4bb7-b2f5-e0b92fba710a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6747dd66f4-qz9fg" Jul 29 15:46:53.831855 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.831692 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b12eb6e7-0ceb-4ccd-a52e-52d944d53551-installation-pull-secrets\") pod \"image-registry-7cc4c4f75c-jp5jj\" (UID: \"b12eb6e7-0ceb-4ccd-a52e-52d944d53551\") " pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" Jul 29 15:46:53.834233 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.834212 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/55e5e0df-2f29-4bb7-b2f5-e0b92fba710a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6747dd66f4-qz9fg\" (UID: \"55e5e0df-2f29-4bb7-b2f5-e0b92fba710a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6747dd66f4-qz9fg" Jul 29 15:46:53.843726 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.843704 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkmpr\" (UniqueName: \"kubernetes.io/projected/55e5e0df-2f29-4bb7-b2f5-e0b92fba710a-kube-api-access-pkmpr\") pod \"managed-serviceaccount-addon-agent-6747dd66f4-qz9fg\" (UID: \"55e5e0df-2f29-4bb7-b2f5-e0b92fba710a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6747dd66f4-qz9fg" Jul 29 15:46:53.933054 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.932957 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b12eb6e7-0ceb-4ccd-a52e-52d944d53551-ca-trust-extracted\") pod \"image-registry-7cc4c4f75c-jp5jj\" (UID: \"b12eb6e7-0ceb-4ccd-a52e-52d944d53551\") " pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" Jul 29 15:46:53.933054 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.933020 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b12eb6e7-0ceb-4ccd-a52e-52d944d53551-trusted-ca\") pod \"image-registry-7cc4c4f75c-jp5jj\" (UID: \"b12eb6e7-0ceb-4ccd-a52e-52d944d53551\") " pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" Jul 29 15:46:53.933266 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.933191 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b12eb6e7-0ceb-4ccd-a52e-52d944d53551-bound-sa-token\") pod \"image-registry-7cc4c4f75c-jp5jj\" (UID: \"b12eb6e7-0ceb-4ccd-a52e-52d944d53551\") " pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" Jul 29 15:46:53.933266 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.933231 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b12eb6e7-0ceb-4ccd-a52e-52d944d53551-installation-pull-secrets\") pod \"image-registry-7cc4c4f75c-jp5jj\" (UID: \"b12eb6e7-0ceb-4ccd-a52e-52d944d53551\") " pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" Jul 29 15:46:53.933266 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.933257 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b12eb6e7-0ceb-4ccd-a52e-52d944d53551-image-registry-private-configuration\") pod \"image-registry-7cc4c4f75c-jp5jj\" (UID: \"b12eb6e7-0ceb-4ccd-a52e-52d944d53551\") " pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" Jul 29 15:46:53.933428 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.933300 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b12eb6e7-0ceb-4ccd-a52e-52d944d53551-registry-certificates\") pod \"image-registry-7cc4c4f75c-jp5jj\" (UID: \"b12eb6e7-0ceb-4ccd-a52e-52d944d53551\") " pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" Jul 29 15:46:53.933428 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.933349 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b12eb6e7-0ceb-4ccd-a52e-52d944d53551-registry-tls\") pod \"image-registry-7cc4c4f75c-jp5jj\" (UID: \"b12eb6e7-0ceb-4ccd-a52e-52d944d53551\") " pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" Jul 29 15:46:53.933428 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.933375 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxc6k\" (UniqueName: \"kubernetes.io/projected/b12eb6e7-0ceb-4ccd-a52e-52d944d53551-kube-api-access-vxc6k\") pod \"image-registry-7cc4c4f75c-jp5jj\" (UID: \"b12eb6e7-0ceb-4ccd-a52e-52d944d53551\") " pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" Jul 29 15:46:53.933428 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.933412 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b12eb6e7-0ceb-4ccd-a52e-52d944d53551-ca-trust-extracted\") pod \"image-registry-7cc4c4f75c-jp5jj\" (UID: \"b12eb6e7-0ceb-4ccd-a52e-52d944d53551\") " pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" Jul 29 15:46:53.934165 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.934143 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b12eb6e7-0ceb-4ccd-a52e-52d944d53551-registry-certificates\") pod \"image-registry-7cc4c4f75c-jp5jj\" (UID: \"b12eb6e7-0ceb-4ccd-a52e-52d944d53551\") " pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" Jul 29 15:46:53.934351 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.934333 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b12eb6e7-0ceb-4ccd-a52e-52d944d53551-trusted-ca\") pod \"image-registry-7cc4c4f75c-jp5jj\" (UID: \"b12eb6e7-0ceb-4ccd-a52e-52d944d53551\") " pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" Jul 29 15:46:53.935825 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.935806 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b12eb6e7-0ceb-4ccd-a52e-52d944d53551-installation-pull-secrets\") pod \"image-registry-7cc4c4f75c-jp5jj\" (UID: \"b12eb6e7-0ceb-4ccd-a52e-52d944d53551\") " pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" Jul 29 15:46:53.936325 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.936308 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b12eb6e7-0ceb-4ccd-a52e-52d944d53551-image-registry-private-configuration\") pod \"image-registry-7cc4c4f75c-jp5jj\" (UID: \"b12eb6e7-0ceb-4ccd-a52e-52d944d53551\") " pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" Jul 29 15:46:53.936434 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.936417 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b12eb6e7-0ceb-4ccd-a52e-52d944d53551-registry-tls\") pod \"image-registry-7cc4c4f75c-jp5jj\" (UID: \"b12eb6e7-0ceb-4ccd-a52e-52d944d53551\") " pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" Jul 29 15:46:53.951253 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.951222 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxc6k\" (UniqueName: \"kubernetes.io/projected/b12eb6e7-0ceb-4ccd-a52e-52d944d53551-kube-api-access-vxc6k\") pod \"image-registry-7cc4c4f75c-jp5jj\" (UID: \"b12eb6e7-0ceb-4ccd-a52e-52d944d53551\") " pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" Jul 29 15:46:53.952610 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.952588 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b12eb6e7-0ceb-4ccd-a52e-52d944d53551-bound-sa-token\") pod \"image-registry-7cc4c4f75c-jp5jj\" (UID: \"b12eb6e7-0ceb-4ccd-a52e-52d944d53551\") " pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" Jul 29 15:46:53.981482 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:53.981448 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6747dd66f4-qz9fg" Jul 29 15:46:54.106746 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:54.106717 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" Jul 29 15:46:54.110198 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:54.110171 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6747dd66f4-qz9fg"] Jul 29 15:46:54.114369 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:46:54.114341 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55e5e0df_2f29_4bb7_b2f5_e0b92fba710a.slice/crio-3ed0e8dca98ae22dd891557cab23e26c1a99045e2922cfafbd032ffb9ce1756a WatchSource:0}: Error finding container 3ed0e8dca98ae22dd891557cab23e26c1a99045e2922cfafbd032ffb9ce1756a: Status 404 returned error can't find the container with id 3ed0e8dca98ae22dd891557cab23e26c1a99045e2922cfafbd032ffb9ce1756a Jul 29 15:46:54.240966 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:54.240918 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cc4c4f75c-jp5jj"] Jul 29 15:46:54.244003 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:46:54.243977 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb12eb6e7_0ceb_4ccd_a52e_52d944d53551.slice/crio-c03d2f863c9d086ddabae690852f92b951d774adbffb07b0a2ace50a52a606e3 WatchSource:0}: Error finding container c03d2f863c9d086ddabae690852f92b951d774adbffb07b0a2ace50a52a606e3: Status 404 returned error can't find the container with id c03d2f863c9d086ddabae690852f92b951d774adbffb07b0a2ace50a52a606e3 Jul 29 15:46:55.118054 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:55.118017 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" event={"ID":"b12eb6e7-0ceb-4ccd-a52e-52d944d53551","Type":"ContainerStarted","Data":"e80e3321a2ad5f7a0b56195923b1d6a256ef2cc4f4125f487518c0917d164561"} Jul 29 15:46:55.118521 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:55.118078 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" event={"ID":"b12eb6e7-0ceb-4ccd-a52e-52d944d53551","Type":"ContainerStarted","Data":"c03d2f863c9d086ddabae690852f92b951d774adbffb07b0a2ace50a52a606e3"} Jul 29 15:46:55.118521 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:55.118120 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" Jul 29 15:46:55.119495 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:55.119470 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6747dd66f4-qz9fg" event={"ID":"55e5e0df-2f29-4bb7-b2f5-e0b92fba710a","Type":"ContainerStarted","Data":"3ed0e8dca98ae22dd891557cab23e26c1a99045e2922cfafbd032ffb9ce1756a"} Jul 29 15:46:55.139529 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:55.139464 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" podStartSLOduration=2.139448151 podStartE2EDuration="2.139448151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:46:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:46:55.138417738 +0000 UTC m=+64.821501033" watchObservedRunningTime="2026-07-29 15:46:55.139448151 +0000 UTC m=+64.822531445" Jul 29 15:46:56.457481 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:56.457433 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5d6572b-df40-46ac-80aa-e62fb0eae0a8-metrics-certs\") pod \"network-metrics-daemon-dj58l\" (UID: \"c5d6572b-df40-46ac-80aa-e62fb0eae0a8\") " pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:46:56.459515 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:56.459490 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 15:46:56.470909 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:56.470877 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5d6572b-df40-46ac-80aa-e62fb0eae0a8-metrics-certs\") pod \"network-metrics-daemon-dj58l\" (UID: \"c5d6572b-df40-46ac-80aa-e62fb0eae0a8\") " pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:46:56.558279 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:56.558236 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe75348c-40b9-462d-8e9e-644aed841fae-original-pull-secret\") pod \"global-pull-secret-syncer-26xnp\" (UID: \"fe75348c-40b9-462d-8e9e-644aed841fae\") " pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:46:56.558485 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:56.558381 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8gsh\" (UniqueName: \"kubernetes.io/projected/b7346e04-c640-4552-832b-a57e1b0d9998-kube-api-access-n8gsh\") pod \"network-check-target-94h8p\" (UID: \"b7346e04-c640-4552-832b-a57e1b0d9998\") " pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:46:56.560527 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:56.560494 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 15:46:56.560690 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:56.560495 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 15:46:56.571311 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:56.571286 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe75348c-40b9-462d-8e9e-644aed841fae-original-pull-secret\") pod \"global-pull-secret-syncer-26xnp\" (UID: \"fe75348c-40b9-462d-8e9e-644aed841fae\") " pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:46:56.573513 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:56.573498 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 15:46:56.582709 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:56.582681 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8gsh\" (UniqueName: \"kubernetes.io/projected/b7346e04-c640-4552-832b-a57e1b0d9998-kube-api-access-n8gsh\") pod \"network-check-target-94h8p\" (UID: \"b7346e04-c640-4552-832b-a57e1b0d9998\") " pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:46:56.744040 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:56.744017 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s67m5\"" Jul 29 15:46:56.749622 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:56.749605 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dcxh7\"" Jul 29 15:46:56.753103 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:56.753087 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:46:56.753226 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:56.753210 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26xnp" Jul 29 15:46:56.758277 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:56.758258 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dj58l" Jul 29 15:46:56.909534 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:56.909417 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-94h8p"] Jul 29 15:46:56.912903 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:46:56.912870 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7346e04_c640_4552_832b_a57e1b0d9998.slice/crio-8c5dbd7b5a066ea0cdb5ac08687bce721329c1f4fa064ea7af983ac7918eb6da WatchSource:0}: Error finding container 8c5dbd7b5a066ea0cdb5ac08687bce721329c1f4fa064ea7af983ac7918eb6da: Status 404 returned error can't find the container with id 8c5dbd7b5a066ea0cdb5ac08687bce721329c1f4fa064ea7af983ac7918eb6da Jul 29 15:46:56.955060 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:56.955033 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-26xnp"] Jul 29 15:46:56.958691 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:46:56.958663 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe75348c_40b9_462d_8e9e_644aed841fae.slice/crio-cf591ef1c0e6499274e8c6dfab1d3cb83b0459bc33671496e088e9554c61c8bb WatchSource:0}: Error finding container cf591ef1c0e6499274e8c6dfab1d3cb83b0459bc33671496e088e9554c61c8bb: Status 404 returned error can't find the container with id cf591ef1c0e6499274e8c6dfab1d3cb83b0459bc33671496e088e9554c61c8bb Jul 29 15:46:56.974457 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:56.974435 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dj58l"] Jul 29 15:46:56.978043 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:46:56.978019 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5d6572b_df40_46ac_80aa_e62fb0eae0a8.slice/crio-2f2b23f8b5581ea82ad5a0036c6f9bbe6545c2c9fa9e5803c6bbdf4b5c17be47 WatchSource:0}: Error finding container 2f2b23f8b5581ea82ad5a0036c6f9bbe6545c2c9fa9e5803c6bbdf4b5c17be47: Status 404 returned error can't find the container with id 2f2b23f8b5581ea82ad5a0036c6f9bbe6545c2c9fa9e5803c6bbdf4b5c17be47 Jul 29 15:46:57.061544 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:57.061444 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b-metrics-tls\") pod \"dns-default-8lkvv\" (UID: \"9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b\") " pod="openshift-dns/dns-default-8lkvv" Jul 29 15:46:57.063909 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:57.063886 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b-metrics-tls\") pod \"dns-default-8lkvv\" (UID: \"9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b\") " pod="openshift-dns/dns-default-8lkvv" Jul 29 15:46:57.127029 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:57.126992 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6747dd66f4-qz9fg" event={"ID":"55e5e0df-2f29-4bb7-b2f5-e0b92fba710a","Type":"ContainerStarted","Data":"0e3a1667e249019c41d197900049a3a15df9374732785fffcd8cfe4a45aad29e"} Jul 29 15:46:57.128157 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:57.128136 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dj58l" event={"ID":"c5d6572b-df40-46ac-80aa-e62fb0eae0a8","Type":"ContainerStarted","Data":"2f2b23f8b5581ea82ad5a0036c6f9bbe6545c2c9fa9e5803c6bbdf4b5c17be47"} Jul 29 15:46:57.129117 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:57.129094 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-26xnp" event={"ID":"fe75348c-40b9-462d-8e9e-644aed841fae","Type":"ContainerStarted","Data":"cf591ef1c0e6499274e8c6dfab1d3cb83b0459bc33671496e088e9554c61c8bb"} Jul 29 15:46:57.130024 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:57.130004 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-94h8p" event={"ID":"b7346e04-c640-4552-832b-a57e1b0d9998","Type":"ContainerStarted","Data":"8c5dbd7b5a066ea0cdb5ac08687bce721329c1f4fa064ea7af983ac7918eb6da"} Jul 29 15:46:57.143574 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:57.143533 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6747dd66f4-qz9fg" podStartSLOduration=1.5255747629999998 podStartE2EDuration="4.143517413s" totalImagesPullingTime="2.61794265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:46:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:46:57.142268192 +0000 UTC m=+66.825351485" watchObservedRunningTime="2026-07-29 15:46:57.143517413 +0000 UTC m=+66.826600707" Jul 29 15:46:57.323120 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:57.323039 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wwm9h\"" Jul 29 15:46:57.331755 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:57.331729 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8lkvv" Jul 29 15:46:57.492208 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:57.492179 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8lkvv"] Jul 29 15:46:57.496538 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:46:57.496506 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bfe7a82_6a4d_4bc7_9a05_b7b42ccf9c3b.slice/crio-bf3ea061f5d6c69fbc7a869feabedb87bf9066f187e743b4804323bc18e17cbd WatchSource:0}: Error finding container bf3ea061f5d6c69fbc7a869feabedb87bf9066f187e743b4804323bc18e17cbd: Status 404 returned error can't find the container with id bf3ea061f5d6c69fbc7a869feabedb87bf9066f187e743b4804323bc18e17cbd Jul 29 15:46:58.136524 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:58.136452 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8lkvv" event={"ID":"9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b","Type":"ContainerStarted","Data":"bf3ea061f5d6c69fbc7a869feabedb87bf9066f187e743b4804323bc18e17cbd"} Jul 29 15:46:59.143058 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:59.142952 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dj58l" event={"ID":"c5d6572b-df40-46ac-80aa-e62fb0eae0a8","Type":"ContainerStarted","Data":"5964fd93a82ee3d2449c53c3698c54925a188d572dfbd62e8646aa01a3471885"} Jul 29 15:46:59.143058 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:59.143019 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dj58l" event={"ID":"c5d6572b-df40-46ac-80aa-e62fb0eae0a8","Type":"ContainerStarted","Data":"473afab978ef35f7c0c8f583d2afa04f4178d82c1277500b07b919c88d000ac3"} Jul 29 15:46:59.159510 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:59.159452 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dj58l" podStartSLOduration=66.807777872 podStartE2EDuration="1m8.159430272s" totalImagesPullingTime="1.3516524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:45:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:46:59.158471359 +0000 UTC m=+68.841554666" watchObservedRunningTime="2026-07-29 15:46:59.159430272 +0000 UTC m=+68.842513567" Jul 29 15:46:59.668976 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:59.667976 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xjwqd"] Jul 29 15:46:59.671271 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:59.670682 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xjwqd" Jul 29 15:46:59.673074 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:59.673055 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 29 15:46:59.673182 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:59.673058 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xxcl5\"" Jul 29 15:46:59.683145 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:59.682821 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xjwqd"] Jul 29 15:46:59.787031 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:59.786827 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/449fc1ec-714f-47d3-9ca0-1b5491e6cc22-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-xjwqd\" (UID: \"449fc1ec-714f-47d3-9ca0-1b5491e6cc22\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xjwqd" Jul 29 15:46:59.887916 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:59.887875 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/449fc1ec-714f-47d3-9ca0-1b5491e6cc22-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-xjwqd\" (UID: \"449fc1ec-714f-47d3-9ca0-1b5491e6cc22\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xjwqd" Jul 29 15:46:59.890809 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:59.890780 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/449fc1ec-714f-47d3-9ca0-1b5491e6cc22-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-xjwqd\" (UID: \"449fc1ec-714f-47d3-9ca0-1b5491e6cc22\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xjwqd" Jul 29 15:46:59.980726 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:46:59.980689 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xjwqd" Jul 29 15:47:00.149658 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:00.149570 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8lkvv" event={"ID":"9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b","Type":"ContainerStarted","Data":"935ab1257ce3afab94507879acb6367289cd04f4935b09cf728c797fe731dd30"} Jul 29 15:47:02.151078 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:02.151052 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xjwqd"] Jul 29 15:47:02.154809 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:47:02.154779 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod449fc1ec_714f_47d3_9ca0_1b5491e6cc22.slice/crio-0df29654106d0f9798c782e20d4b70c6ef661108878a39e57f7addafa6b97d67 WatchSource:0}: Error finding container 0df29654106d0f9798c782e20d4b70c6ef661108878a39e57f7addafa6b97d67: Status 404 returned error can't find the container with id 0df29654106d0f9798c782e20d4b70c6ef661108878a39e57f7addafa6b97d67 Jul 29 15:47:02.158762 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:02.158725 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-26xnp" event={"ID":"fe75348c-40b9-462d-8e9e-644aed841fae","Type":"ContainerStarted","Data":"38331a7d29abb9a5b3ced619a1d81bc9b036693857fd7242b521eff0959f2572"} Jul 29 15:47:02.161240 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:02.161110 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8lkvv" event={"ID":"9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b","Type":"ContainerStarted","Data":"942a235fb08fc06449d23c29224bddaf4d58e9935ee82b983a9cffae25d3e25a"} Jul 29 15:47:02.161572 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:02.161387 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8lkvv" Jul 29 15:47:02.162901 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:02.162883 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-94h8p" event={"ID":"b7346e04-c640-4552-832b-a57e1b0d9998","Type":"ContainerStarted","Data":"feaa3f33ad50286c6b98979c0a83b29402b4d1b9d8c36d433b931e8e38368756"} Jul 29 15:47:02.163238 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:02.163224 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:47:02.172457 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:02.172331 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-26xnp" podStartSLOduration=66.112197416 podStartE2EDuration="1m11.172311315s" totalImagesPullingTime="5.060113899s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:45:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:02.171683412 +0000 UTC m=+71.854766721" watchObservedRunningTime="2026-07-29 15:47:02.172311315 +0000 UTC m=+71.855394610" Jul 29 15:47:02.189233 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:02.189170 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8lkvv" podStartSLOduration=35.156242899 podStartE2EDuration="37.189148544s" totalImagesPullingTime="2.032905645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:02.18790939 +0000 UTC m=+71.870992685" watchObservedRunningTime="2026-07-29 15:47:02.189148544 +0000 UTC m=+71.872231839" Jul 29 15:47:02.811504 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:02.811463 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lgb2h\" (UID: \"7d2163b3-00f3-4ff6-8b0f-66c8706f8614\") " pod="openshift-insights/insights-runtime-extractor-lgb2h" Jul 29 15:47:02.813812 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:02.813793 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d2163b3-00f3-4ff6-8b0f-66c8706f8614-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lgb2h\" (UID: \"7d2163b3-00f3-4ff6-8b0f-66c8706f8614\") " pod="openshift-insights/insights-runtime-extractor-lgb2h" Jul 29 15:47:03.051668 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:03.051636 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mbt76\"" Jul 29 15:47:03.060306 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:03.060285 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lgb2h" Jul 29 15:47:03.167830 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:03.167792 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xjwqd" event={"ID":"449fc1ec-714f-47d3-9ca0-1b5491e6cc22","Type":"ContainerStarted","Data":"0df29654106d0f9798c782e20d4b70c6ef661108878a39e57f7addafa6b97d67"} Jul 29 15:47:03.195454 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:03.195392 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-94h8p" podStartSLOduration=67.10135961 podStartE2EDuration="1m12.195371372s" totalImagesPullingTime="5.094011762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:45:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:02.211186624 +0000 UTC m=+71.894269919" watchObservedRunningTime="2026-07-29 15:47:03.195371372 +0000 UTC m=+72.878454667" Jul 29 15:47:03.196365 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:03.196344 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lgb2h"] Jul 29 15:47:03.199365 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:47:03.199339 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d2163b3_00f3_4ff6_8b0f_66c8706f8614.slice/crio-cdbf24ca2c0608fb60cc5aa7cc838bfa1203f05ab59d5f04c6950fd09f7823c7 WatchSource:0}: Error finding container cdbf24ca2c0608fb60cc5aa7cc838bfa1203f05ab59d5f04c6950fd09f7823c7: Status 404 returned error can't find the container with id cdbf24ca2c0608fb60cc5aa7cc838bfa1203f05ab59d5f04c6950fd09f7823c7 Jul 29 15:47:04.173689 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:04.173650 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lgb2h" event={"ID":"7d2163b3-00f3-4ff6-8b0f-66c8706f8614","Type":"ContainerStarted","Data":"cdbf24ca2c0608fb60cc5aa7cc838bfa1203f05ab59d5f04c6950fd09f7823c7"} Jul 29 15:47:04.175854 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:04.175821 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xjwqd" event={"ID":"449fc1ec-714f-47d3-9ca0-1b5491e6cc22","Type":"ContainerStarted","Data":"4ebd8513792c084ab1074f3534e7a4f4291d7516e9c68462adb4f241b3adae22"} Jul 29 15:47:04.176390 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:04.176370 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xjwqd" Jul 29 15:47:04.177785 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:04.177756 2567 patch_prober.go:28] interesting pod/prometheus-operator-admission-webhook-7f8d78f54b-xjwqd container/prometheus-operator-admission-webhook namespace/openshift-monitoring: Readiness probe status=failure output="Get \"https://10.134.0.13:8443/healthz\": dial tcp 10.134.0.13:8443: connect: connection refused" start-of-body= Jul 29 15:47:04.177893 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:04.177813 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xjwqd" podUID="449fc1ec-714f-47d3-9ca0-1b5491e6cc22" containerName="prometheus-operator-admission-webhook" probeResult="failure" output="Get \"https://10.134.0.13:8443/healthz\": dial tcp 10.134.0.13:8443: connect: connection refused" Jul 29 15:47:04.191622 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:04.191500 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xjwqd" podStartSLOduration=3.281728575 podStartE2EDuration="5.191481729s" totalImagesPullingTime="1.909753154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:46:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:04.190333175 +0000 UTC m=+73.873416491" watchObservedRunningTime="2026-07-29 15:47:04.191481729 +0000 UTC m=+73.874565022" Jul 29 15:47:05.183770 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:05.183739 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xjwqd" Jul 29 15:47:09.170540 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:09.170495 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8lkvv" Jul 29 15:47:09.203181 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:09.199678 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lgb2h" event={"ID":"7d2163b3-00f3-4ff6-8b0f-66c8706f8614","Type":"ContainerStarted","Data":"d866921b7eab1f27e73a7e24428d9adfb9d1bcb7c03898ef9b0aaa95834e66fc"} Jul 29 15:47:12.212542 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:12.212509 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lgb2h" event={"ID":"7d2163b3-00f3-4ff6-8b0f-66c8706f8614","Type":"ContainerStarted","Data":"565900904a44395b1e866ceca705eb527261143e902cc3cfbe60597ae96f080c"} Jul 29 15:47:14.098197 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.098154 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-zx86l"] Jul 29 15:47:14.105882 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.104728 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-q2j8t"] Jul 29 15:47:14.105882 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.104896 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zx86l" Jul 29 15:47:14.113209 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.111775 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q2j8t" Jul 29 15:47:14.113209 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.112315 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 29 15:47:14.114277 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.113584 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 29 15:47:14.114277 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.113764 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-zx86l"] Jul 29 15:47:14.114277 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.113811 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 29 15:47:14.114277 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.113890 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 29 15:47:14.114277 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.114067 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-2qh99\"" Jul 29 15:47:14.114277 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.114098 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 29 15:47:14.119302 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.115374 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 29 15:47:14.119302 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.115638 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 29 15:47:14.119302 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.115878 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9ms5w\"" Jul 29 15:47:14.119302 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.117062 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 29 15:47:14.119985 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.119687 2567 patch_prober.go:28] interesting pod/image-registry-7cc4c4f75c-jp5jj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 29 15:47:14.119985 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.119742 2567 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" podUID="b12eb6e7-0ceb-4ccd-a52e-52d944d53551" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 29 15:47:14.203027 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.202974 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01ec4c57-f450-43e8-a2af-d6175efa9f8d-sys\") pod \"node-exporter-q2j8t\" (UID: \"01ec4c57-f450-43e8-a2af-d6175efa9f8d\") " pod="openshift-monitoring/node-exporter-q2j8t" Jul 29 15:47:14.203027 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.203028 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-zx86l\" (UID: \"a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zx86l" Jul 29 15:47:14.203286 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.203057 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-zx86l\" (UID: \"a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zx86l" Jul 29 15:47:14.203286 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.203079 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/01ec4c57-f450-43e8-a2af-d6175efa9f8d-node-exporter-tls\") pod \"node-exporter-q2j8t\" (UID: \"01ec4c57-f450-43e8-a2af-d6175efa9f8d\") " pod="openshift-monitoring/node-exporter-q2j8t" Jul 29 15:47:14.203286 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.203128 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-zx86l\" (UID: \"a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zx86l" Jul 29 15:47:14.203286 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.203159 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/01ec4c57-f450-43e8-a2af-d6175efa9f8d-node-exporter-accelerators-collector-config\") pod \"node-exporter-q2j8t\" (UID: \"01ec4c57-f450-43e8-a2af-d6175efa9f8d\") " pod="openshift-monitoring/node-exporter-q2j8t" Jul 29 15:47:14.203286 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.203190 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01ec4c57-f450-43e8-a2af-d6175efa9f8d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q2j8t\" (UID: \"01ec4c57-f450-43e8-a2af-d6175efa9f8d\") " pod="openshift-monitoring/node-exporter-q2j8t" Jul 29 15:47:14.203286 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.203212 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqcnz\" (UniqueName: \"kubernetes.io/projected/a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12-kube-api-access-dqcnz\") pod \"openshift-state-metrics-b8f49f5c6-zx86l\" (UID: \"a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zx86l" Jul 29 15:47:14.203286 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.203229 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/01ec4c57-f450-43e8-a2af-d6175efa9f8d-node-exporter-wtmp\") pod \"node-exporter-q2j8t\" (UID: \"01ec4c57-f450-43e8-a2af-d6175efa9f8d\") " pod="openshift-monitoring/node-exporter-q2j8t" Jul 29 15:47:14.203286 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.203261 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/01ec4c57-f450-43e8-a2af-d6175efa9f8d-root\") pod \"node-exporter-q2j8t\" (UID: \"01ec4c57-f450-43e8-a2af-d6175efa9f8d\") " pod="openshift-monitoring/node-exporter-q2j8t" Jul 29 15:47:14.203286 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.203281 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/01ec4c57-f450-43e8-a2af-d6175efa9f8d-node-exporter-textfile\") pod \"node-exporter-q2j8t\" (UID: \"01ec4c57-f450-43e8-a2af-d6175efa9f8d\") " pod="openshift-monitoring/node-exporter-q2j8t" Jul 29 15:47:14.203735 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.203490 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01ec4c57-f450-43e8-a2af-d6175efa9f8d-metrics-client-ca\") pod \"node-exporter-q2j8t\" (UID: \"01ec4c57-f450-43e8-a2af-d6175efa9f8d\") " pod="openshift-monitoring/node-exporter-q2j8t" Jul 29 15:47:14.203735 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.203516 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5k2d\" (UniqueName: \"kubernetes.io/projected/01ec4c57-f450-43e8-a2af-d6175efa9f8d-kube-api-access-z5k2d\") pod \"node-exporter-q2j8t\" (UID: \"01ec4c57-f450-43e8-a2af-d6175efa9f8d\") " pod="openshift-monitoring/node-exporter-q2j8t" Jul 29 15:47:14.304102 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.304065 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/01ec4c57-f450-43e8-a2af-d6175efa9f8d-root\") pod \"node-exporter-q2j8t\" (UID: \"01ec4c57-f450-43e8-a2af-d6175efa9f8d\") " pod="openshift-monitoring/node-exporter-q2j8t" Jul 29 15:47:14.304102 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.304112 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/01ec4c57-f450-43e8-a2af-d6175efa9f8d-node-exporter-textfile\") pod \"node-exporter-q2j8t\" (UID: \"01ec4c57-f450-43e8-a2af-d6175efa9f8d\") " pod="openshift-monitoring/node-exporter-q2j8t" Jul 29 15:47:14.304348 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.304191 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/01ec4c57-f450-43e8-a2af-d6175efa9f8d-root\") pod \"node-exporter-q2j8t\" (UID: \"01ec4c57-f450-43e8-a2af-d6175efa9f8d\") " pod="openshift-monitoring/node-exporter-q2j8t" Jul 29 15:47:14.304348 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.304247 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01ec4c57-f450-43e8-a2af-d6175efa9f8d-metrics-client-ca\") pod \"node-exporter-q2j8t\" (UID: \"01ec4c57-f450-43e8-a2af-d6175efa9f8d\") " pod="openshift-monitoring/node-exporter-q2j8t" Jul 29 15:47:14.304348 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.304284 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5k2d\" (UniqueName: \"kubernetes.io/projected/01ec4c57-f450-43e8-a2af-d6175efa9f8d-kube-api-access-z5k2d\") pod \"node-exporter-q2j8t\" (UID: \"01ec4c57-f450-43e8-a2af-d6175efa9f8d\") " pod="openshift-monitoring/node-exporter-q2j8t" Jul 29 15:47:14.304348 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.304325 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01ec4c57-f450-43e8-a2af-d6175efa9f8d-sys\") pod \"node-exporter-q2j8t\" (UID: \"01ec4c57-f450-43e8-a2af-d6175efa9f8d\") " pod="openshift-monitoring/node-exporter-q2j8t" Jul 29 15:47:14.304555 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.304359 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/01ec4c57-f450-43e8-a2af-d6175efa9f8d-node-exporter-textfile\") pod \"node-exporter-q2j8t\" (UID: \"01ec4c57-f450-43e8-a2af-d6175efa9f8d\") " pod="openshift-monitoring/node-exporter-q2j8t" Jul 29 15:47:14.304555 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.304358 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-zx86l\" (UID: \"a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zx86l" Jul 29 15:47:14.304555 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.304410 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-zx86l\" (UID: \"a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zx86l" Jul 29 15:47:14.304555 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.304427 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/01ec4c57-f450-43e8-a2af-d6175efa9f8d-node-exporter-tls\") pod \"node-exporter-q2j8t\" (UID: \"01ec4c57-f450-43e8-a2af-d6175efa9f8d\") " pod="openshift-monitoring/node-exporter-q2j8t" Jul 29 15:47:14.304555 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.304460 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-zx86l\" (UID: \"a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zx86l" Jul 29 15:47:14.304555 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.304481 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/01ec4c57-f450-43e8-a2af-d6175efa9f8d-node-exporter-accelerators-collector-config\") pod \"node-exporter-q2j8t\" (UID: \"01ec4c57-f450-43e8-a2af-d6175efa9f8d\") " pod="openshift-monitoring/node-exporter-q2j8t" Jul 29 15:47:14.304555 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.304497 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01ec4c57-f450-43e8-a2af-d6175efa9f8d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q2j8t\" (UID: \"01ec4c57-f450-43e8-a2af-d6175efa9f8d\") " pod="openshift-monitoring/node-exporter-q2j8t" Jul 29 15:47:14.304555 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.304514 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqcnz\" (UniqueName: \"kubernetes.io/projected/a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12-kube-api-access-dqcnz\") pod \"openshift-state-metrics-b8f49f5c6-zx86l\" (UID: \"a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zx86l" Jul 29 15:47:14.304555 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.304530 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/01ec4c57-f450-43e8-a2af-d6175efa9f8d-node-exporter-wtmp\") pod \"node-exporter-q2j8t\" (UID: \"01ec4c57-f450-43e8-a2af-d6175efa9f8d\") " pod="openshift-monitoring/node-exporter-q2j8t" Jul 29 15:47:14.305032 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.304687 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/01ec4c57-f450-43e8-a2af-d6175efa9f8d-node-exporter-wtmp\") pod \"node-exporter-q2j8t\" (UID: \"01ec4c57-f450-43e8-a2af-d6175efa9f8d\") " pod="openshift-monitoring/node-exporter-q2j8t" Jul 29 15:47:14.305032 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:47:14.304789 2567 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 29 15:47:14.305032 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:47:14.304854 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12-openshift-state-metrics-tls podName:a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:14.804835064 +0000 UTC m=+84.487918340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-zx86l" (UID: "a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12") : secret "openshift-state-metrics-tls" not found Jul 29 15:47:14.305313 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:47:14.305294 2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 29 15:47:14.305402 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:47:14.305345 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01ec4c57-f450-43e8-a2af-d6175efa9f8d-node-exporter-tls podName:01ec4c57-f450-43e8-a2af-d6175efa9f8d nodeName:}" failed. No retries permitted until 2026-07-29 15:47:14.80533037 +0000 UTC m=+84.488413642 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/01ec4c57-f450-43e8-a2af-d6175efa9f8d-node-exporter-tls") pod "node-exporter-q2j8t" (UID: "01ec4c57-f450-43e8-a2af-d6175efa9f8d") : secret "node-exporter-tls" not found Jul 29 15:47:14.306320 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.305084 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-zx86l\" (UID: \"a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zx86l" Jul 29 15:47:14.306691 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.306668 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01ec4c57-f450-43e8-a2af-d6175efa9f8d-sys\") pod \"node-exporter-q2j8t\" (UID: \"01ec4c57-f450-43e8-a2af-d6175efa9f8d\") " pod="openshift-monitoring/node-exporter-q2j8t" Jul 29 15:47:14.314145 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.314095 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/01ec4c57-f450-43e8-a2af-d6175efa9f8d-node-exporter-accelerators-collector-config\") pod \"node-exporter-q2j8t\" (UID: \"01ec4c57-f450-43e8-a2af-d6175efa9f8d\") " pod="openshift-monitoring/node-exporter-q2j8t" Jul 29 15:47:14.314969 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.314903 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01ec4c57-f450-43e8-a2af-d6175efa9f8d-metrics-client-ca\") pod \"node-exporter-q2j8t\" (UID: \"01ec4c57-f450-43e8-a2af-d6175efa9f8d\") " pod="openshift-monitoring/node-exporter-q2j8t" Jul 29 15:47:14.316369 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.316325 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-zx86l\" (UID: \"a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zx86l" Jul 29 15:47:14.320903 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.320209 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01ec4c57-f450-43e8-a2af-d6175efa9f8d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q2j8t\" (UID: \"01ec4c57-f450-43e8-a2af-d6175efa9f8d\") " pod="openshift-monitoring/node-exporter-q2j8t" Jul 29 15:47:14.328646 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.325513 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqcnz\" (UniqueName: \"kubernetes.io/projected/a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12-kube-api-access-dqcnz\") pod \"openshift-state-metrics-b8f49f5c6-zx86l\" (UID: \"a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zx86l" Jul 29 15:47:14.336397 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.336347 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5k2d\" (UniqueName: \"kubernetes.io/projected/01ec4c57-f450-43e8-a2af-d6175efa9f8d-kube-api-access-z5k2d\") pod \"node-exporter-q2j8t\" (UID: \"01ec4c57-f450-43e8-a2af-d6175efa9f8d\") " pod="openshift-monitoring/node-exporter-q2j8t" Jul 29 15:47:14.809736 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.809687 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-zx86l\" (UID: \"a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zx86l" Jul 29 15:47:14.809736 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.809729 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/01ec4c57-f450-43e8-a2af-d6175efa9f8d-node-exporter-tls\") pod \"node-exporter-q2j8t\" (UID: \"01ec4c57-f450-43e8-a2af-d6175efa9f8d\") " pod="openshift-monitoring/node-exporter-q2j8t" Jul 29 15:47:14.812456 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.812432 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-zx86l\" (UID: \"a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zx86l" Jul 29 15:47:14.812736 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:14.812714 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/01ec4c57-f450-43e8-a2af-d6175efa9f8d-node-exporter-tls\") pod \"node-exporter-q2j8t\" (UID: \"01ec4c57-f450-43e8-a2af-d6175efa9f8d\") " pod="openshift-monitoring/node-exporter-q2j8t" Jul 29 15:47:15.027498 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.027460 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zx86l" Jul 29 15:47:15.034087 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.034004 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q2j8t" Jul 29 15:47:15.163476 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.163387 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 15:47:15.170902 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.170874 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.173226 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.173033 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 29 15:47:15.173226 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.173205 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 29 15:47:15.173412 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.173342 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vjclp\"" Jul 29 15:47:15.173463 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.173419 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 29 15:47:15.173511 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.173492 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 29 15:47:15.173864 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.173554 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 29 15:47:15.173864 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.173641 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 29 15:47:15.173864 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.173732 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 29 15:47:15.173864 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.173854 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 29 15:47:15.174147 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.173895 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 29 15:47:15.187922 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.187897 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 15:47:15.313839 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.313804 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/636a0c3c-df7e-4299-a14e-a5f9309cf558-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.313839 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.313844 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gpxn\" (UniqueName: \"kubernetes.io/projected/636a0c3c-df7e-4299-a14e-a5f9309cf558-kube-api-access-7gpxn\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.314109 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.313878 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-config-volume\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.314109 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.313959 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/636a0c3c-df7e-4299-a14e-a5f9309cf558-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.314109 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.313987 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/636a0c3c-df7e-4299-a14e-a5f9309cf558-config-out\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.314109 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.314020 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.314109 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.314054 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.314109 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.314076 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/636a0c3c-df7e-4299-a14e-a5f9309cf558-tls-assets\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.314109 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.314103 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-web-config\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.314436 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.314133 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.314436 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.314161 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.314436 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.314202 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.314436 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.314246 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/636a0c3c-df7e-4299-a14e-a5f9309cf558-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.414960 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.414846 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/636a0c3c-df7e-4299-a14e-a5f9309cf558-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.414960 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.414888 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/636a0c3c-df7e-4299-a14e-a5f9309cf558-config-out\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.414960 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.414916 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.414960 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.414960 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.415310 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.414998 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/636a0c3c-df7e-4299-a14e-a5f9309cf558-tls-assets\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.415310 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.415021 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-web-config\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.415310 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:47:15.415066 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/636a0c3c-df7e-4299-a14e-a5f9309cf558-alertmanager-trusted-ca-bundle podName:636a0c3c-df7e-4299-a14e-a5f9309cf558 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:15.915040163 +0000 UTC m=+85.598123452 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/636a0c3c-df7e-4299-a14e-a5f9309cf558-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "636a0c3c-df7e-4299-a14e-a5f9309cf558") : configmap references non-existent config key: ca-bundle.crt Jul 29 15:47:15.415310 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.415098 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.415310 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.415137 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.415310 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.415173 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.415310 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.415210 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/636a0c3c-df7e-4299-a14e-a5f9309cf558-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.415310 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.415242 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/636a0c3c-df7e-4299-a14e-a5f9309cf558-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.415310 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.415266 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gpxn\" (UniqueName: \"kubernetes.io/projected/636a0c3c-df7e-4299-a14e-a5f9309cf558-kube-api-access-7gpxn\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.415310 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.415302 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-config-volume\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.415910 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.415877 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/636a0c3c-df7e-4299-a14e-a5f9309cf558-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.417844 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.416607 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/636a0c3c-df7e-4299-a14e-a5f9309cf558-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.417844 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:47:15.417214 2567 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 29 15:47:15.417844 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:47:15.417277 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-secret-alertmanager-main-tls podName:636a0c3c-df7e-4299-a14e-a5f9309cf558 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:15.917260703 +0000 UTC m=+85.600343978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "636a0c3c-df7e-4299-a14e-a5f9309cf558") : secret "alertmanager-main-tls" not found Jul 29 15:47:15.420136 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.419664 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-web-config\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.420136 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.419989 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.421301 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.421274 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.421417 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.421390 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/636a0c3c-df7e-4299-a14e-a5f9309cf558-tls-assets\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.422433 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.422410 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.422636 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.422618 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/636a0c3c-df7e-4299-a14e-a5f9309cf558-config-out\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.424009 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.423966 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.424210 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.424176 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-config-volume\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.426746 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.426678 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gpxn\" (UniqueName: \"kubernetes.io/projected/636a0c3c-df7e-4299-a14e-a5f9309cf558-kube-api-access-7gpxn\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.769804 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:47:15.769767 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01ec4c57_f450_43e8_a2af_d6175efa9f8d.slice/crio-ba3c08b263d98ed5f88b291b87fcc6e23fb95d969eb9b9bf067194d2d58b72d0 WatchSource:0}: Error finding container ba3c08b263d98ed5f88b291b87fcc6e23fb95d969eb9b9bf067194d2d58b72d0: Status 404 returned error can't find the container with id ba3c08b263d98ed5f88b291b87fcc6e23fb95d969eb9b9bf067194d2d58b72d0 Jul 29 15:47:15.901154 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.901124 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-zx86l"] Jul 29 15:47:15.903841 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:47:15.903813 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8ba27b1_cd7c_47b3_9fba_7d6ea27fcc12.slice/crio-b2340fe0ca60efddda2c3a6762e5ee392cdd9f19faf1239111a62411589cff44 WatchSource:0}: Error finding container b2340fe0ca60efddda2c3a6762e5ee392cdd9f19faf1239111a62411589cff44: Status 404 returned error can't find the container with id b2340fe0ca60efddda2c3a6762e5ee392cdd9f19faf1239111a62411589cff44 Jul 29 15:47:15.918804 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.918783 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.918904 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.918838 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/636a0c3c-df7e-4299-a14e-a5f9309cf558-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.919696 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.919672 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/636a0c3c-df7e-4299-a14e-a5f9309cf558-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:15.921347 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:15.921322 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:16.085588 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:16.085503 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:47:16.130780 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:16.130752 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7cc4c4f75c-jp5jj" Jul 29 15:47:16.230602 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:16.230565 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lgb2h" event={"ID":"7d2163b3-00f3-4ff6-8b0f-66c8706f8614","Type":"ContainerStarted","Data":"ae44fdf3fc0fd84bcd9d41ba8d7cd1816da5177728c0a488170ece544ef28405"} Jul 29 15:47:16.232639 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:16.232608 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zx86l" event={"ID":"a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12","Type":"ContainerStarted","Data":"185be67d3e0eb54c84fe2fae400d178295d141c4e5e514d088fadc3ece53866c"} Jul 29 15:47:16.232761 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:16.232663 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zx86l" event={"ID":"a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12","Type":"ContainerStarted","Data":"02ba2f10d61a1bed57ecd50f5f427a3ffb176b79f9da5f609668ef2cb42c368e"} Jul 29 15:47:16.232761 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:16.232682 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zx86l" event={"ID":"a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12","Type":"ContainerStarted","Data":"b2340fe0ca60efddda2c3a6762e5ee392cdd9f19faf1239111a62411589cff44"} Jul 29 15:47:16.234140 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:16.234109 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q2j8t" event={"ID":"01ec4c57-f450-43e8-a2af-d6175efa9f8d","Type":"ContainerStarted","Data":"ba3c08b263d98ed5f88b291b87fcc6e23fb95d969eb9b9bf067194d2d58b72d0"} Jul 29 15:47:16.240545 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:16.240520 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 15:47:16.243216 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:47:16.242504 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod636a0c3c_df7e_4299_a14e_a5f9309cf558.slice/crio-43ae7bb9b614035fbffa47c90fdab8bce14e4c40c96b2a3c5a647fe8bb5e1442 WatchSource:0}: Error finding container 43ae7bb9b614035fbffa47c90fdab8bce14e4c40c96b2a3c5a647fe8bb5e1442: Status 404 returned error can't find the container with id 43ae7bb9b614035fbffa47c90fdab8bce14e4c40c96b2a3c5a647fe8bb5e1442 Jul 29 15:47:16.254163 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:16.254105 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lgb2h" podStartSLOduration=33.741771159 podStartE2EDuration="46.254084884s" totalImagesPullingTime="12.512313725s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:46:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:16.252958012 +0000 UTC m=+85.936041304" watchObservedRunningTime="2026-07-29 15:47:16.254084884 +0000 UTC m=+85.937168179" Jul 29 15:47:17.241997 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:17.241960 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"636a0c3c-df7e-4299-a14e-a5f9309cf558","Type":"ContainerStarted","Data":"43ae7bb9b614035fbffa47c90fdab8bce14e4c40c96b2a3c5a647fe8bb5e1442"} Jul 29 15:47:17.243857 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:17.243826 2567 generic.go:356] "Generic (PLEG): container finished" podID="01ec4c57-f450-43e8-a2af-d6175efa9f8d" containerID="21fab6b2c0e3be0eaf0a4b085ea35f78bc1f72dfe955532ef8fdf1b607d909ce" exitCode=0 Jul 29 15:47:17.243986 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:17.243898 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q2j8t" event={"ID":"01ec4c57-f450-43e8-a2af-d6175efa9f8d","Type":"ContainerDied","Data":"21fab6b2c0e3be0eaf0a4b085ea35f78bc1f72dfe955532ef8fdf1b607d909ce"} Jul 29 15:47:18.250134 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.250099 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zx86l" event={"ID":"a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12","Type":"ContainerStarted","Data":"4b1062e5bd0abe34ec58a3c0abc35e7c7ddb0e190cf28e37e1b08881f3d7a8bf"} Jul 29 15:47:18.251616 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.251592 2567 generic.go:356] "Generic (PLEG): container finished" podID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerID="ce9222f9008aee7c12066218db3340907026d161d840f9aeadd53b4925a9b7cb" exitCode=0 Jul 29 15:47:18.251750 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.251688 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"636a0c3c-df7e-4299-a14e-a5f9309cf558","Type":"ContainerDied","Data":"ce9222f9008aee7c12066218db3340907026d161d840f9aeadd53b4925a9b7cb"} Jul 29 15:47:18.253791 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.253771 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q2j8t" event={"ID":"01ec4c57-f450-43e8-a2af-d6175efa9f8d","Type":"ContainerStarted","Data":"57e4028a20cd17fb8c055f9961df15f2f1c627e0966fb2a08eff839946acb771"} Jul 29 15:47:18.253900 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.253809 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q2j8t" event={"ID":"01ec4c57-f450-43e8-a2af-d6175efa9f8d","Type":"ContainerStarted","Data":"1b63f54e0e42da4a630d700c65c09d3a18798e8260d5b6d4500116ef88f6c865"} Jul 29 15:47:18.315263 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.315193 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-q2j8t" podStartSLOduration=3.367580818 podStartE2EDuration="4.315172682s" totalImagesPullingTime="875.129776ms" totalInitContainerRuntime="72.462088ms" isStatefulPod=true podCreationTimestamp="2026-07-29 15:47:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:18.31513133 +0000 UTC m=+87.998214651" watchObservedRunningTime="2026-07-29 15:47:18.315172682 +0000 UTC m=+87.998255980" Jul 29 15:47:18.316087 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.316054 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-zx86l" podStartSLOduration=3.03606122 podStartE2EDuration="4.316044214s" totalImagesPullingTime="1.279982994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:47:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:18.280177727 +0000 UTC m=+87.963261021" watchObservedRunningTime="2026-07-29 15:47:18.316044214 +0000 UTC m=+87.999127507" Jul 29 15:47:18.528895 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.528822 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-d9976ff44-nf2q8"] Jul 29 15:47:18.532012 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.531997 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d9976ff44-nf2q8" Jul 29 15:47:18.535427 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.535406 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 29 15:47:18.535551 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.535491 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-5654z\"" Jul 29 15:47:18.535886 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.535870 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 29 15:47:18.537358 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.537270 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 29 15:47:18.537358 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.537327 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-as558u5r8ttlg\"" Jul 29 15:47:18.537725 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.537707 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 29 15:47:18.563006 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.562976 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d9976ff44-nf2q8"] Jul 29 15:47:18.643004 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.642970 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4b4cbe1a-05fd-405d-94ab-25975ee836e3-secret-metrics-server-tls\") pod \"metrics-server-d9976ff44-nf2q8\" (UID: \"4b4cbe1a-05fd-405d-94ab-25975ee836e3\") " pod="openshift-monitoring/metrics-server-d9976ff44-nf2q8" Jul 29 15:47:18.643176 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.643018 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4b4cbe1a-05fd-405d-94ab-25975ee836e3-metrics-server-audit-profiles\") pod \"metrics-server-d9976ff44-nf2q8\" (UID: \"4b4cbe1a-05fd-405d-94ab-25975ee836e3\") " pod="openshift-monitoring/metrics-server-d9976ff44-nf2q8" Jul 29 15:47:18.643176 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.643048 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4b4cbe1a-05fd-405d-94ab-25975ee836e3-audit-log\") pod \"metrics-server-d9976ff44-nf2q8\" (UID: \"4b4cbe1a-05fd-405d-94ab-25975ee836e3\") " pod="openshift-monitoring/metrics-server-d9976ff44-nf2q8" Jul 29 15:47:18.643176 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.643095 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b4cbe1a-05fd-405d-94ab-25975ee836e3-client-ca-bundle\") pod \"metrics-server-d9976ff44-nf2q8\" (UID: \"4b4cbe1a-05fd-405d-94ab-25975ee836e3\") " pod="openshift-monitoring/metrics-server-d9976ff44-nf2q8" Jul 29 15:47:18.643278 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.643168 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4b4cbe1a-05fd-405d-94ab-25975ee836e3-secret-metrics-server-client-certs\") pod \"metrics-server-d9976ff44-nf2q8\" (UID: \"4b4cbe1a-05fd-405d-94ab-25975ee836e3\") " pod="openshift-monitoring/metrics-server-d9976ff44-nf2q8" Jul 29 15:47:18.643278 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.643209 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69jx9\" (UniqueName: \"kubernetes.io/projected/4b4cbe1a-05fd-405d-94ab-25975ee836e3-kube-api-access-69jx9\") pod \"metrics-server-d9976ff44-nf2q8\" (UID: \"4b4cbe1a-05fd-405d-94ab-25975ee836e3\") " pod="openshift-monitoring/metrics-server-d9976ff44-nf2q8" Jul 29 15:47:18.643278 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.643229 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b4cbe1a-05fd-405d-94ab-25975ee836e3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d9976ff44-nf2q8\" (UID: \"4b4cbe1a-05fd-405d-94ab-25975ee836e3\") " pod="openshift-monitoring/metrics-server-d9976ff44-nf2q8" Jul 29 15:47:18.744208 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.744166 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69jx9\" (UniqueName: \"kubernetes.io/projected/4b4cbe1a-05fd-405d-94ab-25975ee836e3-kube-api-access-69jx9\") pod \"metrics-server-d9976ff44-nf2q8\" (UID: \"4b4cbe1a-05fd-405d-94ab-25975ee836e3\") " pod="openshift-monitoring/metrics-server-d9976ff44-nf2q8" Jul 29 15:47:18.744208 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.744209 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b4cbe1a-05fd-405d-94ab-25975ee836e3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d9976ff44-nf2q8\" (UID: \"4b4cbe1a-05fd-405d-94ab-25975ee836e3\") " pod="openshift-monitoring/metrics-server-d9976ff44-nf2q8" Jul 29 15:47:18.744437 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.744259 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4b4cbe1a-05fd-405d-94ab-25975ee836e3-secret-metrics-server-tls\") pod \"metrics-server-d9976ff44-nf2q8\" (UID: \"4b4cbe1a-05fd-405d-94ab-25975ee836e3\") " pod="openshift-monitoring/metrics-server-d9976ff44-nf2q8" Jul 29 15:47:18.744437 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.744293 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4b4cbe1a-05fd-405d-94ab-25975ee836e3-metrics-server-audit-profiles\") pod \"metrics-server-d9976ff44-nf2q8\" (UID: \"4b4cbe1a-05fd-405d-94ab-25975ee836e3\") " pod="openshift-monitoring/metrics-server-d9976ff44-nf2q8" Jul 29 15:47:18.744437 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.744319 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4b4cbe1a-05fd-405d-94ab-25975ee836e3-audit-log\") pod \"metrics-server-d9976ff44-nf2q8\" (UID: \"4b4cbe1a-05fd-405d-94ab-25975ee836e3\") " pod="openshift-monitoring/metrics-server-d9976ff44-nf2q8" Jul 29 15:47:18.744437 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.744350 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b4cbe1a-05fd-405d-94ab-25975ee836e3-client-ca-bundle\") pod \"metrics-server-d9976ff44-nf2q8\" (UID: \"4b4cbe1a-05fd-405d-94ab-25975ee836e3\") " pod="openshift-monitoring/metrics-server-d9976ff44-nf2q8" Jul 29 15:47:18.744437 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.744392 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4b4cbe1a-05fd-405d-94ab-25975ee836e3-secret-metrics-server-client-certs\") pod \"metrics-server-d9976ff44-nf2q8\" (UID: \"4b4cbe1a-05fd-405d-94ab-25975ee836e3\") " pod="openshift-monitoring/metrics-server-d9976ff44-nf2q8" Jul 29 15:47:18.744837 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.744806 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4b4cbe1a-05fd-405d-94ab-25975ee836e3-audit-log\") pod \"metrics-server-d9976ff44-nf2q8\" (UID: \"4b4cbe1a-05fd-405d-94ab-25975ee836e3\") " pod="openshift-monitoring/metrics-server-d9976ff44-nf2q8" Jul 29 15:47:18.745129 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.745062 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b4cbe1a-05fd-405d-94ab-25975ee836e3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d9976ff44-nf2q8\" (UID: \"4b4cbe1a-05fd-405d-94ab-25975ee836e3\") " pod="openshift-monitoring/metrics-server-d9976ff44-nf2q8" Jul 29 15:47:18.745330 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.745297 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4b4cbe1a-05fd-405d-94ab-25975ee836e3-metrics-server-audit-profiles\") pod \"metrics-server-d9976ff44-nf2q8\" (UID: \"4b4cbe1a-05fd-405d-94ab-25975ee836e3\") " pod="openshift-monitoring/metrics-server-d9976ff44-nf2q8" Jul 29 15:47:18.747011 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.746983 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4b4cbe1a-05fd-405d-94ab-25975ee836e3-secret-metrics-server-tls\") pod \"metrics-server-d9976ff44-nf2q8\" (UID: \"4b4cbe1a-05fd-405d-94ab-25975ee836e3\") " pod="openshift-monitoring/metrics-server-d9976ff44-nf2q8" Jul 29 15:47:18.747379 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.747359 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4b4cbe1a-05fd-405d-94ab-25975ee836e3-secret-metrics-server-client-certs\") pod \"metrics-server-d9976ff44-nf2q8\" (UID: \"4b4cbe1a-05fd-405d-94ab-25975ee836e3\") " pod="openshift-monitoring/metrics-server-d9976ff44-nf2q8" Jul 29 15:47:18.747468 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.747409 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b4cbe1a-05fd-405d-94ab-25975ee836e3-client-ca-bundle\") pod \"metrics-server-d9976ff44-nf2q8\" (UID: \"4b4cbe1a-05fd-405d-94ab-25975ee836e3\") " pod="openshift-monitoring/metrics-server-d9976ff44-nf2q8" Jul 29 15:47:18.755564 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.755536 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69jx9\" (UniqueName: \"kubernetes.io/projected/4b4cbe1a-05fd-405d-94ab-25975ee836e3-kube-api-access-69jx9\") pod \"metrics-server-d9976ff44-nf2q8\" (UID: \"4b4cbe1a-05fd-405d-94ab-25975ee836e3\") " pod="openshift-monitoring/metrics-server-d9976ff44-nf2q8" Jul 29 15:47:18.841533 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.841445 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d9976ff44-nf2q8" Jul 29 15:47:18.990015 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:18.989983 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d9976ff44-nf2q8"] Jul 29 15:47:18.993542 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:47:18.993512 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b4cbe1a_05fd_405d_94ab_25975ee836e3.slice/crio-d75723a1a3b64c52d54b5fb66e0341a518240414418014fc3591bd056f3021a1 WatchSource:0}: Error finding container d75723a1a3b64c52d54b5fb66e0341a518240414418014fc3591bd056f3021a1: Status 404 returned error can't find the container with id d75723a1a3b64c52d54b5fb66e0341a518240414418014fc3591bd056f3021a1 Jul 29 15:47:19.258039 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:19.258008 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d9976ff44-nf2q8" event={"ID":"4b4cbe1a-05fd-405d-94ab-25975ee836e3","Type":"ContainerStarted","Data":"d75723a1a3b64c52d54b5fb66e0341a518240414418014fc3591bd056f3021a1"} Jul 29 15:47:19.691757 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:19.691720 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-sjzh6"] Jul 29 15:47:19.694997 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:19.694974 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-sjzh6" Jul 29 15:47:19.697023 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:19.696999 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 29 15:47:19.697170 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:19.697149 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-8h7jt\"" Jul 29 15:47:19.697498 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:19.697481 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 29 15:47:19.705898 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:19.705874 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-sjzh6"] Jul 29 15:47:19.856033 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:19.855994 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtq6v\" (UniqueName: \"kubernetes.io/projected/626c1714-32b2-4f61-aa50-c49fb1f2bfe0-kube-api-access-xtq6v\") pod \"downloads-7c97dc4555-sjzh6\" (UID: \"626c1714-32b2-4f61-aa50-c49fb1f2bfe0\") " pod="openshift-console/downloads-7c97dc4555-sjzh6" Jul 29 15:47:19.956952 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:19.956848 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtq6v\" (UniqueName: \"kubernetes.io/projected/626c1714-32b2-4f61-aa50-c49fb1f2bfe0-kube-api-access-xtq6v\") pod \"downloads-7c97dc4555-sjzh6\" (UID: \"626c1714-32b2-4f61-aa50-c49fb1f2bfe0\") " pod="openshift-console/downloads-7c97dc4555-sjzh6" Jul 29 15:47:19.970360 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:19.970329 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtq6v\" (UniqueName: \"kubernetes.io/projected/626c1714-32b2-4f61-aa50-c49fb1f2bfe0-kube-api-access-xtq6v\") pod \"downloads-7c97dc4555-sjzh6\" (UID: \"626c1714-32b2-4f61-aa50-c49fb1f2bfe0\") " pod="openshift-console/downloads-7c97dc4555-sjzh6" Jul 29 15:47:20.006679 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.006642 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-sjzh6" Jul 29 15:47:20.336672 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.336637 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 15:47:20.342494 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.341712 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.344919 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.344893 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 29 15:47:20.345099 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.344987 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 29 15:47:20.345796 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.345761 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 29 15:47:20.345920 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.345822 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 29 15:47:20.346073 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.346052 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 29 15:47:20.346177 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.346160 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 29 15:47:20.346412 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.346390 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 29 15:47:20.346534 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.346443 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 29 15:47:20.346925 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.346904 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 29 15:47:20.347580 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.347560 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 29 15:47:20.347654 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.347584 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 29 15:47:20.347710 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.347674 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qphcj\"" Jul 29 15:47:20.347989 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.347959 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1iusr146uk5ku\"" Jul 29 15:47:20.348046 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.348008 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 29 15:47:20.348116 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.347961 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 29 15:47:20.349621 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.349603 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 29 15:47:20.362162 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.362087 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 15:47:20.440106 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.439986 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-sjzh6"] Jul 29 15:47:20.460856 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.460826 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.461040 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.460864 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.461040 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.460895 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-web-config\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.461040 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.461015 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.461191 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.461070 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-config-out\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.461191 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.461100 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.461191 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.461136 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.461191 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.461166 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.461324 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.461195 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.461324 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.461218 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.461324 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.461247 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.461324 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.461282 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.461324 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.461311 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.461554 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.461366 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.461554 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.461401 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd2jg\" (UniqueName: \"kubernetes.io/projected/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-kube-api-access-cd2jg\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.461554 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.461438 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.461554 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.461464 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.461554 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.461501 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-config\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.461554 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.461522 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.461554 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.461549 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.562824 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.562739 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.562824 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.562786 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.562824 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.562807 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.563147 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.562829 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.563147 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.562858 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.563147 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.562884 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.563147 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.562916 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.563147 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.562965 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.563147 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.562999 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd2jg\" (UniqueName: \"kubernetes.io/projected/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-kube-api-access-cd2jg\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.563147 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.563034 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.563147 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.563054 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.563147 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.563090 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-config\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.563147 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.563109 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.563147 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.563134 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.563658 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.563169 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.563658 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.563199 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.563658 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.563223 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-web-config\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.563658 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.563257 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.563658 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.563295 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-config-out\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.563658 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.563320 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.563972 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.563905 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.565216 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.564531 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.565216 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.564761 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.565216 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.564863 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.565216 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.564926 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.565483 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.565434 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.566349 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.566329 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.566511 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.566482 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.566764 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.566740 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.566855 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.566807 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.568555 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.568511 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.568922 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.568893 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.569286 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.569255 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-web-config\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.569376 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.569287 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.569569 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.569547 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.569647 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.569556 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.570233 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.570211 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-config\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.570327 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.570279 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.570588 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.570569 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-config-out\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.572340 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.572319 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd2jg\" (UniqueName: \"kubernetes.io/projected/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-kube-api-access-cd2jg\") pod \"prometheus-k8s-0\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.656036 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.656002 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:20.771319 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:47:20.771288 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod626c1714_32b2_4f61_aa50_c49fb1f2bfe0.slice/crio-d6e16cd6cdae3a45cf028cd709b6a5e6588dc3dc01f73ffaeb4a01c6e52d3ae4 WatchSource:0}: Error finding container d6e16cd6cdae3a45cf028cd709b6a5e6588dc3dc01f73ffaeb4a01c6e52d3ae4: Status 404 returned error can't find the container with id d6e16cd6cdae3a45cf028cd709b6a5e6588dc3dc01f73ffaeb4a01c6e52d3ae4 Jul 29 15:47:20.934497 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:20.934411 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 15:47:20.939060 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:47:20.939036 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod323b7c13_70d3_47d8_90d3_f2e7da6e0d6f.slice/crio-9f54f80187fdb20d7941c3ae959b06c896ea42c743b3fd49a4dc626618f50fd6 WatchSource:0}: Error finding container 9f54f80187fdb20d7941c3ae959b06c896ea42c743b3fd49a4dc626618f50fd6: Status 404 returned error can't find the container with id 9f54f80187fdb20d7941c3ae959b06c896ea42c743b3fd49a4dc626618f50fd6 Jul 29 15:47:21.272196 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:21.272162 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"636a0c3c-df7e-4299-a14e-a5f9309cf558","Type":"ContainerStarted","Data":"80b85b0a384372b2b857ada810bef98fe06857fb862778fa9e026b3e9dc758a1"} Jul 29 15:47:21.272353 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:21.272286 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"636a0c3c-df7e-4299-a14e-a5f9309cf558","Type":"ContainerStarted","Data":"f152c1c7c38e82cb3a8da5b061dab0b8e5ae7408359f502e59bd3f528756add4"} Jul 29 15:47:21.272353 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:21.272331 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"636a0c3c-df7e-4299-a14e-a5f9309cf558","Type":"ContainerStarted","Data":"cfc2524c5de843b8f4d5b3b999375e6ef5ca472c99581bb47021bf791c11c783"} Jul 29 15:47:21.272480 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:21.272357 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"636a0c3c-df7e-4299-a14e-a5f9309cf558","Type":"ContainerStarted","Data":"63c89c75216ae4727b31dc9cfde72ed350bb443b7dad0769f7aee81d3c6a726a"} Jul 29 15:47:21.272480 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:21.272386 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"636a0c3c-df7e-4299-a14e-a5f9309cf558","Type":"ContainerStarted","Data":"96531c3c702116f6287207d646c33779cc9e514d9e1c10eab4917d32d647b1f7"} Jul 29 15:47:21.273774 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:21.273741 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d9976ff44-nf2q8" event={"ID":"4b4cbe1a-05fd-405d-94ab-25975ee836e3","Type":"ContainerStarted","Data":"af14bece7179c48ade379a94d2a297fa727d353ff49c8a16950b034c327ddc6a"} Jul 29 15:47:21.275296 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:21.275275 2567 generic.go:356] "Generic (PLEG): container finished" podID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerID="45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56" exitCode=0 Jul 29 15:47:21.275405 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:21.275315 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f","Type":"ContainerDied","Data":"45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56"} Jul 29 15:47:21.275405 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:21.275385 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f","Type":"ContainerStarted","Data":"9f54f80187fdb20d7941c3ae959b06c896ea42c743b3fd49a4dc626618f50fd6"} Jul 29 15:47:21.276444 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:21.276425 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-sjzh6" event={"ID":"626c1714-32b2-4f61-aa50-c49fb1f2bfe0","Type":"ContainerStarted","Data":"d6e16cd6cdae3a45cf028cd709b6a5e6588dc3dc01f73ffaeb4a01c6e52d3ae4"} Jul 29 15:47:21.298719 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:21.298673 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-d9976ff44-nf2q8" podStartSLOduration=1.47268982 podStartE2EDuration="3.298656666s" totalImagesPullingTime="1.825966846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:47:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:21.297278447 +0000 UTC m=+90.980361743" watchObservedRunningTime="2026-07-29 15:47:21.298656666 +0000 UTC m=+90.981739960" Jul 29 15:47:22.287061 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:22.286473 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"636a0c3c-df7e-4299-a14e-a5f9309cf558","Type":"ContainerStarted","Data":"ba34dbe57fedab32c651da54de1b5c716e22ec0238097a42c79c17ce598c5489"} Jul 29 15:47:22.326924 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:22.325715 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.859236937 podStartE2EDuration="7.32569286s" totalImagesPullingTime="4.450810002s" totalInitContainerRuntime="15.645921ms" isStatefulPod=false podCreationTimestamp="2026-07-29 15:47:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:22.324065532 +0000 UTC m=+92.007148844" watchObservedRunningTime="2026-07-29 15:47:22.32569286 +0000 UTC m=+92.008776156" Jul 29 15:47:25.304916 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:25.304878 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f","Type":"ContainerStarted","Data":"83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f"} Jul 29 15:47:26.312661 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:26.312565 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f","Type":"ContainerStarted","Data":"941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851"} Jul 29 15:47:28.326864 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:28.326828 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f","Type":"ContainerStarted","Data":"2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec"} Jul 29 15:47:28.327355 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:28.326906 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f","Type":"ContainerStarted","Data":"cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63"} Jul 29 15:47:28.327355 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:28.326976 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f","Type":"ContainerStarted","Data":"0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad"} Jul 29 15:47:28.327355 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:28.327019 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f","Type":"ContainerStarted","Data":"034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab"} Jul 29 15:47:28.358460 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:28.358316 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.340803557 podStartE2EDuration="8.358298894s" totalImagesPullingTime="5.990825268s" totalInitContainerRuntime="26.670069ms" isStatefulPod=false podCreationTimestamp="2026-07-29 15:47:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:28.356875522 +0000 UTC m=+98.039958817" watchObservedRunningTime="2026-07-29 15:47:28.358298894 +0000 UTC m=+98.041382167" Jul 29 15:47:30.656641 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:30.656604 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:47:34.179021 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:34.178981 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-94h8p" Jul 29 15:47:38.842399 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:38.842359 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-d9976ff44-nf2q8" Jul 29 15:47:38.842920 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:38.842417 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-d9976ff44-nf2q8" Jul 29 15:47:41.388162 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:41.388128 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-sjzh6" event={"ID":"626c1714-32b2-4f61-aa50-c49fb1f2bfe0","Type":"ContainerStarted","Data":"c6c0bdfb74fab361ac573c072a42b054d308521a20b223ad8ffed991d01aaf7e"} Jul 29 15:47:41.388665 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:41.388356 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-sjzh6" Jul 29 15:47:41.404281 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:41.404251 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-sjzh6" Jul 29 15:47:41.420229 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:41.420164 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-sjzh6" podStartSLOduration=2.740276609 podStartE2EDuration="22.420140635s" totalImagesPullingTime="19.679864026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:47:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:41.419548433 +0000 UTC m=+111.102631755" watchObservedRunningTime="2026-07-29 15:47:41.420140635 +0000 UTC m=+111.103223930" Jul 29 15:47:51.252824 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:51.252796 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6tw4d_c2010b07-9481-44e2-83d2-041556d8c913/serve-healthcheck-canary/0.log" Jul 29 15:47:58.847946 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:58.847900 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-d9976ff44-nf2q8" Jul 29 15:47:58.851806 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:47:58.851781 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-d9976ff44-nf2q8" Jul 29 15:48:20.656678 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:20.656636 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:20.722209 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:20.722180 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:21.576571 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:21.576540 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:34.488918 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:34.488879 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 15:48:34.489431 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:34.489205 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerName="alertmanager" containerID="cri-o://96531c3c702116f6287207d646c33779cc9e514d9e1c10eab4917d32d647b1f7" gracePeriod=120 Jul 29 15:48:34.489431 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:34.489243 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerName="kube-rbac-proxy-web" containerID="cri-o://cfc2524c5de843b8f4d5b3b999375e6ef5ca472c99581bb47021bf791c11c783" gracePeriod=120 Jul 29 15:48:34.489431 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:34.489268 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerName="config-reloader" containerID="cri-o://63c89c75216ae4727b31dc9cfde72ed350bb443b7dad0769f7aee81d3c6a726a" gracePeriod=120 Jul 29 15:48:34.489431 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:34.489286 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerName="prom-label-proxy" containerID="cri-o://ba34dbe57fedab32c651da54de1b5c716e22ec0238097a42c79c17ce598c5489" gracePeriod=120 Jul 29 15:48:34.489431 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:34.489242 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerName="kube-rbac-proxy" containerID="cri-o://f152c1c7c38e82cb3a8da5b061dab0b8e5ae7408359f502e59bd3f528756add4" gracePeriod=120 Jul 29 15:48:34.489681 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:34.489441 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerName="kube-rbac-proxy-metric" containerID="cri-o://80b85b0a384372b2b857ada810bef98fe06857fb862778fa9e026b3e9dc758a1" gracePeriod=120 Jul 29 15:48:34.617510 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:34.617479 2567 generic.go:356] "Generic (PLEG): container finished" podID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerID="ba34dbe57fedab32c651da54de1b5c716e22ec0238097a42c79c17ce598c5489" exitCode=0 Jul 29 15:48:34.617510 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:34.617506 2567 generic.go:356] "Generic (PLEG): container finished" podID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerID="f152c1c7c38e82cb3a8da5b061dab0b8e5ae7408359f502e59bd3f528756add4" exitCode=0 Jul 29 15:48:34.617510 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:34.617514 2567 generic.go:356] "Generic (PLEG): container finished" podID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerID="63c89c75216ae4727b31dc9cfde72ed350bb443b7dad0769f7aee81d3c6a726a" exitCode=0 Jul 29 15:48:34.617731 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:34.617520 2567 generic.go:356] "Generic (PLEG): container finished" podID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerID="96531c3c702116f6287207d646c33779cc9e514d9e1c10eab4917d32d647b1f7" exitCode=0 Jul 29 15:48:34.617731 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:34.617548 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"636a0c3c-df7e-4299-a14e-a5f9309cf558","Type":"ContainerDied","Data":"ba34dbe57fedab32c651da54de1b5c716e22ec0238097a42c79c17ce598c5489"} Jul 29 15:48:34.617731 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:34.617623 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"636a0c3c-df7e-4299-a14e-a5f9309cf558","Type":"ContainerDied","Data":"f152c1c7c38e82cb3a8da5b061dab0b8e5ae7408359f502e59bd3f528756add4"} Jul 29 15:48:34.617731 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:34.617652 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"636a0c3c-df7e-4299-a14e-a5f9309cf558","Type":"ContainerDied","Data":"63c89c75216ae4727b31dc9cfde72ed350bb443b7dad0769f7aee81d3c6a726a"} Jul 29 15:48:34.617731 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:34.617677 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"636a0c3c-df7e-4299-a14e-a5f9309cf558","Type":"ContainerDied","Data":"96531c3c702116f6287207d646c33779cc9e514d9e1c10eab4917d32d647b1f7"} Jul 29 15:48:35.626082 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.626052 2567 generic.go:356] "Generic (PLEG): container finished" podID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerID="80b85b0a384372b2b857ada810bef98fe06857fb862778fa9e026b3e9dc758a1" exitCode=0 Jul 29 15:48:35.626082 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.626075 2567 generic.go:356] "Generic (PLEG): container finished" podID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerID="cfc2524c5de843b8f4d5b3b999375e6ef5ca472c99581bb47021bf791c11c783" exitCode=0 Jul 29 15:48:35.626533 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.626135 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"636a0c3c-df7e-4299-a14e-a5f9309cf558","Type":"ContainerDied","Data":"80b85b0a384372b2b857ada810bef98fe06857fb862778fa9e026b3e9dc758a1"} Jul 29 15:48:35.626533 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.626225 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"636a0c3c-df7e-4299-a14e-a5f9309cf558","Type":"ContainerDied","Data":"cfc2524c5de843b8f4d5b3b999375e6ef5ca472c99581bb47021bf791c11c783"} Jul 29 15:48:35.734142 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.734118 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:35.849354 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.849268 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-secret-alertmanager-kube-rbac-proxy\") pod \"636a0c3c-df7e-4299-a14e-a5f9309cf558\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " Jul 29 15:48:35.849354 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.849305 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/636a0c3c-df7e-4299-a14e-a5f9309cf558-alertmanager-main-db\") pod \"636a0c3c-df7e-4299-a14e-a5f9309cf558\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " Jul 29 15:48:35.849354 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.849321 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-secret-alertmanager-kube-rbac-proxy-web\") pod \"636a0c3c-df7e-4299-a14e-a5f9309cf558\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " Jul 29 15:48:35.849354 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.849346 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-secret-alertmanager-main-tls\") pod \"636a0c3c-df7e-4299-a14e-a5f9309cf558\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " Jul 29 15:48:35.849688 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.849442 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/636a0c3c-df7e-4299-a14e-a5f9309cf558-config-out\") pod \"636a0c3c-df7e-4299-a14e-a5f9309cf558\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " Jul 29 15:48:35.849688 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.849467 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/636a0c3c-df7e-4299-a14e-a5f9309cf558-tls-assets\") pod \"636a0c3c-df7e-4299-a14e-a5f9309cf558\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " Jul 29 15:48:35.849688 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.849491 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-secret-alertmanager-kube-rbac-proxy-metric\") pod \"636a0c3c-df7e-4299-a14e-a5f9309cf558\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " Jul 29 15:48:35.849688 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.849532 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-web-config\") pod \"636a0c3c-df7e-4299-a14e-a5f9309cf558\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " Jul 29 15:48:35.849688 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.849577 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-cluster-tls-config\") pod \"636a0c3c-df7e-4299-a14e-a5f9309cf558\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " Jul 29 15:48:35.849688 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.849614 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gpxn\" (UniqueName: \"kubernetes.io/projected/636a0c3c-df7e-4299-a14e-a5f9309cf558-kube-api-access-7gpxn\") pod \"636a0c3c-df7e-4299-a14e-a5f9309cf558\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " Jul 29 15:48:35.849688 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.849656 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/636a0c3c-df7e-4299-a14e-a5f9309cf558-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "636a0c3c-df7e-4299-a14e-a5f9309cf558" (UID: "636a0c3c-df7e-4299-a14e-a5f9309cf558"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:48:35.849688 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.849661 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/636a0c3c-df7e-4299-a14e-a5f9309cf558-alertmanager-trusted-ca-bundle\") pod \"636a0c3c-df7e-4299-a14e-a5f9309cf558\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " Jul 29 15:48:35.850265 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.849719 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-config-volume\") pod \"636a0c3c-df7e-4299-a14e-a5f9309cf558\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " Jul 29 15:48:35.850265 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.849748 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/636a0c3c-df7e-4299-a14e-a5f9309cf558-metrics-client-ca\") pod \"636a0c3c-df7e-4299-a14e-a5f9309cf558\" (UID: \"636a0c3c-df7e-4299-a14e-a5f9309cf558\") " Jul 29 15:48:35.850265 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.849995 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/636a0c3c-df7e-4299-a14e-a5f9309cf558-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "636a0c3c-df7e-4299-a14e-a5f9309cf558" (UID: "636a0c3c-df7e-4299-a14e-a5f9309cf558"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:48:35.850265 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.850092 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/636a0c3c-df7e-4299-a14e-a5f9309cf558-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:35.850265 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.850110 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/636a0c3c-df7e-4299-a14e-a5f9309cf558-alertmanager-main-db\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:35.850522 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.850299 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/636a0c3c-df7e-4299-a14e-a5f9309cf558-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "636a0c3c-df7e-4299-a14e-a5f9309cf558" (UID: "636a0c3c-df7e-4299-a14e-a5f9309cf558"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:48:35.852741 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.852711 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/636a0c3c-df7e-4299-a14e-a5f9309cf558-config-out" (OuterVolumeSpecName: "config-out") pod "636a0c3c-df7e-4299-a14e-a5f9309cf558" (UID: "636a0c3c-df7e-4299-a14e-a5f9309cf558"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:48:35.852882 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.852814 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "636a0c3c-df7e-4299-a14e-a5f9309cf558" (UID: "636a0c3c-df7e-4299-a14e-a5f9309cf558"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:48:35.853002 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.852960 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "636a0c3c-df7e-4299-a14e-a5f9309cf558" (UID: "636a0c3c-df7e-4299-a14e-a5f9309cf558"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:48:35.853119 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.853046 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "636a0c3c-df7e-4299-a14e-a5f9309cf558" (UID: "636a0c3c-df7e-4299-a14e-a5f9309cf558"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:48:35.853253 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.853232 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/636a0c3c-df7e-4299-a14e-a5f9309cf558-kube-api-access-7gpxn" (OuterVolumeSpecName: "kube-api-access-7gpxn") pod "636a0c3c-df7e-4299-a14e-a5f9309cf558" (UID: "636a0c3c-df7e-4299-a14e-a5f9309cf558"). InnerVolumeSpecName "kube-api-access-7gpxn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:48:35.853429 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.853403 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "636a0c3c-df7e-4299-a14e-a5f9309cf558" (UID: "636a0c3c-df7e-4299-a14e-a5f9309cf558"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:48:35.853681 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.853654 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/636a0c3c-df7e-4299-a14e-a5f9309cf558-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "636a0c3c-df7e-4299-a14e-a5f9309cf558" (UID: "636a0c3c-df7e-4299-a14e-a5f9309cf558"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:48:35.853753 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.853694 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-config-volume" (OuterVolumeSpecName: "config-volume") pod "636a0c3c-df7e-4299-a14e-a5f9309cf558" (UID: "636a0c3c-df7e-4299-a14e-a5f9309cf558"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:48:35.857275 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.857129 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "636a0c3c-df7e-4299-a14e-a5f9309cf558" (UID: "636a0c3c-df7e-4299-a14e-a5f9309cf558"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:48:35.864723 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.864699 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-web-config" (OuterVolumeSpecName: "web-config") pod "636a0c3c-df7e-4299-a14e-a5f9309cf558" (UID: "636a0c3c-df7e-4299-a14e-a5f9309cf558"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:48:35.951016 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.950962 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/636a0c3c-df7e-4299-a14e-a5f9309cf558-config-out\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:35.951016 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.951008 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/636a0c3c-df7e-4299-a14e-a5f9309cf558-tls-assets\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:35.951016 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.951022 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:35.951016 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.951035 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-web-config\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:35.951302 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.951048 2567 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-cluster-tls-config\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:35.951302 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.951060 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gpxn\" (UniqueName: \"kubernetes.io/projected/636a0c3c-df7e-4299-a14e-a5f9309cf558-kube-api-access-7gpxn\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:35.951302 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.951072 2567 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-config-volume\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:35.951302 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.951082 2567 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/636a0c3c-df7e-4299-a14e-a5f9309cf558-metrics-client-ca\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:35.951302 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.951096 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:35.951302 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.951111 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:35.951302 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:35.951123 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/636a0c3c-df7e-4299-a14e-a5f9309cf558-secret-alertmanager-main-tls\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:36.633257 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:36.633224 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"636a0c3c-df7e-4299-a14e-a5f9309cf558","Type":"ContainerDied","Data":"43ae7bb9b614035fbffa47c90fdab8bce14e4c40c96b2a3c5a647fe8bb5e1442"} Jul 29 15:48:36.633257 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:36.633242 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:48:36.633679 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:36.633301 2567 scope.go:117] "RemoveContainer" containerID="ba34dbe57fedab32c651da54de1b5c716e22ec0238097a42c79c17ce598c5489" Jul 29 15:48:36.645516 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:36.645498 2567 scope.go:117] "RemoveContainer" containerID="80b85b0a384372b2b857ada810bef98fe06857fb862778fa9e026b3e9dc758a1" Jul 29 15:48:36.652818 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:36.652802 2567 scope.go:117] "RemoveContainer" containerID="f152c1c7c38e82cb3a8da5b061dab0b8e5ae7408359f502e59bd3f528756add4" Jul 29 15:48:36.660049 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:36.660026 2567 scope.go:117] "RemoveContainer" containerID="cfc2524c5de843b8f4d5b3b999375e6ef5ca472c99581bb47021bf791c11c783" Jul 29 15:48:36.662049 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:36.662025 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 15:48:36.667639 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:36.667617 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 15:48:36.667994 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:36.667970 2567 scope.go:117] "RemoveContainer" containerID="63c89c75216ae4727b31dc9cfde72ed350bb443b7dad0769f7aee81d3c6a726a" Jul 29 15:48:36.675254 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:36.675233 2567 scope.go:117] "RemoveContainer" containerID="96531c3c702116f6287207d646c33779cc9e514d9e1c10eab4917d32d647b1f7" Jul 29 15:48:36.682475 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:36.682454 2567 scope.go:117] "RemoveContainer" containerID="ce9222f9008aee7c12066218db3340907026d161d840f9aeadd53b4925a9b7cb" Jul 29 15:48:36.834162 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:36.834082 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="636a0c3c-df7e-4299-a14e-a5f9309cf558" path="/var/lib/kubelet/pods/636a0c3c-df7e-4299-a14e-a5f9309cf558/volumes" Jul 29 15:48:38.764841 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:38.764803 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 15:48:38.765383 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:38.765174 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerName="prometheus" containerID="cri-o://83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f" gracePeriod=600 Jul 29 15:48:38.765383 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:38.765203 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerName="kube-rbac-proxy" containerID="cri-o://cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63" gracePeriod=600 Jul 29 15:48:38.765383 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:38.765230 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerName="thanos-sidecar" containerID="cri-o://034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab" gracePeriod=600 Jul 29 15:48:38.765383 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:38.765268 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerName="kube-rbac-proxy-web" containerID="cri-o://0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad" gracePeriod=600 Jul 29 15:48:38.765383 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:38.765285 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerName="config-reloader" containerID="cri-o://941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851" gracePeriod=600 Jul 29 15:48:38.765383 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:38.765203 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerName="kube-rbac-proxy-thanos" containerID="cri-o://2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec" gracePeriod=600 Jul 29 15:48:39.014060 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.014030 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.177187 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.177082 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-grpc-tls\") pod \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " Jul 29 15:48:39.177187 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.177131 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-configmap-metrics-client-ca\") pod \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " Jul 29 15:48:39.177187 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.177151 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-prometheus-k8s-rulefiles-1\") pod \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " Jul 29 15:48:39.177187 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.177175 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-prometheus-trusted-ca-bundle\") pod \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " Jul 29 15:48:39.177509 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.177193 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-thanos-prometheus-http-client-file\") pod \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " Jul 29 15:48:39.177509 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.177219 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-config-out\") pod \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " Jul 29 15:48:39.177509 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.177251 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-prometheus-k8s-rulefiles-0\") pod \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " Jul 29 15:48:39.177509 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.177351 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-kube-rbac-proxy\") pod \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " Jul 29 15:48:39.177509 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.177396 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-tls-assets\") pod \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " Jul 29 15:48:39.177509 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.177434 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-configmap-kubelet-serving-ca-bundle\") pod \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " Jul 29 15:48:39.177509 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.177461 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-prometheus-k8s-rulefiles-2\") pod \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " Jul 29 15:48:39.177509 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.177492 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " Jul 29 15:48:39.177927 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.177531 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-config\") pod \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " Jul 29 15:48:39.177927 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.177567 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-configmap-serving-certs-ca-bundle\") pod \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " Jul 29 15:48:39.177927 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.177595 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-prometheus-k8s-tls\") pod \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " Jul 29 15:48:39.177927 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.177631 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-web-config\") pod \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " Jul 29 15:48:39.177927 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.177664 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-metrics-client-certs\") pod \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " Jul 29 15:48:39.177927 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.177673 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" (UID: "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:48:39.177927 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.177700 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cd2jg\" (UniqueName: \"kubernetes.io/projected/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-kube-api-access-cd2jg\") pod \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " Jul 29 15:48:39.177927 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.177730 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " Jul 29 15:48:39.177927 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.177756 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-prometheus-k8s-db\") pod \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\" (UID: \"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f\") " Jul 29 15:48:39.177927 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.177783 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" (UID: "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:48:39.177927 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.177853 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" (UID: "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:48:39.178452 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.178161 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-configmap-metrics-client-ca\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:39.178452 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.178182 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:39.178452 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.178198 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:39.178601 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.178492 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" (UID: "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:48:39.179276 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.179017 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" (UID: "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:48:39.179779 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.179512 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" (UID: "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:48:39.179951 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.179906 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" (UID: "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:48:39.180087 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.180065 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" (UID: "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:48:39.181241 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.181214 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" (UID: "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:48:39.181427 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.181239 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" (UID: "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:48:39.181427 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.181261 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" (UID: "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:48:39.181427 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.181297 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-config-out" (OuterVolumeSpecName: "config-out") pod "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" (UID: "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:48:39.181609 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.181517 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" (UID: "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:48:39.181666 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.181650 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" (UID: "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:48:39.182659 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.182632 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-kube-api-access-cd2jg" (OuterVolumeSpecName: "kube-api-access-cd2jg") pod "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" (UID: "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f"). InnerVolumeSpecName "kube-api-access-cd2jg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:48:39.182992 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.182970 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" (UID: "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:48:39.183071 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.183054 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-config" (OuterVolumeSpecName: "config") pod "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" (UID: "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:48:39.183140 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.183122 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" (UID: "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:48:39.183330 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.183308 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" (UID: "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:48:39.192543 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.192520 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-web-config" (OuterVolumeSpecName: "web-config") pod "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" (UID: "323b7c13-70d3-47d8-90d3-f2e7da6e0d6f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:48:39.279151 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.279103 2567 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-grpc-tls\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:39.279151 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.279147 2567 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:39.279151 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.279158 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-config-out\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:39.279151 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.279167 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:39.279414 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.279176 2567 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-kube-rbac-proxy\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:39.279414 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.279184 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-tls-assets\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:39.279414 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.279194 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:39.279414 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.279203 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:39.279414 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.279236 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:39.279414 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.279246 2567 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-config\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:39.279414 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.279254 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:39.279414 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.279263 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:39.279414 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.279271 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-web-config\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:39.279414 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.279281 2567 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-metrics-client-certs\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:39.279414 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.279288 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cd2jg\" (UniqueName: \"kubernetes.io/projected/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-kube-api-access-cd2jg\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:39.279414 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.279296 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:39.279414 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.279305 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f-prometheus-k8s-db\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:48:39.648900 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.648864 2567 generic.go:356] "Generic (PLEG): container finished" podID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerID="2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec" exitCode=0 Jul 29 15:48:39.648900 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.648893 2567 generic.go:356] "Generic (PLEG): container finished" podID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerID="cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63" exitCode=0 Jul 29 15:48:39.648900 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.648901 2567 generic.go:356] "Generic (PLEG): container finished" podID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerID="0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad" exitCode=0 Jul 29 15:48:39.648900 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.648908 2567 generic.go:356] "Generic (PLEG): container finished" podID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerID="034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab" exitCode=0 Jul 29 15:48:39.649193 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.648915 2567 generic.go:356] "Generic (PLEG): container finished" podID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerID="941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851" exitCode=0 Jul 29 15:48:39.649193 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.648924 2567 generic.go:356] "Generic (PLEG): container finished" podID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerID="83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f" exitCode=0 Jul 29 15:48:39.649193 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.648956 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.649193 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.648976 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f","Type":"ContainerDied","Data":"2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec"} Jul 29 15:48:39.649193 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.649057 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f","Type":"ContainerDied","Data":"cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63"} Jul 29 15:48:39.649193 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.649090 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f","Type":"ContainerDied","Data":"0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad"} Jul 29 15:48:39.649193 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.649129 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f","Type":"ContainerDied","Data":"034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab"} Jul 29 15:48:39.649193 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.649131 2567 scope.go:117] "RemoveContainer" containerID="2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec" Jul 29 15:48:39.649193 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.649171 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f","Type":"ContainerDied","Data":"941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851"} Jul 29 15:48:39.649603 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.649214 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f","Type":"ContainerDied","Data":"83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f"} Jul 29 15:48:39.649603 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.649259 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"323b7c13-70d3-47d8-90d3-f2e7da6e0d6f","Type":"ContainerDied","Data":"9f54f80187fdb20d7941c3ae959b06c896ea42c743b3fd49a4dc626618f50fd6"} Jul 29 15:48:39.657813 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.657708 2567 scope.go:117] "RemoveContainer" containerID="cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63" Jul 29 15:48:39.665005 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.664989 2567 scope.go:117] "RemoveContainer" containerID="0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad" Jul 29 15:48:39.671737 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.671721 2567 scope.go:117] "RemoveContainer" containerID="034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab" Jul 29 15:48:39.680671 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.680652 2567 scope.go:117] "RemoveContainer" containerID="941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851" Jul 29 15:48:39.681165 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.681138 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 15:48:39.687770 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.687754 2567 scope.go:117] "RemoveContainer" containerID="83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f" Jul 29 15:48:39.693522 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.693500 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 15:48:39.695996 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.695979 2567 scope.go:117] "RemoveContainer" containerID="45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56" Jul 29 15:48:39.702648 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.702629 2567 scope.go:117] "RemoveContainer" containerID="2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec" Jul 29 15:48:39.702917 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:48:39.702895 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec\": container with ID starting with 2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec not found: ID does not exist" containerID="2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec" Jul 29 15:48:39.703066 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.703017 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec"} err="failed to get container status \"2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec\": rpc error: code = NotFound desc = could not find container \"2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec\": container with ID starting with 2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec not found: ID does not exist" Jul 29 15:48:39.703148 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.703069 2567 scope.go:117] "RemoveContainer" containerID="cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63" Jul 29 15:48:39.703332 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:48:39.703316 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63\": container with ID starting with cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63 not found: ID does not exist" containerID="cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63" Jul 29 15:48:39.703385 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.703338 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63"} err="failed to get container status \"cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63\": rpc error: code = NotFound desc = could not find container \"cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63\": container with ID starting with cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63 not found: ID does not exist" Jul 29 15:48:39.703385 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.703353 2567 scope.go:117] "RemoveContainer" containerID="0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad" Jul 29 15:48:39.703589 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:48:39.703573 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad\": container with ID starting with 0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad not found: ID does not exist" containerID="0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad" Jul 29 15:48:39.703631 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.703594 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad"} err="failed to get container status \"0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad\": rpc error: code = NotFound desc = could not find container \"0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad\": container with ID starting with 0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad not found: ID does not exist" Jul 29 15:48:39.703631 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.703608 2567 scope.go:117] "RemoveContainer" containerID="034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab" Jul 29 15:48:39.703841 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:48:39.703825 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab\": container with ID starting with 034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab not found: ID does not exist" containerID="034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab" Jul 29 15:48:39.703877 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.703848 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab"} err="failed to get container status \"034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab\": rpc error: code = NotFound desc = could not find container \"034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab\": container with ID starting with 034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab not found: ID does not exist" Jul 29 15:48:39.703877 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.703865 2567 scope.go:117] "RemoveContainer" containerID="941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851" Jul 29 15:48:39.704102 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:48:39.704082 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851\": container with ID starting with 941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851 not found: ID does not exist" containerID="941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851" Jul 29 15:48:39.704161 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.704110 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851"} err="failed to get container status \"941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851\": rpc error: code = NotFound desc = could not find container \"941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851\": container with ID starting with 941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851 not found: ID does not exist" Jul 29 15:48:39.704161 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.704128 2567 scope.go:117] "RemoveContainer" containerID="83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f" Jul 29 15:48:39.704356 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:48:39.704341 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f\": container with ID starting with 83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f not found: ID does not exist" containerID="83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f" Jul 29 15:48:39.704389 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.704361 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f"} err="failed to get container status \"83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f\": rpc error: code = NotFound desc = could not find container \"83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f\": container with ID starting with 83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f not found: ID does not exist" Jul 29 15:48:39.704389 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.704373 2567 scope.go:117] "RemoveContainer" containerID="45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56" Jul 29 15:48:39.704593 ip-10-0-142-124 kubenswrapper[2567]: E0729 15:48:39.704578 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56\": container with ID starting with 45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56 not found: ID does not exist" containerID="45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56" Jul 29 15:48:39.704639 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.704599 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56"} err="failed to get container status \"45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56\": rpc error: code = NotFound desc = could not find container \"45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56\": container with ID starting with 45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56 not found: ID does not exist" Jul 29 15:48:39.704639 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.704613 2567 scope.go:117] "RemoveContainer" containerID="2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec" Jul 29 15:48:39.704816 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.704797 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec"} err="failed to get container status \"2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec\": rpc error: code = NotFound desc = could not find container \"2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec\": container with ID starting with 2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec not found: ID does not exist" Jul 29 15:48:39.704878 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.704817 2567 scope.go:117] "RemoveContainer" containerID="cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63" Jul 29 15:48:39.705049 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.705033 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63"} err="failed to get container status \"cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63\": rpc error: code = NotFound desc = could not find container \"cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63\": container with ID starting with cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63 not found: ID does not exist" Jul 29 15:48:39.705049 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.705049 2567 scope.go:117] "RemoveContainer" containerID="0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad" Jul 29 15:48:39.705265 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.705241 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad"} err="failed to get container status \"0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad\": rpc error: code = NotFound desc = could not find container \"0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad\": container with ID starting with 0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad not found: ID does not exist" Jul 29 15:48:39.705265 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.705259 2567 scope.go:117] "RemoveContainer" containerID="034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab" Jul 29 15:48:39.705466 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.705447 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab"} err="failed to get container status \"034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab\": rpc error: code = NotFound desc = could not find container \"034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab\": container with ID starting with 034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab not found: ID does not exist" Jul 29 15:48:39.705536 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.705469 2567 scope.go:117] "RemoveContainer" containerID="941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851" Jul 29 15:48:39.705702 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.705677 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851"} err="failed to get container status \"941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851\": rpc error: code = NotFound desc = could not find container \"941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851\": container with ID starting with 941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851 not found: ID does not exist" Jul 29 15:48:39.705702 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.705694 2567 scope.go:117] "RemoveContainer" containerID="83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f" Jul 29 15:48:39.705865 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.705848 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f"} err="failed to get container status \"83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f\": rpc error: code = NotFound desc = could not find container \"83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f\": container with ID starting with 83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f not found: ID does not exist" Jul 29 15:48:39.705917 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.705866 2567 scope.go:117] "RemoveContainer" containerID="45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56" Jul 29 15:48:39.706078 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.706058 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56"} err="failed to get container status \"45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56\": rpc error: code = NotFound desc = could not find container \"45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56\": container with ID starting with 45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56 not found: ID does not exist" Jul 29 15:48:39.706149 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.706080 2567 scope.go:117] "RemoveContainer" containerID="2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec" Jul 29 15:48:39.706283 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.706267 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec"} err="failed to get container status \"2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec\": rpc error: code = NotFound desc = could not find container \"2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec\": container with ID starting with 2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec not found: ID does not exist" Jul 29 15:48:39.706350 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.706285 2567 scope.go:117] "RemoveContainer" containerID="cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63" Jul 29 15:48:39.706482 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.706465 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63"} err="failed to get container status \"cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63\": rpc error: code = NotFound desc = could not find container \"cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63\": container with ID starting with cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63 not found: ID does not exist" Jul 29 15:48:39.706546 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.706483 2567 scope.go:117] "RemoveContainer" containerID="0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad" Jul 29 15:48:39.706689 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.706671 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad"} err="failed to get container status \"0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad\": rpc error: code = NotFound desc = could not find container \"0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad\": container with ID starting with 0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad not found: ID does not exist" Jul 29 15:48:39.706689 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.706690 2567 scope.go:117] "RemoveContainer" containerID="034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab" Jul 29 15:48:39.706868 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.706853 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab"} err="failed to get container status \"034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab\": rpc error: code = NotFound desc = could not find container \"034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab\": container with ID starting with 034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab not found: ID does not exist" Jul 29 15:48:39.706908 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.706868 2567 scope.go:117] "RemoveContainer" containerID="941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851" Jul 29 15:48:39.707081 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.707065 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851"} err="failed to get container status \"941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851\": rpc error: code = NotFound desc = could not find container \"941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851\": container with ID starting with 941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851 not found: ID does not exist" Jul 29 15:48:39.707134 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.707080 2567 scope.go:117] "RemoveContainer" containerID="83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f" Jul 29 15:48:39.707271 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.707252 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f"} err="failed to get container status \"83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f\": rpc error: code = NotFound desc = could not find container \"83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f\": container with ID starting with 83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f not found: ID does not exist" Jul 29 15:48:39.707314 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.707273 2567 scope.go:117] "RemoveContainer" containerID="45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56" Jul 29 15:48:39.707504 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.707486 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56"} err="failed to get container status \"45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56\": rpc error: code = NotFound desc = could not find container \"45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56\": container with ID starting with 45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56 not found: ID does not exist" Jul 29 15:48:39.707504 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.707504 2567 scope.go:117] "RemoveContainer" containerID="2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec" Jul 29 15:48:39.707702 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.707686 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec"} err="failed to get container status \"2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec\": rpc error: code = NotFound desc = could not find container \"2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec\": container with ID starting with 2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec not found: ID does not exist" Jul 29 15:48:39.707702 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.707702 2567 scope.go:117] "RemoveContainer" containerID="cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63" Jul 29 15:48:39.707908 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.707893 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63"} err="failed to get container status \"cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63\": rpc error: code = NotFound desc = could not find container \"cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63\": container with ID starting with cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63 not found: ID does not exist" Jul 29 15:48:39.707995 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.707909 2567 scope.go:117] "RemoveContainer" containerID="0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad" Jul 29 15:48:39.708170 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.708153 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad"} err="failed to get container status \"0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad\": rpc error: code = NotFound desc = could not find container \"0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad\": container with ID starting with 0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad not found: ID does not exist" Jul 29 15:48:39.708217 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.708172 2567 scope.go:117] "RemoveContainer" containerID="034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab" Jul 29 15:48:39.708417 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.708399 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab"} err="failed to get container status \"034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab\": rpc error: code = NotFound desc = could not find container \"034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab\": container with ID starting with 034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab not found: ID does not exist" Jul 29 15:48:39.708468 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.708419 2567 scope.go:117] "RemoveContainer" containerID="941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851" Jul 29 15:48:39.708626 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.708608 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851"} err="failed to get container status \"941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851\": rpc error: code = NotFound desc = could not find container \"941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851\": container with ID starting with 941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851 not found: ID does not exist" Jul 29 15:48:39.708699 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.708628 2567 scope.go:117] "RemoveContainer" containerID="83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f" Jul 29 15:48:39.708845 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.708829 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f"} err="failed to get container status \"83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f\": rpc error: code = NotFound desc = could not find container \"83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f\": container with ID starting with 83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f not found: ID does not exist" Jul 29 15:48:39.708845 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.708845 2567 scope.go:117] "RemoveContainer" containerID="45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56" Jul 29 15:48:39.709052 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.709032 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56"} err="failed to get container status \"45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56\": rpc error: code = NotFound desc = could not find container \"45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56\": container with ID starting with 45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56 not found: ID does not exist" Jul 29 15:48:39.709052 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.709050 2567 scope.go:117] "RemoveContainer" containerID="2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec" Jul 29 15:48:39.709287 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.709271 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec"} err="failed to get container status \"2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec\": rpc error: code = NotFound desc = could not find container \"2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec\": container with ID starting with 2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec not found: ID does not exist" Jul 29 15:48:39.709339 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.709289 2567 scope.go:117] "RemoveContainer" containerID="cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63" Jul 29 15:48:39.709511 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.709493 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63"} err="failed to get container status \"cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63\": rpc error: code = NotFound desc = could not find container \"cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63\": container with ID starting with cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63 not found: ID does not exist" Jul 29 15:48:39.709582 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.709512 2567 scope.go:117] "RemoveContainer" containerID="0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad" Jul 29 15:48:39.709725 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.709710 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad"} err="failed to get container status \"0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad\": rpc error: code = NotFound desc = could not find container \"0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad\": container with ID starting with 0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad not found: ID does not exist" Jul 29 15:48:39.709766 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.709725 2567 scope.go:117] "RemoveContainer" containerID="034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab" Jul 29 15:48:39.709915 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.709901 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab"} err="failed to get container status \"034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab\": rpc error: code = NotFound desc = could not find container \"034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab\": container with ID starting with 034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab not found: ID does not exist" Jul 29 15:48:39.709989 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.709915 2567 scope.go:117] "RemoveContainer" containerID="941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851" Jul 29 15:48:39.710128 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.710113 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851"} err="failed to get container status \"941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851\": rpc error: code = NotFound desc = could not find container \"941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851\": container with ID starting with 941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851 not found: ID does not exist" Jul 29 15:48:39.710168 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.710129 2567 scope.go:117] "RemoveContainer" containerID="83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f" Jul 29 15:48:39.710331 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.710312 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f"} err="failed to get container status \"83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f\": rpc error: code = NotFound desc = could not find container \"83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f\": container with ID starting with 83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f not found: ID does not exist" Jul 29 15:48:39.710374 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.710333 2567 scope.go:117] "RemoveContainer" containerID="45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56" Jul 29 15:48:39.710517 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.710503 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56"} err="failed to get container status \"45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56\": rpc error: code = NotFound desc = could not find container \"45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56\": container with ID starting with 45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56 not found: ID does not exist" Jul 29 15:48:39.710566 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.710518 2567 scope.go:117] "RemoveContainer" containerID="2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec" Jul 29 15:48:39.710675 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.710661 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec"} err="failed to get container status \"2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec\": rpc error: code = NotFound desc = could not find container \"2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec\": container with ID starting with 2dde8b17e52cb4d4fb42f4fd64255473dd129aef66b2957ec32ebd39d7b3e4ec not found: ID does not exist" Jul 29 15:48:39.710713 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.710676 2567 scope.go:117] "RemoveContainer" containerID="cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63" Jul 29 15:48:39.710867 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.710852 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63"} err="failed to get container status \"cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63\": rpc error: code = NotFound desc = could not find container \"cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63\": container with ID starting with cb08b091d13c751f93f762bb187e18e2fe75f9c6b03e8a4b5166d299e9907e63 not found: ID does not exist" Jul 29 15:48:39.710912 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.710868 2567 scope.go:117] "RemoveContainer" containerID="0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad" Jul 29 15:48:39.711094 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.711075 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad"} err="failed to get container status \"0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad\": rpc error: code = NotFound desc = could not find container \"0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad\": container with ID starting with 0a57faf26e8fe48bed031e80772ea199a9704eaf7ee4fecb08dc994b0d66e7ad not found: ID does not exist" Jul 29 15:48:39.711142 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.711096 2567 scope.go:117] "RemoveContainer" containerID="034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab" Jul 29 15:48:39.711269 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.711254 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab"} err="failed to get container status \"034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab\": rpc error: code = NotFound desc = could not find container \"034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab\": container with ID starting with 034b43df81f91681fe23b1e71b947cfa2367a0377657631973cde339743e13ab not found: ID does not exist" Jul 29 15:48:39.711314 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.711270 2567 scope.go:117] "RemoveContainer" containerID="941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851" Jul 29 15:48:39.711451 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.711433 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851"} err="failed to get container status \"941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851\": rpc error: code = NotFound desc = could not find container \"941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851\": container with ID starting with 941ce91d615ff28ba0aa97073830bb26c5dad7470f05a51485b6f2b35ba69851 not found: ID does not exist" Jul 29 15:48:39.711500 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.711454 2567 scope.go:117] "RemoveContainer" containerID="83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f" Jul 29 15:48:39.711675 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.711658 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f"} err="failed to get container status \"83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f\": rpc error: code = NotFound desc = could not find container \"83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f\": container with ID starting with 83ff840eae4a895b98437750a238b1e5822c8e7b0b50a0285bb839d65f93b89f not found: ID does not exist" Jul 29 15:48:39.711714 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.711676 2567 scope.go:117] "RemoveContainer" containerID="45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56" Jul 29 15:48:39.711871 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.711853 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56"} err="failed to get container status \"45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56\": rpc error: code = NotFound desc = could not find container \"45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56\": container with ID starting with 45b13f7daa503e57f36a78ada7b7d5acbfbc2254a4c2fe9f88be7261728a0f56 not found: ID does not exist" Jul 29 15:48:39.750079 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750044 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 15:48:39.750325 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750313 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerName="prometheus" Jul 29 15:48:39.750373 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750327 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerName="prometheus" Jul 29 15:48:39.750373 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750335 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerName="thanos-sidecar" Jul 29 15:48:39.750373 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750341 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerName="thanos-sidecar" Jul 29 15:48:39.750373 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750347 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerName="config-reloader" Jul 29 15:48:39.750373 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750353 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerName="config-reloader" Jul 29 15:48:39.750373 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750360 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerName="kube-rbac-proxy" Jul 29 15:48:39.750373 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750367 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerName="kube-rbac-proxy" Jul 29 15:48:39.750373 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750372 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerName="kube-rbac-proxy-thanos" Jul 29 15:48:39.750591 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750378 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerName="kube-rbac-proxy-thanos" Jul 29 15:48:39.750591 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750387 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerName="kube-rbac-proxy-web" Jul 29 15:48:39.750591 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750392 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerName="kube-rbac-proxy-web" Jul 29 15:48:39.750591 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750398 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerName="init-config-reloader" Jul 29 15:48:39.750591 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750404 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerName="init-config-reloader" Jul 29 15:48:39.750591 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750412 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerName="alertmanager" Jul 29 15:48:39.750591 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750416 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerName="alertmanager" Jul 29 15:48:39.750591 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750425 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerName="init-config-reloader" Jul 29 15:48:39.750591 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750431 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerName="init-config-reloader" Jul 29 15:48:39.750591 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750437 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerName="prom-label-proxy" Jul 29 15:48:39.750591 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750442 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerName="prom-label-proxy" Jul 29 15:48:39.750591 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750448 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerName="kube-rbac-proxy-web" Jul 29 15:48:39.750591 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750453 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerName="kube-rbac-proxy-web" Jul 29 15:48:39.750591 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750459 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerName="kube-rbac-proxy-metric" Jul 29 15:48:39.750591 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750464 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerName="kube-rbac-proxy-metric" Jul 29 15:48:39.750591 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750472 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerName="config-reloader" Jul 29 15:48:39.750591 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750478 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerName="config-reloader" Jul 29 15:48:39.750591 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750485 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerName="kube-rbac-proxy" Jul 29 15:48:39.750591 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750490 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerName="kube-rbac-proxy" Jul 29 15:48:39.750591 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750530 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerName="kube-rbac-proxy" Jul 29 15:48:39.750591 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750536 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerName="config-reloader" Jul 29 15:48:39.750591 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750541 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerName="kube-rbac-proxy" Jul 29 15:48:39.750591 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750548 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerName="kube-rbac-proxy-web" Jul 29 15:48:39.750591 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750552 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerName="kube-rbac-proxy-metric" Jul 29 15:48:39.750591 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750557 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerName="thanos-sidecar" Jul 29 15:48:39.750591 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750563 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerName="prometheus" Jul 29 15:48:39.750591 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750567 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerName="prom-label-proxy" Jul 29 15:48:39.750591 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750573 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerName="alertmanager" Jul 29 15:48:39.750591 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750578 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerName="config-reloader" Jul 29 15:48:39.750591 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750582 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="636a0c3c-df7e-4299-a14e-a5f9309cf558" containerName="kube-rbac-proxy-web" Jul 29 15:48:39.750591 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.750587 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" containerName="kube-rbac-proxy-thanos" Jul 29 15:48:39.754236 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.754221 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.756672 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.756645 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 29 15:48:39.756672 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.756661 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 29 15:48:39.756860 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.756673 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 29 15:48:39.756860 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.756756 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 29 15:48:39.756860 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.756756 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1iusr146uk5ku\"" Jul 29 15:48:39.756860 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.756673 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 29 15:48:39.757078 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.757044 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 29 15:48:39.757078 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.757053 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 29 15:48:39.757168 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.757082 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 29 15:48:39.757168 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.757151 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qphcj\"" Jul 29 15:48:39.757249 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.757186 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 29 15:48:39.757546 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.757526 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 29 15:48:39.757672 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.757573 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 29 15:48:39.758409 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.758390 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 29 15:48:39.760999 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.760977 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 29 15:48:39.767724 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.767653 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 29 15:48:39.773985 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.773961 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 15:48:39.884921 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.884879 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.884921 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.884922 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.885147 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.885025 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.885147 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.885056 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.885147 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.885073 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.885147 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.885093 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2qff\" (UniqueName: \"kubernetes.io/projected/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-kube-api-access-x2qff\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.885147 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.885131 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-config\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.885296 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.885154 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.885296 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.885171 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.885296 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.885189 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.885296 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.885229 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.885296 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.885246 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.885296 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.885269 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-web-config\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.885476 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.885300 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.885476 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.885325 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.885476 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.885354 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.885476 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.885396 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.885476 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.885431 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-config-out\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.885476 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.885457 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.885476 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.885472 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.986048 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.986012 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.986048 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.986047 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-web-config\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.986239 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.986064 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.986239 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.986089 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.986239 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.986135 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.986239 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.986176 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.986239 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.986210 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-config-out\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.986911 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.986246 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.986911 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.986271 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.986911 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.986312 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.986911 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.986338 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.986911 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.986381 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.986911 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.986408 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.986911 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.986430 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.986911 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.986462 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2qff\" (UniqueName: \"kubernetes.io/projected/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-kube-api-access-x2qff\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.986911 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.986491 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-config\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.986911 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.986517 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.986911 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.986540 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.986911 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.986568 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.986911 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.986576 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.986911 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.986617 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.986911 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.986838 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.987801 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.986922 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.987801 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.987282 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.989866 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.989575 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-web-config\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.989866 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.989668 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.989866 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.989788 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.989866 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.989794 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.989866 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.989791 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.990204 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.989912 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-config\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.990204 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.990046 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.990811 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.990744 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.990811 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.990777 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-config-out\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.991245 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.991218 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.991734 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.991710 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.992358 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.992336 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.992547 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.992530 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.992691 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.992675 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.992835 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.992817 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:39.997842 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:39.997822 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2qff\" (UniqueName: \"kubernetes.io/projected/10fd4a51-6063-4d04-91f3-5fb52fa90c9e-kube-api-access-x2qff\") pod \"prometheus-k8s-0\" (UID: \"10fd4a51-6063-4d04-91f3-5fb52fa90c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:40.065117 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:40.065077 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:48:40.202889 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:40.202852 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 15:48:40.206495 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:48:40.206458 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10fd4a51_6063_4d04_91f3_5fb52fa90c9e.slice/crio-91a5cdd046020246e665bb52ffa74d7aed4b0bb9f82c523eb4c7a71f1865fd44 WatchSource:0}: Error finding container 91a5cdd046020246e665bb52ffa74d7aed4b0bb9f82c523eb4c7a71f1865fd44: Status 404 returned error can't find the container with id 91a5cdd046020246e665bb52ffa74d7aed4b0bb9f82c523eb4c7a71f1865fd44 Jul 29 15:48:40.656021 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:40.655918 2567 generic.go:356] "Generic (PLEG): container finished" podID="10fd4a51-6063-4d04-91f3-5fb52fa90c9e" containerID="27a6ed8de3bbadbe7abf5049cbc57e7a01966d60b71747df88e860c727906cb2" exitCode=0 Jul 29 15:48:40.656021 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:40.656006 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10fd4a51-6063-4d04-91f3-5fb52fa90c9e","Type":"ContainerDied","Data":"27a6ed8de3bbadbe7abf5049cbc57e7a01966d60b71747df88e860c727906cb2"} Jul 29 15:48:40.656186 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:40.656070 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10fd4a51-6063-4d04-91f3-5fb52fa90c9e","Type":"ContainerStarted","Data":"91a5cdd046020246e665bb52ffa74d7aed4b0bb9f82c523eb4c7a71f1865fd44"} Jul 29 15:48:40.834404 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:40.834373 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="323b7c13-70d3-47d8-90d3-f2e7da6e0d6f" path="/var/lib/kubelet/pods/323b7c13-70d3-47d8-90d3-f2e7da6e0d6f/volumes" Jul 29 15:48:41.662699 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:41.662663 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10fd4a51-6063-4d04-91f3-5fb52fa90c9e","Type":"ContainerStarted","Data":"c85e8fb35e4694f64e067bc062f83df4d7c272676aee50975afe078dcd36da8b"} Jul 29 15:48:41.662868 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:41.662744 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10fd4a51-6063-4d04-91f3-5fb52fa90c9e","Type":"ContainerStarted","Data":"3b57b4fd981774b1bad9fd50f6ab7acd1c493b99a49acb3efe40e96f5ff02460"} Jul 29 15:48:41.662868 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:41.662793 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10fd4a51-6063-4d04-91f3-5fb52fa90c9e","Type":"ContainerStarted","Data":"594dfb665f14e16617526ba0b934fe69cbb0c99d6d248c1f2d560f6a3c744a5a"} Jul 29 15:48:41.662868 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:41.662828 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10fd4a51-6063-4d04-91f3-5fb52fa90c9e","Type":"ContainerStarted","Data":"337a15eb71ed78acb102326eefc0f2fda7b566b3af358d2b9112a30bba45ce5e"} Jul 29 15:48:41.662868 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:41.662863 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10fd4a51-6063-4d04-91f3-5fb52fa90c9e","Type":"ContainerStarted","Data":"c3f8beeb2d465d5c8161ea1c0b46c1e19452235954e7ca1d66027f433d0e007c"} Jul 29 15:48:41.663020 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:41.662898 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10fd4a51-6063-4d04-91f3-5fb52fa90c9e","Type":"ContainerStarted","Data":"ae3c61e39c1bd3fd743caf16f2cb802e7ccf43d1a964c966bc9fff4110e3d76e"} Jul 29 15:48:41.692148 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:41.692101 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.674511242 podStartE2EDuration="2.692079175s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.567933ms" isStatefulPod=false podCreationTimestamp="2026-07-29 15:48:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:48:41.690625528 +0000 UTC m=+171.373708866" watchObservedRunningTime="2026-07-29 15:48:41.692079175 +0000 UTC m=+171.375162471" Jul 29 15:48:45.065728 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:48:45.065676 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:40.065552 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:49:40.065504 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:40.081393 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:49:40.081371 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:49:40.893481 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:49:40.893455 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:50:15.208277 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:50:15.208195 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-l4w7n"] Jul 29 15:50:15.210203 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:50:15.210187 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-l4w7n" Jul 29 15:50:15.212053 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:50:15.212030 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-5q2bd\"" Jul 29 15:50:15.212163 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:50:15.212064 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 29 15:50:15.212424 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:50:15.212407 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 29 15:50:15.220692 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:50:15.220669 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-l4w7n"] Jul 29 15:50:15.262720 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:50:15.262681 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/628a90fc-f6c1-422d-9277-d3b39e86d0c2-bound-sa-token\") pod \"cert-manager-55b4d954d5-l4w7n\" (UID: \"628a90fc-f6c1-422d-9277-d3b39e86d0c2\") " pod="cert-manager/cert-manager-55b4d954d5-l4w7n" Jul 29 15:50:15.262896 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:50:15.262735 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nv27\" (UniqueName: \"kubernetes.io/projected/628a90fc-f6c1-422d-9277-d3b39e86d0c2-kube-api-access-6nv27\") pod \"cert-manager-55b4d954d5-l4w7n\" (UID: \"628a90fc-f6c1-422d-9277-d3b39e86d0c2\") " pod="cert-manager/cert-manager-55b4d954d5-l4w7n" Jul 29 15:50:15.363513 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:50:15.363476 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/628a90fc-f6c1-422d-9277-d3b39e86d0c2-bound-sa-token\") pod \"cert-manager-55b4d954d5-l4w7n\" (UID: \"628a90fc-f6c1-422d-9277-d3b39e86d0c2\") " pod="cert-manager/cert-manager-55b4d954d5-l4w7n" Jul 29 15:50:15.363671 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:50:15.363527 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nv27\" (UniqueName: \"kubernetes.io/projected/628a90fc-f6c1-422d-9277-d3b39e86d0c2-kube-api-access-6nv27\") pod \"cert-manager-55b4d954d5-l4w7n\" (UID: \"628a90fc-f6c1-422d-9277-d3b39e86d0c2\") " pod="cert-manager/cert-manager-55b4d954d5-l4w7n" Jul 29 15:50:15.374411 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:50:15.374381 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nv27\" (UniqueName: \"kubernetes.io/projected/628a90fc-f6c1-422d-9277-d3b39e86d0c2-kube-api-access-6nv27\") pod \"cert-manager-55b4d954d5-l4w7n\" (UID: \"628a90fc-f6c1-422d-9277-d3b39e86d0c2\") " pod="cert-manager/cert-manager-55b4d954d5-l4w7n" Jul 29 15:50:15.375280 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:50:15.375259 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/628a90fc-f6c1-422d-9277-d3b39e86d0c2-bound-sa-token\") pod \"cert-manager-55b4d954d5-l4w7n\" (UID: \"628a90fc-f6c1-422d-9277-d3b39e86d0c2\") " pod="cert-manager/cert-manager-55b4d954d5-l4w7n" Jul 29 15:50:15.519598 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:50:15.519521 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-l4w7n" Jul 29 15:50:15.653119 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:50:15.653068 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-l4w7n"] Jul 29 15:50:15.655247 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:50:15.655220 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod628a90fc_f6c1_422d_9277_d3b39e86d0c2.slice/crio-ee2051eb075ac54fecb9eeb5b7e613fd662c5af954e99b070424e15cec8cc26c WatchSource:0}: Error finding container ee2051eb075ac54fecb9eeb5b7e613fd662c5af954e99b070424e15cec8cc26c: Status 404 returned error can't find the container with id ee2051eb075ac54fecb9eeb5b7e613fd662c5af954e99b070424e15cec8cc26c Jul 29 15:50:16.008694 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:50:16.008645 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-l4w7n" event={"ID":"628a90fc-f6c1-422d-9277-d3b39e86d0c2","Type":"ContainerStarted","Data":"ee2051eb075ac54fecb9eeb5b7e613fd662c5af954e99b070424e15cec8cc26c"} Jul 29 15:50:19.023018 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:50:19.022988 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-l4w7n" event={"ID":"628a90fc-f6c1-422d-9277-d3b39e86d0c2","Type":"ContainerStarted","Data":"7b40847e95712ca02565c311d0bbaac440554bce9c720fc8b62193829a06b5a8"} Jul 29 15:50:19.040129 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:50:19.040078 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-l4w7n" podStartSLOduration=1.093974811 podStartE2EDuration="4.040059789s" totalImagesPullingTime="2.946084978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:50:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:50:19.038289177 +0000 UTC m=+268.721372461" watchObservedRunningTime="2026-07-29 15:50:19.040059789 +0000 UTC m=+268.723143082" Jul 29 15:50:50.644881 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:50:50.644844 2567 kubelet.go:1648] "Image garbage collection succeeded" Jul 29 15:52:47.838580 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:52:47.838548 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-9h9k8"] Jul 29 15:52:47.841721 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:52:47.841706 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-9h9k8" Jul 29 15:52:47.843727 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:52:47.843695 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 29 15:52:47.844189 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:52:47.844173 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 29 15:52:47.844270 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:52:47.844198 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-z9f9c\"" Jul 29 15:52:47.852513 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:52:47.852493 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-9h9k8"] Jul 29 15:52:48.011108 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:52:48.011072 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wbf8\" (UniqueName: \"kubernetes.io/projected/2f3e8722-355b-4b0a-ac76-59892864e999-kube-api-access-9wbf8\") pod \"test-trainjob-workflow-node-0-0-9h9k8\" (UID: \"2f3e8722-355b-4b0a-ac76-59892864e999\") " pod="opendatahub/test-trainjob-workflow-node-0-0-9h9k8" Jul 29 15:52:48.111739 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:52:48.111639 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wbf8\" (UniqueName: \"kubernetes.io/projected/2f3e8722-355b-4b0a-ac76-59892864e999-kube-api-access-9wbf8\") pod \"test-trainjob-workflow-node-0-0-9h9k8\" (UID: \"2f3e8722-355b-4b0a-ac76-59892864e999\") " pod="opendatahub/test-trainjob-workflow-node-0-0-9h9k8" Jul 29 15:52:48.121447 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:52:48.121411 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wbf8\" (UniqueName: \"kubernetes.io/projected/2f3e8722-355b-4b0a-ac76-59892864e999-kube-api-access-9wbf8\") pod \"test-trainjob-workflow-node-0-0-9h9k8\" (UID: \"2f3e8722-355b-4b0a-ac76-59892864e999\") " pod="opendatahub/test-trainjob-workflow-node-0-0-9h9k8" Jul 29 15:52:48.150324 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:52:48.150284 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-9h9k8" Jul 29 15:52:48.278810 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:52:48.278630 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-9h9k8"] Jul 29 15:52:48.281480 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:52:48.281456 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f3e8722_355b_4b0a_ac76_59892864e999.slice/crio-db736ae0d1877fb2a5fb95ca47b24ee3fd4dbfe32d55d52f33c552e5339ea8e3 WatchSource:0}: Error finding container db736ae0d1877fb2a5fb95ca47b24ee3fd4dbfe32d55d52f33c552e5339ea8e3: Status 404 returned error can't find the container with id db736ae0d1877fb2a5fb95ca47b24ee3fd4dbfe32d55d52f33c552e5339ea8e3 Jul 29 15:52:48.283491 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:52:48.283478 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 15:52:48.567692 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:52:48.567655 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-9h9k8" event={"ID":"2f3e8722-355b-4b0a-ac76-59892864e999","Type":"ContainerStarted","Data":"db736ae0d1877fb2a5fb95ca47b24ee3fd4dbfe32d55d52f33c552e5339ea8e3"} Jul 29 15:53:59.903150 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:53:59.903109 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-9h9k8" event={"ID":"2f3e8722-355b-4b0a-ac76-59892864e999","Type":"ContainerStarted","Data":"cff93bde569350c35e72b1e04a65204b2d96ba4869087332b22936c533873444"} Jul 29 15:53:59.925097 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:53:59.925038 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-trainjob-workflow-node-0-0-9h9k8" podStartSLOduration=2.0505847680000002 podStartE2EDuration="1m12.925021301s" totalImagesPullingTime="1m10.874436533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:52:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:53:59.923036009 +0000 UTC m=+489.606119303" watchObservedRunningTime="2026-07-29 15:53:59.925021301 +0000 UTC m=+489.608104665" Jul 29 15:54:01.912332 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:54:01.912303 2567 generic.go:356] "Generic (PLEG): container finished" podID="2f3e8722-355b-4b0a-ac76-59892864e999" containerID="cff93bde569350c35e72b1e04a65204b2d96ba4869087332b22936c533873444" exitCode=0 Jul 29 15:54:01.912729 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:54:01.912374 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-9h9k8" event={"ID":"2f3e8722-355b-4b0a-ac76-59892864e999","Type":"ContainerDied","Data":"cff93bde569350c35e72b1e04a65204b2d96ba4869087332b22936c533873444"} Jul 29 15:54:03.061046 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:54:03.061018 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-9h9k8" Jul 29 15:54:03.198996 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:54:03.198961 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wbf8\" (UniqueName: \"kubernetes.io/projected/2f3e8722-355b-4b0a-ac76-59892864e999-kube-api-access-9wbf8\") pod \"2f3e8722-355b-4b0a-ac76-59892864e999\" (UID: \"2f3e8722-355b-4b0a-ac76-59892864e999\") " Jul 29 15:54:03.201346 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:54:03.201321 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f3e8722-355b-4b0a-ac76-59892864e999-kube-api-access-9wbf8" (OuterVolumeSpecName: "kube-api-access-9wbf8") pod "2f3e8722-355b-4b0a-ac76-59892864e999" (UID: "2f3e8722-355b-4b0a-ac76-59892864e999"). InnerVolumeSpecName "kube-api-access-9wbf8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:54:03.299711 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:54:03.299673 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wbf8\" (UniqueName: \"kubernetes.io/projected/2f3e8722-355b-4b0a-ac76-59892864e999-kube-api-access-9wbf8\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jul 29 15:54:03.926489 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:54:03.926440 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-9h9k8" event={"ID":"2f3e8722-355b-4b0a-ac76-59892864e999","Type":"ContainerDied","Data":"db736ae0d1877fb2a5fb95ca47b24ee3fd4dbfe32d55d52f33c552e5339ea8e3"} Jul 29 15:54:03.926739 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:54:03.926496 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db736ae0d1877fb2a5fb95ca47b24ee3fd4dbfe32d55d52f33c552e5339ea8e3" Jul 29 15:54:03.926739 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:54:03.926468 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-9h9k8" Jul 29 15:54:05.067318 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:54:05.067289 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-9h9k8"] Jul 29 15:54:05.072326 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:54:05.072301 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-9h9k8"] Jul 29 15:54:06.833895 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:54:06.833861 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f3e8722-355b-4b0a-ac76-59892864e999" path="/var/lib/kubelet/pods/2f3e8722-355b-4b0a-ac76-59892864e999/volumes" Jul 29 15:55:01.782885 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:01.782806 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g66fj/must-gather-kj4zd"] Jul 29 15:55:01.783358 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:01.783103 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f3e8722-355b-4b0a-ac76-59892864e999" containerName="node" Jul 29 15:55:01.783358 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:01.783115 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f3e8722-355b-4b0a-ac76-59892864e999" containerName="node" Jul 29 15:55:01.783358 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:01.783171 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f3e8722-355b-4b0a-ac76-59892864e999" containerName="node" Jul 29 15:55:01.785089 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:01.785067 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g66fj/must-gather-kj4zd" Jul 29 15:55:01.789483 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:01.789432 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g66fj\"/\"kube-root-ca.crt\"" Jul 29 15:55:01.789691 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:01.789668 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-g66fj\"/\"default-dockercfg-4n6cj\"" Jul 29 15:55:01.789869 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:01.789668 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g66fj\"/\"openshift-service-ca.crt\"" Jul 29 15:55:01.797425 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:01.797401 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g66fj/must-gather-kj4zd"] Jul 29 15:55:01.886114 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:01.886067 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a6798407-ed98-409d-b653-998a2816f9d2-must-gather-output\") pod \"must-gather-kj4zd\" (UID: \"a6798407-ed98-409d-b653-998a2816f9d2\") " pod="openshift-must-gather-g66fj/must-gather-kj4zd" Jul 29 15:55:01.886114 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:01.886127 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfqcl\" (UniqueName: \"kubernetes.io/projected/a6798407-ed98-409d-b653-998a2816f9d2-kube-api-access-tfqcl\") pod \"must-gather-kj4zd\" (UID: \"a6798407-ed98-409d-b653-998a2816f9d2\") " pod="openshift-must-gather-g66fj/must-gather-kj4zd" Jul 29 15:55:01.987012 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:01.986980 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a6798407-ed98-409d-b653-998a2816f9d2-must-gather-output\") pod \"must-gather-kj4zd\" (UID: \"a6798407-ed98-409d-b653-998a2816f9d2\") " pod="openshift-must-gather-g66fj/must-gather-kj4zd" Jul 29 15:55:01.987187 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:01.987029 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfqcl\" (UniqueName: \"kubernetes.io/projected/a6798407-ed98-409d-b653-998a2816f9d2-kube-api-access-tfqcl\") pod \"must-gather-kj4zd\" (UID: \"a6798407-ed98-409d-b653-998a2816f9d2\") " pod="openshift-must-gather-g66fj/must-gather-kj4zd" Jul 29 15:55:01.987312 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:01.987292 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a6798407-ed98-409d-b653-998a2816f9d2-must-gather-output\") pod \"must-gather-kj4zd\" (UID: \"a6798407-ed98-409d-b653-998a2816f9d2\") " pod="openshift-must-gather-g66fj/must-gather-kj4zd" Jul 29 15:55:01.995095 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:01.995071 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfqcl\" (UniqueName: \"kubernetes.io/projected/a6798407-ed98-409d-b653-998a2816f9d2-kube-api-access-tfqcl\") pod \"must-gather-kj4zd\" (UID: \"a6798407-ed98-409d-b653-998a2816f9d2\") " pod="openshift-must-gather-g66fj/must-gather-kj4zd" Jul 29 15:55:02.094295 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:02.094180 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g66fj/must-gather-kj4zd" Jul 29 15:55:02.230076 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:02.230050 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g66fj/must-gather-kj4zd"] Jul 29 15:55:02.232621 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:55:02.232595 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6798407_ed98_409d_b653_998a2816f9d2.slice/crio-30a60769b9883424ac8c191ce7ed03915d505834e14f3e7ea97c7dc3e6e087c8 WatchSource:0}: Error finding container 30a60769b9883424ac8c191ce7ed03915d505834e14f3e7ea97c7dc3e6e087c8: Status 404 returned error can't find the container with id 30a60769b9883424ac8c191ce7ed03915d505834e14f3e7ea97c7dc3e6e087c8 Jul 29 15:55:03.153667 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:03.153609 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g66fj/must-gather-kj4zd" event={"ID":"a6798407-ed98-409d-b653-998a2816f9d2","Type":"ContainerStarted","Data":"30a60769b9883424ac8c191ce7ed03915d505834e14f3e7ea97c7dc3e6e087c8"} Jul 29 15:55:04.159752 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:04.159712 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g66fj/must-gather-kj4zd" event={"ID":"a6798407-ed98-409d-b653-998a2816f9d2","Type":"ContainerStarted","Data":"d8e448d2d9d84b32be9bd7e15f3949e2c6f771a605ee6a15f158553ee88a6d1b"} Jul 29 15:55:04.160274 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:04.159761 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g66fj/must-gather-kj4zd" event={"ID":"a6798407-ed98-409d-b653-998a2816f9d2","Type":"ContainerStarted","Data":"6b427ca9c352478aff6c14a94312f89d722ec5865cb2c34f30ad94742223c8d1"} Jul 29 15:55:04.177044 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:04.176974 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-g66fj/must-gather-kj4zd" podStartSLOduration=2.293573725 podStartE2EDuration="3.17695337s" totalImagesPullingTime="883.379645ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:55:04.175143907 +0000 UTC m=+553.858227207" watchObservedRunningTime="2026-07-29 15:55:04.17695337 +0000 UTC m=+553.860036662" Jul 29 15:55:04.510455 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:04.510424 2567 ???:1] "http2: server: error reading preface from client 10.0.142.124:32812: read tcp 10.0.142.124:10250->10.0.142.124:32812: read: connection reset by peer" Jul 29 15:55:04.512623 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:04.512595 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-26xnp_fe75348c-40b9-462d-8e9e-644aed841fae/global-pull-secret-syncer/0.log" Jul 29 15:55:04.670201 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:04.670170 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tqjbj_c1f386b0-39d7-4422-98d7-b62d212d6b62/konnectivity-agent/0.log" Jul 29 15:55:04.771552 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:04.771457 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-124.ec2.internal_834e29422605a4563abd0c2b2da8dece/haproxy/0.log" Jul 29 15:55:08.996316 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:08.996291 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-d9976ff44-nf2q8_4b4cbe1a-05fd-405d-94ab-25975ee836e3/metrics-server/0.log" Jul 29 15:55:09.141393 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:09.141361 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q2j8t_01ec4c57-f450-43e8-a2af-d6175efa9f8d/node-exporter/0.log" Jul 29 15:55:09.172468 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:09.172434 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q2j8t_01ec4c57-f450-43e8-a2af-d6175efa9f8d/kube-rbac-proxy/0.log" Jul 29 15:55:09.195870 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:09.195840 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q2j8t_01ec4c57-f450-43e8-a2af-d6175efa9f8d/init-textfile/0.log" Jul 29 15:55:09.306878 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:09.306790 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-zx86l_a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12/kube-rbac-proxy-main/0.log" Jul 29 15:55:09.336860 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:09.336832 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-zx86l_a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12/kube-rbac-proxy-self/0.log" Jul 29 15:55:09.362387 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:09.362360 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-zx86l_a8ba27b1-cd7c-47b3-9fba-7d6ea27fcc12/openshift-state-metrics/0.log" Jul 29 15:55:09.413696 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:09.413668 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_10fd4a51-6063-4d04-91f3-5fb52fa90c9e/prometheus/0.log" Jul 29 15:55:09.439517 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:09.439485 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_10fd4a51-6063-4d04-91f3-5fb52fa90c9e/config-reloader/0.log" Jul 29 15:55:09.463032 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:09.463004 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_10fd4a51-6063-4d04-91f3-5fb52fa90c9e/thanos-sidecar/0.log" Jul 29 15:55:09.489317 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:09.489286 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_10fd4a51-6063-4d04-91f3-5fb52fa90c9e/kube-rbac-proxy-web/0.log" Jul 29 15:55:09.512240 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:09.512216 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_10fd4a51-6063-4d04-91f3-5fb52fa90c9e/kube-rbac-proxy/0.log" Jul 29 15:55:09.537342 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:09.537319 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_10fd4a51-6063-4d04-91f3-5fb52fa90c9e/kube-rbac-proxy-thanos/0.log" Jul 29 15:55:09.563718 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:09.563617 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_10fd4a51-6063-4d04-91f3-5fb52fa90c9e/init-config-reloader/0.log" Jul 29 15:55:09.656365 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:09.656340 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-xjwqd_449fc1ec-714f-47d3-9ca0-1b5491e6cc22/prometheus-operator-admission-webhook/0.log" Jul 29 15:55:11.985770 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:11.985739 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g66fj/perf-node-gather-daemonset-7lhsk"] Jul 29 15:55:11.992130 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:11.992106 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g66fj/perf-node-gather-daemonset-7lhsk" Jul 29 15:55:12.001332 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:12.001297 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g66fj/perf-node-gather-daemonset-7lhsk"] Jul 29 15:55:12.080582 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:12.080545 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53-proc\") pod \"perf-node-gather-daemonset-7lhsk\" (UID: \"bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53\") " pod="openshift-must-gather-g66fj/perf-node-gather-daemonset-7lhsk" Jul 29 15:55:12.080842 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:12.080819 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53-podres\") pod \"perf-node-gather-daemonset-7lhsk\" (UID: \"bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53\") " pod="openshift-must-gather-g66fj/perf-node-gather-daemonset-7lhsk" Jul 29 15:55:12.080980 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:12.080856 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmtfs\" (UniqueName: \"kubernetes.io/projected/bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53-kube-api-access-kmtfs\") pod \"perf-node-gather-daemonset-7lhsk\" (UID: \"bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53\") " pod="openshift-must-gather-g66fj/perf-node-gather-daemonset-7lhsk" Jul 29 15:55:12.081055 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:12.080982 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53-lib-modules\") pod \"perf-node-gather-daemonset-7lhsk\" (UID: \"bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53\") " pod="openshift-must-gather-g66fj/perf-node-gather-daemonset-7lhsk" Jul 29 15:55:12.081055 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:12.081041 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53-sys\") pod \"perf-node-gather-daemonset-7lhsk\" (UID: \"bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53\") " pod="openshift-must-gather-g66fj/perf-node-gather-daemonset-7lhsk" Jul 29 15:55:12.120397 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:12.120371 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-sjzh6_626c1714-32b2-4f61-aa50-c49fb1f2bfe0/download-server/0.log" Jul 29 15:55:12.182032 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:12.181993 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53-lib-modules\") pod \"perf-node-gather-daemonset-7lhsk\" (UID: \"bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53\") " pod="openshift-must-gather-g66fj/perf-node-gather-daemonset-7lhsk" Jul 29 15:55:12.182285 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:12.182053 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53-sys\") pod \"perf-node-gather-daemonset-7lhsk\" (UID: \"bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53\") " pod="openshift-must-gather-g66fj/perf-node-gather-daemonset-7lhsk" Jul 29 15:55:12.182285 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:12.182114 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53-proc\") pod \"perf-node-gather-daemonset-7lhsk\" (UID: \"bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53\") " pod="openshift-must-gather-g66fj/perf-node-gather-daemonset-7lhsk" Jul 29 15:55:12.182285 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:12.182144 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53-podres\") pod \"perf-node-gather-daemonset-7lhsk\" (UID: \"bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53\") " pod="openshift-must-gather-g66fj/perf-node-gather-daemonset-7lhsk" Jul 29 15:55:12.182285 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:12.182179 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmtfs\" (UniqueName: \"kubernetes.io/projected/bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53-kube-api-access-kmtfs\") pod \"perf-node-gather-daemonset-7lhsk\" (UID: \"bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53\") " pod="openshift-must-gather-g66fj/perf-node-gather-daemonset-7lhsk" Jul 29 15:55:12.182285 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:12.182223 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53-lib-modules\") pod \"perf-node-gather-daemonset-7lhsk\" (UID: \"bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53\") " pod="openshift-must-gather-g66fj/perf-node-gather-daemonset-7lhsk" Jul 29 15:55:12.182578 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:12.182307 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53-podres\") pod \"perf-node-gather-daemonset-7lhsk\" (UID: \"bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53\") " pod="openshift-must-gather-g66fj/perf-node-gather-daemonset-7lhsk" Jul 29 15:55:12.182578 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:12.182392 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53-proc\") pod \"perf-node-gather-daemonset-7lhsk\" (UID: \"bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53\") " pod="openshift-must-gather-g66fj/perf-node-gather-daemonset-7lhsk" Jul 29 15:55:12.182578 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:12.182454 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53-sys\") pod \"perf-node-gather-daemonset-7lhsk\" (UID: \"bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53\") " pod="openshift-must-gather-g66fj/perf-node-gather-daemonset-7lhsk" Jul 29 15:55:12.191831 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:12.191796 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmtfs\" (UniqueName: \"kubernetes.io/projected/bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53-kube-api-access-kmtfs\") pod \"perf-node-gather-daemonset-7lhsk\" (UID: \"bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53\") " pod="openshift-must-gather-g66fj/perf-node-gather-daemonset-7lhsk" Jul 29 15:55:12.308040 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:12.307957 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g66fj/perf-node-gather-daemonset-7lhsk" Jul 29 15:55:12.473010 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:12.472796 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g66fj/perf-node-gather-daemonset-7lhsk"] Jul 29 15:55:12.476263 ip-10-0-142-124 kubenswrapper[2567]: W0729 15:55:12.476236 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbcfd2c0b_fcd1_4d35_bf83_fbcdbd92ac53.slice/crio-780d9606bc2aec48bd6a5c3bf00ee187423cdd2b9ca4467b186caf48c1e2aacc WatchSource:0}: Error finding container 780d9606bc2aec48bd6a5c3bf00ee187423cdd2b9ca4467b186caf48c1e2aacc: Status 404 returned error can't find the container with id 780d9606bc2aec48bd6a5c3bf00ee187423cdd2b9ca4467b186caf48c1e2aacc Jul 29 15:55:13.208077 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:13.208042 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g66fj/perf-node-gather-daemonset-7lhsk" event={"ID":"bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53","Type":"ContainerStarted","Data":"82559b20b0c5d228304f6821c913be78e3ede7429e4d686d7490293462692aa2"} Jul 29 15:55:13.208657 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:13.208628 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g66fj/perf-node-gather-daemonset-7lhsk" event={"ID":"bcfd2c0b-fcd1-4d35-bf83-fbcdbd92ac53","Type":"ContainerStarted","Data":"780d9606bc2aec48bd6a5c3bf00ee187423cdd2b9ca4467b186caf48c1e2aacc"} Jul 29 15:55:13.208970 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:13.208928 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-g66fj/perf-node-gather-daemonset-7lhsk" Jul 29 15:55:13.519305 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:13.519230 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8lkvv_9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b/dns/0.log" Jul 29 15:55:13.541739 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:13.541712 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8lkvv_9bfe7a82-6a4d-4bc7-9a05-b7b42ccf9c3b/kube-rbac-proxy/0.log" Jul 29 15:55:13.656813 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:13.656788 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f9hnm_4dcf8deb-1079-4f6f-9ae9-e0d84870c960/dns-node-resolver/0.log" Jul 29 15:55:14.136447 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:14.136424 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7cc4c4f75c-jp5jj_b12eb6e7-0ceb-4ccd-a52e-52d944d53551/registry/0.log" Jul 29 15:55:14.184251 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:14.184225 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-crwhp_70b633f9-e025-4576-a729-be5ebb65658e/node-ca/0.log" Jul 29 15:55:15.268286 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:15.268258 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6tw4d_c2010b07-9481-44e2-83d2-041556d8c913/serve-healthcheck-canary/0.log" Jul 29 15:55:15.759449 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:15.759425 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lgb2h_7d2163b3-00f3-4ff6-8b0f-66c8706f8614/kube-rbac-proxy/0.log" Jul 29 15:55:15.779783 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:15.779757 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lgb2h_7d2163b3-00f3-4ff6-8b0f-66c8706f8614/exporter/0.log" Jul 29 15:55:15.799784 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:15.799756 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lgb2h_7d2163b3-00f3-4ff6-8b0f-66c8706f8614/extractor/0.log" Jul 29 15:55:19.225775 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:19.224903 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-g66fj/perf-node-gather-daemonset-7lhsk" Jul 29 15:55:19.243092 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:19.243040 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-g66fj/perf-node-gather-daemonset-7lhsk" podStartSLOduration=8.243022662 podStartE2EDuration="8.243022662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:55:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:55:13.238121827 +0000 UTC m=+562.921205147" watchObservedRunningTime="2026-07-29 15:55:19.243022662 +0000 UTC m=+568.926105955" Jul 29 15:55:20.767169 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:20.767142 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-njm82_5c955d50-e915-4254-8574-c95022df6c85/migrator/0.log" Jul 29 15:55:20.790436 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:20.790398 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-njm82_5c955d50-e915-4254-8574-c95022df6c85/graceful-termination/0.log" Jul 29 15:55:22.451685 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:22.451662 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xvdkk_0bd89f55-5065-499c-a550-d7b6f62acb1f/kube-multus-additional-cni-plugins/0.log" Jul 29 15:55:22.477351 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:22.477329 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xvdkk_0bd89f55-5065-499c-a550-d7b6f62acb1f/egress-router-binary-copy/0.log" Jul 29 15:55:22.499231 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:22.499207 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xvdkk_0bd89f55-5065-499c-a550-d7b6f62acb1f/cni-plugins/0.log" Jul 29 15:55:22.522151 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:22.522128 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xvdkk_0bd89f55-5065-499c-a550-d7b6f62acb1f/bond-cni-plugin/0.log" Jul 29 15:55:22.546821 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:22.546790 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xvdkk_0bd89f55-5065-499c-a550-d7b6f62acb1f/routeoverride-cni/0.log" Jul 29 15:55:22.570746 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:22.570716 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xvdkk_0bd89f55-5065-499c-a550-d7b6f62acb1f/whereabouts-cni-bincopy/0.log" Jul 29 15:55:22.593064 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:22.593030 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xvdkk_0bd89f55-5065-499c-a550-d7b6f62acb1f/whereabouts-cni/0.log" Jul 29 15:55:22.689864 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:22.689839 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xm7ph_06c8dbb9-0046-48c8-a509-07078d3e19e2/kube-multus/0.log" Jul 29 15:55:22.768905 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:22.768877 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dj58l_c5d6572b-df40-46ac-80aa-e62fb0eae0a8/network-metrics-daemon/0.log" Jul 29 15:55:22.795414 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:22.795367 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dj58l_c5d6572b-df40-46ac-80aa-e62fb0eae0a8/kube-rbac-proxy/0.log" Jul 29 15:55:23.896454 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:23.896428 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7svn_f2281802-4f4b-495b-8bca-8cc371df6eec/ovn-controller/0.log" Jul 29 15:55:23.923333 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:23.923308 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7svn_f2281802-4f4b-495b-8bca-8cc371df6eec/ovn-acl-logging/0.log" Jul 29 15:55:23.954199 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:23.954174 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7svn_f2281802-4f4b-495b-8bca-8cc371df6eec/kube-rbac-proxy-node/0.log" Jul 29 15:55:23.985003 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:23.984976 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7svn_f2281802-4f4b-495b-8bca-8cc371df6eec/kube-rbac-proxy-ovn-metrics/0.log" Jul 29 15:55:24.035036 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:24.035007 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7svn_f2281802-4f4b-495b-8bca-8cc371df6eec/northd/0.log" Jul 29 15:55:24.078512 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:24.078480 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7svn_f2281802-4f4b-495b-8bca-8cc371df6eec/nbdb/0.log" Jul 29 15:55:24.117835 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:24.117787 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7svn_f2281802-4f4b-495b-8bca-8cc371df6eec/sbdb/0.log" Jul 29 15:55:24.200571 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:24.200539 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7svn_f2281802-4f4b-495b-8bca-8cc371df6eec/ovnkube-controller/0.log" Jul 29 15:55:25.654034 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:25.653989 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-94h8p_b7346e04-c640-4552-832b-a57e1b0d9998/network-check-target-container/0.log" Jul 29 15:55:26.669496 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:26.669472 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-cwkkf_3c2416e5-3e11-42e8-95d5-93fc1b266d71/iptables-alerter/0.log" Jul 29 15:55:27.366179 ip-10-0-142-124 kubenswrapper[2567]: I0729 15:55:27.366148 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-gkb9q_d91f80fe-f4fa-4484-9244-c520bc696460/tuned/0.log"