Jul 29 16:04:32.386235 ip-10-0-129-212 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 29 16:04:32.386247 ip-10-0-129-212 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 29 16:04:32.386253 ip-10-0-129-212 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 29 16:04:32.386602 ip-10-0-129-212 systemd[1]: Failed to start Kubernetes Kubelet. Jul 29 16:04:42.405041 ip-10-0-129-212 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 29 16:04:42.405057 ip-10-0-129-212 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 8f198a54f79242df91eaf51a7eb72202 -- Jul 29 16:06:42.870028 ip-10-0-129-212 systemd[1]: Starting Kubernetes Kubelet... Jul 29 16:06:43.250835 ip-10-0-129-212 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 16:06:43.250835 ip-10-0-129-212 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 29 16:06:43.250835 ip-10-0-129-212 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 16:06:43.250835 ip-10-0-129-212 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 29 16:06:43.250835 ip-10-0-129-212 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 16:06:43.251392 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.250891 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 29 16:06:43.257170 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257151 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 16:06:43.257170 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257166 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 16:06:43.257170 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257170 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 16:06:43.257256 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257174 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 16:06:43.257256 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257177 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 16:06:43.257256 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257180 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 16:06:43.257256 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257183 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 16:06:43.257256 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257186 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 16:06:43.257256 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257189 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 16:06:43.257256 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257192 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 16:06:43.257256 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257194 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 16:06:43.257256 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257197 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 16:06:43.257256 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257200 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 16:06:43.257256 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257202 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 16:06:43.257256 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257205 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 16:06:43.257256 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257208 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 16:06:43.257256 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257210 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 16:06:43.257256 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257213 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 16:06:43.257256 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257215 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 16:06:43.257256 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257219 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 16:06:43.257256 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257221 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 16:06:43.257256 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257224 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 16:06:43.257698 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257227 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 16:06:43.257698 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257229 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 16:06:43.257698 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257232 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 16:06:43.257698 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257235 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 16:06:43.257698 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257237 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 16:06:43.257698 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257240 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 16:06:43.257698 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257243 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 16:06:43.257698 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257247 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 16:06:43.257698 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257251 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 16:06:43.257698 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257253 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 16:06:43.257698 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257256 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 16:06:43.257698 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257259 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 16:06:43.257698 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257262 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 16:06:43.257698 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257265 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 16:06:43.257698 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257268 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 16:06:43.257698 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257271 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 16:06:43.257698 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257274 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 16:06:43.257698 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257276 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 16:06:43.257698 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257279 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 16:06:43.257698 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257282 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 16:06:43.258299 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257285 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 16:06:43.258299 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257287 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 16:06:43.258299 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257290 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 16:06:43.258299 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257292 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 16:06:43.258299 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257296 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 16:06:43.258299 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257300 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 16:06:43.258299 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257302 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 16:06:43.258299 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257305 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 16:06:43.258299 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257307 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 16:06:43.258299 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257310 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 16:06:43.258299 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257313 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 16:06:43.258299 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257315 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 16:06:43.258299 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257317 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 16:06:43.258299 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257321 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 16:06:43.258299 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257324 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 16:06:43.258299 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257326 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 16:06:43.258299 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257329 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 16:06:43.258299 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257331 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 16:06:43.258299 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257334 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 16:06:43.258299 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257336 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 16:06:43.258821 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257339 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 16:06:43.258821 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257341 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 16:06:43.258821 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257345 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 16:06:43.258821 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257350 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 16:06:43.258821 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257353 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 16:06:43.258821 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257356 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 16:06:43.258821 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257359 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 16:06:43.258821 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257361 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 16:06:43.258821 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257364 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 16:06:43.258821 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257374 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 16:06:43.258821 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257376 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 16:06:43.258821 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257379 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 16:06:43.258821 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257382 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 16:06:43.258821 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257384 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 16:06:43.258821 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257387 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 16:06:43.258821 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257390 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 16:06:43.258821 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257392 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 16:06:43.258821 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257395 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 16:06:43.258821 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257398 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 16:06:43.259261 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257400 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 16:06:43.259261 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257403 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 16:06:43.259261 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257405 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 16:06:43.259261 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257408 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 16:06:43.259261 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257411 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 16:06:43.259261 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257413 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 16:06:43.259261 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257416 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 29 16:06:43.259261 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257420 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 16:06:43.259261 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257422 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 16:06:43.259261 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257425 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 16:06:43.259261 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257427 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 16:06:43.259261 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257430 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 16:06:43.259261 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257433 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 16:06:43.259261 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257435 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 16:06:43.259261 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257437 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 16:06:43.259261 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257440 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 16:06:43.259261 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257442 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 16:06:43.259261 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.257445 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 16:06:43.259261 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258152 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 16:06:43.259261 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258159 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 16:06:43.259731 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258162 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 16:06:43.259731 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258166 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 16:06:43.259731 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258168 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 16:06:43.259731 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258172 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 16:06:43.259731 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258174 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 16:06:43.259731 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258177 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 16:06:43.259731 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258179 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 16:06:43.259731 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258182 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 16:06:43.259731 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258184 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 16:06:43.259731 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258187 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 16:06:43.259731 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258189 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 16:06:43.259731 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258192 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 16:06:43.259731 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258195 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 16:06:43.259731 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258199 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 16:06:43.259731 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258203 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 16:06:43.259731 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258207 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 16:06:43.259731 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258210 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 16:06:43.259731 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258213 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 16:06:43.259731 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258216 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 16:06:43.260203 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258219 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 16:06:43.260203 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258222 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 16:06:43.260203 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258225 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 16:06:43.260203 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258227 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 16:06:43.260203 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258230 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 16:06:43.260203 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258233 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 16:06:43.260203 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258235 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 16:06:43.260203 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258238 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 16:06:43.260203 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258240 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 16:06:43.260203 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258242 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 16:06:43.260203 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258245 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 16:06:43.260203 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258247 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 16:06:43.260203 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258249 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 16:06:43.260203 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258252 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 16:06:43.260203 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258254 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 16:06:43.260203 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258256 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 16:06:43.260203 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258259 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 16:06:43.260203 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258262 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 16:06:43.260203 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258264 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 16:06:43.260203 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258267 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 16:06:43.260686 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258269 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 16:06:43.260686 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258271 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 16:06:43.260686 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258274 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 16:06:43.260686 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258276 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 16:06:43.260686 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258278 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 16:06:43.260686 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258281 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 16:06:43.260686 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258283 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 16:06:43.260686 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258285 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 16:06:43.260686 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258288 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 16:06:43.260686 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258290 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 16:06:43.260686 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258292 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 16:06:43.260686 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258296 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 16:06:43.260686 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258298 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 16:06:43.260686 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258301 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 16:06:43.260686 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258303 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 29 16:06:43.260686 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258306 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 16:06:43.260686 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258310 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 16:06:43.260686 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258313 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 16:06:43.260686 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258316 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 16:06:43.260686 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258318 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 16:06:43.261195 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258321 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 16:06:43.261195 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258324 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 16:06:43.261195 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258327 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 16:06:43.261195 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258329 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 16:06:43.261195 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258331 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 16:06:43.261195 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258334 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 16:06:43.261195 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258336 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 16:06:43.261195 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258338 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 16:06:43.261195 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258341 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 16:06:43.261195 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258343 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 16:06:43.261195 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258346 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 16:06:43.261195 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258348 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 16:06:43.261195 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258351 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 16:06:43.261195 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258354 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 16:06:43.261195 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258356 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 16:06:43.261195 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258358 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 16:06:43.261195 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258361 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 16:06:43.261195 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258363 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 16:06:43.261195 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258365 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 16:06:43.261195 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258368 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 16:06:43.261679 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258370 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 16:06:43.261679 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258373 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 16:06:43.261679 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258375 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 16:06:43.261679 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258379 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 16:06:43.261679 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258381 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 16:06:43.261679 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258384 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 16:06:43.261679 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258386 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 16:06:43.261679 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258388 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 16:06:43.261679 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258390 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 16:06:43.261679 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258393 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 16:06:43.261679 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258395 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 16:06:43.261679 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258397 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 16:06:43.261679 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258399 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 16:06:43.261679 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258402 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 16:06:43.261679 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258404 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 16:06:43.261679 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258407 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 16:06:43.261679 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258409 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 16:06:43.261679 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258412 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 16:06:43.261679 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258738 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 16:06:43.261679 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258759 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 16:06:43.262177 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258762 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 16:06:43.262177 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258765 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 16:06:43.262177 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258768 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 16:06:43.262177 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258770 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 16:06:43.262177 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258773 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 16:06:43.262177 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258775 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 16:06:43.262177 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258778 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 16:06:43.262177 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258780 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 16:06:43.262177 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258783 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 16:06:43.262177 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258785 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 16:06:43.262177 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258788 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 16:06:43.262177 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258790 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 16:06:43.262177 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258793 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 16:06:43.262177 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258795 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 16:06:43.262177 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258798 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 16:06:43.262177 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258800 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 16:06:43.262177 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258803 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 16:06:43.262177 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258806 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 16:06:43.262177 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258808 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 16:06:43.262177 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258811 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 16:06:43.262649 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258813 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 16:06:43.262649 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258815 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 16:06:43.262649 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258818 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 16:06:43.262649 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258820 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 16:06:43.262649 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258823 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 16:06:43.262649 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258826 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 16:06:43.262649 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258828 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 16:06:43.262649 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258832 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 16:06:43.262649 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258836 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 16:06:43.262649 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258839 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 16:06:43.262649 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258842 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 16:06:43.262649 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258845 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 16:06:43.262649 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258848 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 16:06:43.262649 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258851 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 16:06:43.262649 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258854 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 16:06:43.262649 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258856 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 16:06:43.262649 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258859 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 16:06:43.262649 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258862 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 16:06:43.262649 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258864 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 16:06:43.263124 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258867 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 16:06:43.263124 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258870 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 16:06:43.263124 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258873 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 16:06:43.263124 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258877 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 16:06:43.263124 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258879 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 16:06:43.263124 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258882 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 16:06:43.263124 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258884 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 16:06:43.263124 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258887 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 16:06:43.263124 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258890 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 16:06:43.263124 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258893 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 16:06:43.263124 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258895 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 16:06:43.263124 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258897 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 16:06:43.263124 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258900 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 16:06:43.263124 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258902 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 16:06:43.263124 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258904 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 16:06:43.263124 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258907 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 16:06:43.263124 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258909 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 16:06:43.263124 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258912 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 16:06:43.263124 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258914 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 16:06:43.263595 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258917 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 16:06:43.263595 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258919 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 16:06:43.263595 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258921 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 16:06:43.263595 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258924 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 16:06:43.263595 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258926 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 16:06:43.263595 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258928 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 16:06:43.263595 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258932 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 16:06:43.263595 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258935 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 16:06:43.263595 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258937 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 16:06:43.263595 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258940 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 16:06:43.263595 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258942 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 16:06:43.263595 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258945 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 16:06:43.263595 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258948 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 16:06:43.263595 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258951 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 16:06:43.263595 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258953 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 16:06:43.263595 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258956 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 16:06:43.263595 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258959 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 16:06:43.263595 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258961 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 16:06:43.263595 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258964 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 16:06:43.263595 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258966 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 16:06:43.264074 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258969 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 16:06:43.264074 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258972 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 16:06:43.264074 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258974 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 16:06:43.264074 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258977 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 16:06:43.264074 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258980 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 16:06:43.264074 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258982 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 16:06:43.264074 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258984 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 16:06:43.264074 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258988 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 16:06:43.264074 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258991 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 16:06:43.264074 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258993 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 16:06:43.264074 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258996 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 16:06:43.264074 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.258998 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 16:06:43.264074 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259001 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 29 16:06:43.264074 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259003 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 16:06:43.264074 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259006 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 16:06:43.264074 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259008 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 16:06:43.264074 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259011 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 16:06:43.264074 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259013 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 16:06:43.264074 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259017 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 16:06:43.264074 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259080 2563 flags.go:64] FLAG: --address="0.0.0.0" Jul 29 16:06:43.264535 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259087 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 29 16:06:43.264535 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259092 2563 flags.go:64] FLAG: --anonymous-auth="true" Jul 29 16:06:43.264535 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259096 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 29 16:06:43.264535 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259100 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 29 16:06:43.264535 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259103 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 29 16:06:43.264535 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259107 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 29 16:06:43.264535 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259111 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 29 16:06:43.264535 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259114 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 29 16:06:43.264535 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259117 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 29 16:06:43.264535 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259120 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 29 16:06:43.264535 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259123 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 29 16:06:43.264535 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259126 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 29 16:06:43.264535 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259128 2563 flags.go:64] FLAG: --cgroup-root="" Jul 29 16:06:43.264535 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259131 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 29 16:06:43.264535 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259134 2563 flags.go:64] FLAG: --client-ca-file="" Jul 29 16:06:43.264535 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259137 2563 flags.go:64] FLAG: --cloud-provider="external" Jul 29 16:06:43.264535 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259139 2563 flags.go:64] FLAG: --cluster-dns="[]" Jul 29 16:06:43.264535 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259143 2563 flags.go:64] FLAG: --cluster-domain="" Jul 29 16:06:43.264535 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259145 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 29 16:06:43.264535 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259148 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 29 16:06:43.264535 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259151 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 29 16:06:43.264535 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259154 2563 flags.go:64] FLAG: --container-log-max-files="5" Jul 29 16:06:43.264535 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259157 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 29 16:06:43.264535 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259160 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 29 16:06:43.265141 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259162 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 29 16:06:43.265141 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259166 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 29 16:06:43.265141 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259168 2563 flags.go:64] FLAG: --contention-profiling="false" Jul 29 16:06:43.265141 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259171 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 29 16:06:43.265141 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259173 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 29 16:06:43.265141 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259176 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 29 16:06:43.265141 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259180 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 29 16:06:43.265141 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259184 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 29 16:06:43.265141 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259187 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 29 16:06:43.265141 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259189 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 29 16:06:43.265141 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259192 2563 flags.go:64] FLAG: --enable-load-reader="false" Jul 29 16:06:43.265141 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259195 2563 flags.go:64] FLAG: --enable-server="true" Jul 29 16:06:43.265141 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259198 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 29 16:06:43.265141 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259202 2563 flags.go:64] FLAG: --event-burst="100" Jul 29 16:06:43.265141 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259205 2563 flags.go:64] FLAG: --event-qps="50" Jul 29 16:06:43.265141 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259208 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 29 16:06:43.265141 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259210 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 29 16:06:43.265141 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259213 2563 flags.go:64] FLAG: --eviction-hard="" Jul 29 16:06:43.265141 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259216 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 29 16:06:43.265141 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259219 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 29 16:06:43.265141 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259222 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 29 16:06:43.265141 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259225 2563 flags.go:64] FLAG: --eviction-soft="" Jul 29 16:06:43.265141 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259227 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 29 16:06:43.265141 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259230 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 29 16:06:43.265141 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259232 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 29 16:06:43.265757 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259235 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jul 29 16:06:43.265757 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259238 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 29 16:06:43.265757 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259240 2563 flags.go:64] FLAG: --fail-swap-on="true" Jul 29 16:06:43.265757 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259247 2563 flags.go:64] FLAG: --feature-gates="" Jul 29 16:06:43.265757 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259250 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jul 29 16:06:43.265757 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259253 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 29 16:06:43.265757 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259256 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 29 16:06:43.265757 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259259 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 29 16:06:43.265757 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259261 2563 flags.go:64] FLAG: --healthz-port="10248" Jul 29 16:06:43.265757 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259264 2563 flags.go:64] FLAG: --help="false" Jul 29 16:06:43.265757 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259267 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-129-212.ec2.internal" Jul 29 16:06:43.265757 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259270 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 29 16:06:43.265757 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259273 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jul 29 16:06:43.265757 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259276 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 29 16:06:43.265757 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259280 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 29 16:06:43.265757 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259283 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 29 16:06:43.265757 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259285 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 29 16:06:43.265757 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259288 2563 flags.go:64] FLAG: --image-service-endpoint="" Jul 29 16:06:43.265757 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259290 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 29 16:06:43.265757 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259293 2563 flags.go:64] FLAG: --kube-api-burst="100" Jul 29 16:06:43.265757 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259296 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 29 16:06:43.265757 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259299 2563 flags.go:64] FLAG: --kube-api-qps="50" Jul 29 16:06:43.265757 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259301 2563 flags.go:64] FLAG: --kube-reserved="" Jul 29 16:06:43.265757 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259304 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 29 16:06:43.266348 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259306 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 29 16:06:43.266348 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259309 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jul 29 16:06:43.266348 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259311 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 29 16:06:43.266348 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259314 2563 flags.go:64] FLAG: --lock-file="" Jul 29 16:06:43.266348 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259316 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 29 16:06:43.266348 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259319 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 29 16:06:43.266348 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259322 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 29 16:06:43.266348 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259326 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jul 29 16:06:43.266348 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259329 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 29 16:06:43.266348 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259332 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jul 29 16:06:43.266348 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259334 2563 flags.go:64] FLAG: --logging-format="text" Jul 29 16:06:43.266348 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259338 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 29 16:06:43.266348 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259341 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 29 16:06:43.266348 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259344 2563 flags.go:64] FLAG: --manifest-url="" Jul 29 16:06:43.266348 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259346 2563 flags.go:64] FLAG: --manifest-url-header="" Jul 29 16:06:43.266348 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259350 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 29 16:06:43.266348 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259353 2563 flags.go:64] FLAG: --max-open-files="1000000" Jul 29 16:06:43.266348 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259356 2563 flags.go:64] FLAG: --max-pods="110" Jul 29 16:06:43.266348 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259358 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 29 16:06:43.266348 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259361 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 29 16:06:43.266348 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259364 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jul 29 16:06:43.266348 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259367 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 29 16:06:43.266348 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259370 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 29 16:06:43.266348 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259372 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 29 16:06:43.266348 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259375 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 29 16:06:43.266958 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259381 2563 flags.go:64] FLAG: --node-status-max-images="50" Jul 29 16:06:43.266958 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259384 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 29 16:06:43.266958 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259387 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jul 29 16:06:43.266958 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259390 2563 flags.go:64] FLAG: --pod-cidr="" Jul 29 16:06:43.266958 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259394 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 29 16:06:43.266958 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259399 2563 flags.go:64] FLAG: --pod-manifest-path="" Jul 29 16:06:43.266958 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259401 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jul 29 16:06:43.266958 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259404 2563 flags.go:64] FLAG: --pods-per-core="0" Jul 29 16:06:43.266958 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259407 2563 flags.go:64] FLAG: --port="10250" Jul 29 16:06:43.266958 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259409 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 29 16:06:43.266958 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259412 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-022bd4c0870dfd5af" Jul 29 16:06:43.266958 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259415 2563 flags.go:64] FLAG: --qos-reserved="" Jul 29 16:06:43.266958 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259418 2563 flags.go:64] FLAG: --read-only-port="10255" Jul 29 16:06:43.266958 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259420 2563 flags.go:64] FLAG: --register-node="true" Jul 29 16:06:43.266958 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259423 2563 flags.go:64] FLAG: --register-with-taints="" Jul 29 16:06:43.266958 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259426 2563 flags.go:64] FLAG: --registry-burst="10" Jul 29 16:06:43.266958 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259429 2563 flags.go:64] FLAG: --registry-qps="5" Jul 29 16:06:43.266958 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259431 2563 flags.go:64] FLAG: --reserved-cpus="" Jul 29 16:06:43.266958 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259435 2563 flags.go:64] FLAG: --reserved-memory="" Jul 29 16:06:43.266958 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259438 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 29 16:06:43.266958 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259441 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 29 16:06:43.266958 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259443 2563 flags.go:64] FLAG: --rotate-certificates="false" Jul 29 16:06:43.266958 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259446 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 29 16:06:43.266958 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259448 2563 flags.go:64] FLAG: --runonce="false" Jul 29 16:06:43.266958 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259451 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 29 16:06:43.267536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259454 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 29 16:06:43.267536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259457 2563 flags.go:64] FLAG: --seccomp-default="false" Jul 29 16:06:43.267536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259459 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 29 16:06:43.267536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259462 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 29 16:06:43.267536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259465 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 29 16:06:43.267536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259468 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 29 16:06:43.267536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259471 2563 flags.go:64] FLAG: --storage-driver-password="root" Jul 29 16:06:43.267536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259474 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jul 29 16:06:43.267536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259477 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jul 29 16:06:43.267536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259479 2563 flags.go:64] FLAG: --storage-driver-user="root" Jul 29 16:06:43.267536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259482 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 29 16:06:43.267536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259484 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 29 16:06:43.267536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259487 2563 flags.go:64] FLAG: --system-cgroups="" Jul 29 16:06:43.267536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259490 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 29 16:06:43.267536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259495 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 29 16:06:43.267536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259497 2563 flags.go:64] FLAG: --tls-cert-file="" Jul 29 16:06:43.267536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259500 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 29 16:06:43.267536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259504 2563 flags.go:64] FLAG: --tls-min-version="" Jul 29 16:06:43.267536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259506 2563 flags.go:64] FLAG: --tls-private-key-file="" Jul 29 16:06:43.267536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259509 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jul 29 16:06:43.267536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259511 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 29 16:06:43.267536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259514 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jul 29 16:06:43.267536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259516 2563 flags.go:64] FLAG: --v="2" Jul 29 16:06:43.267536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259520 2563 flags.go:64] FLAG: --version="false" Jul 29 16:06:43.267536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259523 2563 flags.go:64] FLAG: --vmodule="" Jul 29 16:06:43.268133 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259527 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 29 16:06:43.268133 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.259531 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 29 16:06:43.268133 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259632 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 16:06:43.268133 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259635 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 16:06:43.268133 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259638 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 16:06:43.268133 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259640 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 16:06:43.268133 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259643 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 16:06:43.268133 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259647 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 16:06:43.268133 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259651 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 16:06:43.268133 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259653 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 16:06:43.268133 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259656 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 16:06:43.268133 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259659 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 16:06:43.268133 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259662 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 16:06:43.268133 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259664 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 16:06:43.268133 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259667 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 16:06:43.268133 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259669 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 16:06:43.268133 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259672 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 16:06:43.268133 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259674 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 16:06:43.268133 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259677 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 16:06:43.268133 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259679 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 16:06:43.268597 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259682 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 16:06:43.268597 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259684 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 16:06:43.268597 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259686 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 16:06:43.268597 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259689 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 16:06:43.268597 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259691 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 16:06:43.268597 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259693 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 16:06:43.268597 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259696 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 16:06:43.268597 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259698 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 16:06:43.268597 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259700 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 16:06:43.268597 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259702 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 16:06:43.268597 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259705 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 16:06:43.268597 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259707 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 16:06:43.268597 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259711 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 16:06:43.268597 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259713 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 16:06:43.268597 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259715 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 16:06:43.268597 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259718 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 16:06:43.268597 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259720 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 16:06:43.268597 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259722 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 16:06:43.268597 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259724 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 16:06:43.268597 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259727 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 29 16:06:43.269167 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259729 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 16:06:43.269167 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259731 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 16:06:43.269167 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259734 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 16:06:43.269167 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259738 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 16:06:43.269167 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259756 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 16:06:43.269167 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259759 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 16:06:43.269167 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259761 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 16:06:43.269167 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259763 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 16:06:43.269167 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259766 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 16:06:43.269167 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259768 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 16:06:43.269167 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259771 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 16:06:43.269167 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259775 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 16:06:43.269167 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259778 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 16:06:43.269167 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259781 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 16:06:43.269167 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259784 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 16:06:43.269167 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259786 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 16:06:43.269167 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259788 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 16:06:43.269167 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259791 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 16:06:43.269167 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259793 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 16:06:43.269167 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259796 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 16:06:43.269659 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259798 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 16:06:43.269659 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259802 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 16:06:43.269659 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259805 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 16:06:43.269659 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259808 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 16:06:43.269659 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259812 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 16:06:43.269659 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259814 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 16:06:43.269659 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259816 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 16:06:43.269659 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259819 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 16:06:43.269659 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259821 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 16:06:43.269659 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259823 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 16:06:43.269659 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259826 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 16:06:43.269659 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259828 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 16:06:43.269659 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259831 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 16:06:43.269659 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259833 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 16:06:43.269659 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259836 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 16:06:43.269659 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259839 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 16:06:43.269659 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259842 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 16:06:43.269659 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259844 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 16:06:43.269659 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259847 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 16:06:43.270137 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259849 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 16:06:43.270137 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259852 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 16:06:43.270137 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259854 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 16:06:43.270137 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259856 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 16:06:43.270137 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259859 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 16:06:43.270137 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259861 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 16:06:43.270137 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259864 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 16:06:43.270137 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259866 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 16:06:43.270137 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259869 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 16:06:43.270137 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259872 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 16:06:43.270137 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259874 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 16:06:43.270137 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259877 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 16:06:43.270137 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259879 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 16:06:43.270137 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259881 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 16:06:43.270137 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259884 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 16:06:43.270137 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259886 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 16:06:43.270137 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259889 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 16:06:43.270137 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259892 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 16:06:43.270137 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259894 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 16:06:43.270137 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259897 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 16:06:43.270605 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259899 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 16:06:43.270605 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.259901 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 16:06:43.270605 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.261088 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 16:06:43.270605 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.266947 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 29 16:06:43.270605 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.266961 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 29 16:06:43.270605 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.266979 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 29 16:06:43.270605 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.266985 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 29 16:06:43.270605 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267036 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 16:06:43.270605 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267041 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 16:06:43.270605 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267045 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 16:06:43.270605 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267047 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 16:06:43.270605 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267051 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 16:06:43.270605 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267054 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 16:06:43.270605 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267056 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 16:06:43.270605 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267059 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 16:06:43.270967 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267061 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 16:06:43.270967 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267064 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 16:06:43.270967 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267066 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 16:06:43.270967 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267069 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 16:06:43.270967 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267072 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 16:06:43.270967 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267076 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 16:06:43.270967 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267078 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 16:06:43.270967 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267081 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 16:06:43.270967 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267084 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 16:06:43.270967 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267086 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 16:06:43.270967 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267089 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 16:06:43.270967 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267092 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 16:06:43.270967 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267094 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 16:06:43.270967 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267096 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 16:06:43.270967 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267099 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 16:06:43.270967 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267101 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 16:06:43.270967 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267104 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 16:06:43.270967 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267106 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 16:06:43.270967 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267108 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 16:06:43.270967 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267111 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 16:06:43.271425 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267113 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 16:06:43.271425 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267117 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 29 16:06:43.271425 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267119 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 16:06:43.271425 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267122 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 16:06:43.271425 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267124 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 16:06:43.271425 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267127 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 16:06:43.271425 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267129 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 16:06:43.271425 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267131 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 16:06:43.271425 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267134 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 16:06:43.271425 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267136 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 16:06:43.271425 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267138 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 16:06:43.271425 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267141 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 16:06:43.271425 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267143 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 16:06:43.271425 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267145 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 16:06:43.271425 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267148 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 16:06:43.271425 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267150 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 16:06:43.271425 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267152 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 16:06:43.271425 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267155 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 16:06:43.271425 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267157 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 16:06:43.271425 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267159 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 16:06:43.271905 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267163 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 16:06:43.271905 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267166 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 16:06:43.271905 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267169 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 16:06:43.271905 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267172 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 16:06:43.271905 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267174 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 16:06:43.271905 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267177 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 16:06:43.271905 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267179 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 16:06:43.271905 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267182 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 16:06:43.271905 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267185 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 16:06:43.271905 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267187 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 16:06:43.271905 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267189 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 16:06:43.271905 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267192 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 16:06:43.271905 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267194 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 16:06:43.271905 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267197 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 16:06:43.271905 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267200 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 16:06:43.271905 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267203 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 16:06:43.271905 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267205 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 16:06:43.271905 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267208 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 16:06:43.271905 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267210 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 16:06:43.272542 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267213 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 16:06:43.272542 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267216 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 16:06:43.272542 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267219 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 16:06:43.272542 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267222 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 16:06:43.272542 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267225 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 16:06:43.272542 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267227 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 16:06:43.272542 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267230 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 16:06:43.272542 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267233 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 16:06:43.272542 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267235 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 16:06:43.272542 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267237 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 16:06:43.272542 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267240 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 16:06:43.272542 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267242 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 16:06:43.272542 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267244 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 16:06:43.272542 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267247 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 16:06:43.272542 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267249 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 16:06:43.272542 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267251 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 16:06:43.272542 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267253 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 16:06:43.272542 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267256 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 16:06:43.272542 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267258 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 16:06:43.273405 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267260 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 16:06:43.273405 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267263 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 16:06:43.273405 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267265 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 16:06:43.273405 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267267 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 16:06:43.273405 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267270 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 16:06:43.273405 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267272 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 16:06:43.273405 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267274 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 16:06:43.273405 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267277 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 16:06:43.273405 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267280 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 16:06:43.273405 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267283 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 16:06:43.273405 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267285 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 16:06:43.273405 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267288 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 16:06:43.273405 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267290 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 16:06:43.273405 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.267295 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 16:06:43.273818 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267414 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 16:06:43.273818 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267418 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 16:06:43.273818 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267421 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 16:06:43.273818 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267424 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 16:06:43.273818 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267427 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 16:06:43.273818 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267430 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 16:06:43.273818 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267432 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 16:06:43.273818 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267435 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 16:06:43.273818 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267437 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 16:06:43.273818 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267439 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 16:06:43.273818 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267441 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 16:06:43.273818 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267444 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 16:06:43.273818 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267447 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 16:06:43.273818 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267449 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 16:06:43.273818 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267451 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 16:06:43.273818 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267454 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 16:06:43.273818 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267456 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 16:06:43.273818 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267458 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 16:06:43.273818 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267460 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 16:06:43.273818 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267462 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 16:06:43.274303 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267465 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 16:06:43.274303 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267467 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 16:06:43.274303 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267469 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 16:06:43.274303 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267472 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 16:06:43.274303 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267474 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 16:06:43.274303 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267476 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 16:06:43.274303 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267479 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 16:06:43.274303 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267482 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 16:06:43.274303 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267485 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 16:06:43.274303 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267487 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 16:06:43.274303 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267490 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 16:06:43.274303 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267492 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 16:06:43.274303 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267494 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 16:06:43.274303 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267497 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 16:06:43.274303 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267499 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 16:06:43.274303 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267501 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 16:06:43.274303 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267503 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 16:06:43.274303 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267506 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 16:06:43.274303 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267508 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 16:06:43.274303 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267510 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 16:06:43.274797 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267513 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 29 16:06:43.274797 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267515 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 16:06:43.274797 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267519 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 16:06:43.274797 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267522 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 16:06:43.274797 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267524 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 16:06:43.274797 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267527 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 16:06:43.274797 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267529 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 16:06:43.274797 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267532 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 16:06:43.274797 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267534 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 16:06:43.274797 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267536 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 16:06:43.274797 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267539 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 16:06:43.274797 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267541 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 16:06:43.274797 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267544 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 16:06:43.274797 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267546 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 16:06:43.274797 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267549 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 16:06:43.274797 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267551 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 16:06:43.274797 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267554 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 16:06:43.274797 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267556 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 16:06:43.274797 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267558 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 16:06:43.274797 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267561 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 16:06:43.275259 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267563 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 16:06:43.275259 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267566 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 16:06:43.275259 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267568 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 16:06:43.275259 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267570 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 16:06:43.275259 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267573 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 16:06:43.275259 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267575 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 16:06:43.275259 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267577 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 16:06:43.275259 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267580 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 16:06:43.275259 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267582 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 16:06:43.275259 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267585 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 16:06:43.275259 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267587 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 16:06:43.275259 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267589 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 16:06:43.275259 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267592 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 16:06:43.275259 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267594 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 16:06:43.275259 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267596 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 16:06:43.275259 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267599 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 16:06:43.275259 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267601 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 16:06:43.275259 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267603 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 16:06:43.275259 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267605 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 16:06:43.275259 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267608 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 16:06:43.275714 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267610 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 16:06:43.275714 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267612 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 16:06:43.275714 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267614 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 16:06:43.275714 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267616 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 16:06:43.275714 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267619 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 16:06:43.275714 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267621 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 16:06:43.275714 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267624 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 16:06:43.275714 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267626 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 16:06:43.275714 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267630 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 16:06:43.275714 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267633 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 16:06:43.275714 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267635 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 16:06:43.275714 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267638 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 16:06:43.275714 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267640 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 16:06:43.275714 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267644 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 16:06:43.275714 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267647 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 16:06:43.275714 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267650 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 16:06:43.275714 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267653 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 16:06:43.275714 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267655 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 16:06:43.275714 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:43.267658 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 16:06:43.276217 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.267662 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 16:06:43.276217 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.267769 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jul 29 16:06:43.276217 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.269478 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 29 16:06:43.276217 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.270652 2563 server.go:1019] "Starting client certificate rotation" Jul 29 16:06:43.276217 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.270761 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 16:06:43.276217 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.273497 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 16:06:43.276364 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.276244 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 16:06:43.277369 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.277349 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 16:06:43.293169 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.293152 2563 log.go:25] "Validated CRI v1 runtime API" Jul 29 16:06:43.295046 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.295031 2563 log.go:25] "Validated CRI v1 image API" Jul 29 16:06:43.295898 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.295883 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 29 16:06:43.300605 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.300574 2563 fs.go:135] Filesystem UUIDs: map[4e938d13-300f-4b4e-bc9d-9dd737c9a47c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 bb853625-c57a-4812-a164-233cfd25d511:/dev/nvme0n1p3] Jul 29 16:06:43.300686 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.300602 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 29 16:06:43.305188 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.305169 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 16:06:43.305274 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.305136 2563 manager.go:216] Machine: {Timestamp:2026-07-29 16:06:43.304071341 +0000 UTC m=+0.321892578 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3168808 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec211ebd342d5ac938d9feb899ded7a2 SystemUUID:ec211ebd-342d-5ac9-38d9-feb899ded7a2 BootID:8f198a54-f792-42df-91ea-f51a7eb72202 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:12:b4:e1:53:67 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:12:b4:e1:53:67 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:03:e3:e8:a3:dc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 29 16:06:43.305274 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.305258 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 29 16:06:43.305374 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.305324 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 29 16:06:43.306252 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.306224 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 29 16:06:43.306399 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.306255 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-212.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 29 16:06:43.306924 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.306904 2563 topology_manager.go:138] "Creating topology manager with none policy" Jul 29 16:06:43.306924 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.306925 2563 container_manager_linux.go:309] "Creating device plugin manager" Jul 29 16:06:43.307001 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.306933 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 16:06:43.307524 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.307514 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 16:06:43.308145 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.308136 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 29 16:06:43.309691 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.309681 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 29 16:06:43.309830 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.309820 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 29 16:06:43.309871 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.309852 2563 kubelet.go:486] "Attempting to sync node with API server" Jul 29 16:06:43.309871 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.309864 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 29 16:06:43.309921 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.309878 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 29 16:06:43.309921 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.309887 2563 kubelet.go:398] "Adding apiserver pod source" Jul 29 16:06:43.309921 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.309895 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 29 16:06:43.310189 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.310178 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 16:06:43.310240 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.310196 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 16:06:43.313272 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.313072 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 29 16:06:43.314902 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.314887 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 29 16:06:43.314990 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.314924 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 29 16:06:43.316071 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.316058 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 29 16:06:43.316143 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.316077 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 29 16:06:43.316143 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.316086 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 29 16:06:43.316143 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.316094 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 29 16:06:43.316143 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.316106 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 29 16:06:43.316143 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.316115 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 29 16:06:43.316143 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.316126 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 29 16:06:43.316143 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.316133 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 29 16:06:43.316143 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.316143 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 29 16:06:43.316407 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.316151 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 29 16:06:43.316407 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.316163 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 29 16:06:43.316407 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.316171 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 29 16:06:43.316950 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.316938 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 29 16:06:43.317008 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.316953 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 29 16:06:43.318348 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.318321 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-212.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 29 16:06:43.318348 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:43.318333 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-212.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 29 16:06:43.318518 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:43.318448 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 29 16:06:43.320003 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.319988 2563 server.go:1268] "Started kubelet" Jul 29 16:06:43.320074 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.320044 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 29 16:06:43.320157 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.320115 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 29 16:06:43.320196 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.320178 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 29 16:06:43.320678 ip-10-0-129-212 systemd[1]: Started Kubernetes Kubelet. Jul 29 16:06:43.321780 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.321189 2563 server.go:310] "Adding debug handlers to kubelet server" Jul 29 16:06:43.324922 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.324906 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 29 16:06:43.326019 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:43.326003 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 29 16:06:43.326316 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:43.325523 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-212.ec2.internal.18c6ce5d82c146bf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-212.ec2.internal,UID:ip-10-0-129-212.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-212.ec2.internal,},FirstTimestamp:2026-07-29 16:06:43.319965375 +0000 UTC m=+0.337786612,LastTimestamp:2026-07-29 16:06:43.319965375 +0000 UTC m=+0.337786612,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-212.ec2.internal,}" Jul 29 16:06:43.327635 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.327614 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-s5d66" Jul 29 16:06:43.329528 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.329509 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 29 16:06:43.329528 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.329516 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 29 16:06:43.329683 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:43.329625 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-212.ec2.internal\" not found" Jul 29 16:06:43.330002 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.329986 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 29 16:06:43.330091 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.330007 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 29 16:06:43.330091 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.330016 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 29 16:06:43.330181 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.330108 2563 reconstruct.go:97] "Volume reconstruction finished" Jul 29 16:06:43.330181 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.330118 2563 reconciler.go:29] "Reconciler: start to sync state" Jul 29 16:06:43.330613 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.330579 2563 factory.go:55] Registering systemd factory Jul 29 16:06:43.330613 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.330614 2563 factory.go:223] Registration of the systemd container factory successfully Jul 29 16:06:43.330922 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.330906 2563 factory.go:153] Registering CRI-O factory Jul 29 16:06:43.330922 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.330923 2563 factory.go:223] Registration of the crio container factory successfully Jul 29 16:06:43.331044 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.330978 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 29 16:06:43.331044 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.331005 2563 factory.go:103] Registering Raw factory Jul 29 16:06:43.331044 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.331016 2563 manager.go:1196] Started watching for new ooms in manager Jul 29 16:06:43.331694 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.331681 2563 manager.go:349] Starting recovery of all containers Jul 29 16:06:43.335330 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.335310 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-s5d66" Jul 29 16:06:43.339692 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:43.339670 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 29 16:06:43.339996 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:43.339972 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-212.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 29 16:06:43.343667 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.343569 2563 manager.go:354] Recovery completed Jul 29 16:06:43.348266 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.348255 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 16:06:43.349905 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.349886 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasSufficientMemory" Jul 29 16:06:43.349977 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.349917 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 16:06:43.349977 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.349926 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasSufficientPID" Jul 29 16:06:43.350473 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.350459 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 29 16:06:43.350473 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.350471 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 29 16:06:43.350610 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.350486 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 16:06:43.350610 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.350489 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 29 16:06:43.351130 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.351113 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasSufficientMemory" Jul 29 16:06:43.351198 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.351140 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 16:06:43.351198 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.351149 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasSufficientPID" Jul 29 16:06:43.351865 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.351853 2563 policy_none.go:49] "None policy: Start" Jul 29 16:06:43.351865 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.351868 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 29 16:06:43.351952 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.351878 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 29 16:06:43.352731 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.352722 2563 policy_none.go:47] "Start" Jul 29 16:06:43.389308 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.389295 2563 manager.go:337] "Starting Device Plugin manager" Jul 29 16:06:43.389381 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:43.389328 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 29 16:06:43.389381 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.389337 2563 server.go:87] "Starting device plugin registration server" Jul 29 16:06:43.389549 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.389537 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 29 16:06:43.389584 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.389552 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 29 16:06:43.389846 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.389734 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 29 16:06:43.389846 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.389843 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 29 16:06:43.389993 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.389852 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 29 16:06:43.390236 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:43.390222 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 29 16:06:43.390279 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:43.390268 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-212.ec2.internal\" not found" Jul 29 16:06:43.489948 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.489927 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 16:06:43.491740 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.491730 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasSufficientMemory" Jul 29 16:06:43.491810 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.491774 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 16:06:43.491810 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.491789 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasSufficientPID" Jul 29 16:06:43.491869 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.491814 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-212.ec2.internal" Jul 29 16:06:43.503650 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.503612 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-212.ec2.internal" Jul 29 16:06:43.503650 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:43.503631 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-212.ec2.internal\": node \"ip-10-0-129-212.ec2.internal\" not found" Jul 29 16:06:43.533896 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:43.533872 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-212.ec2.internal\" not found" Jul 29 16:06:43.535320 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.535297 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 29 16:06:43.536615 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.536597 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 29 16:06:43.536691 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.536633 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 29 16:06:43.536691 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.536654 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jul 29 16:06:43.536691 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:43.536686 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 29 16:06:43.539134 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.539119 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 16:06:43.634583 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:43.634563 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-212.ec2.internal\" not found" Jul 29 16:06:43.637716 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.637701 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-212.ec2.internal"] Jul 29 16:06:43.637780 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.637766 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 16:06:43.639138 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.639123 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasSufficientMemory" Jul 29 16:06:43.639203 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.639153 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 16:06:43.639203 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.639162 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasSufficientPID" Jul 29 16:06:43.641136 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.641125 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 16:06:43.641288 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.641274 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal" Jul 29 16:06:43.641329 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.641303 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 16:06:43.641835 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.641812 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasSufficientMemory" Jul 29 16:06:43.641929 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.641855 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 16:06:43.641929 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.641867 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasSufficientPID" Jul 29 16:06:43.642042 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.641957 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasSufficientMemory" Jul 29 16:06:43.642042 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.641980 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 16:06:43.642042 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.641993 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasSufficientPID" Jul 29 16:06:43.643884 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.643868 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-212.ec2.internal" Jul 29 16:06:43.643961 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.643896 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 16:06:43.644550 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.644534 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasSufficientMemory" Jul 29 16:06:43.644623 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.644560 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 16:06:43.644623 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.644579 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasSufficientPID" Jul 29 16:06:43.666337 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:43.666316 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-212.ec2.internal\" not found" node="ip-10-0-129-212.ec2.internal" Jul 29 16:06:43.670050 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:43.670037 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-212.ec2.internal\" not found" node="ip-10-0-129-212.ec2.internal" Jul 29 16:06:43.731562 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.731542 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/21cfd4953a54adbfe7241648da9fa238-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal\" (UID: \"21cfd4953a54adbfe7241648da9fa238\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal" Jul 29 16:06:43.731622 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.731571 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21cfd4953a54adbfe7241648da9fa238-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal\" (UID: \"21cfd4953a54adbfe7241648da9fa238\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal" Jul 29 16:06:43.731622 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.731593 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0895cdd09b066c024f59b1f6d999c0ab-config\") pod \"kube-apiserver-proxy-ip-10-0-129-212.ec2.internal\" (UID: \"0895cdd09b066c024f59b1f6d999c0ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-212.ec2.internal" Jul 29 16:06:43.735260 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:43.735244 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-212.ec2.internal\" not found" Jul 29 16:06:43.831887 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.831829 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0895cdd09b066c024f59b1f6d999c0ab-config\") pod \"kube-apiserver-proxy-ip-10-0-129-212.ec2.internal\" (UID: \"0895cdd09b066c024f59b1f6d999c0ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-212.ec2.internal" Jul 29 16:06:43.831887 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.831864 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/21cfd4953a54adbfe7241648da9fa238-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal\" (UID: \"21cfd4953a54adbfe7241648da9fa238\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal" Jul 29 16:06:43.831887 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.831888 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21cfd4953a54adbfe7241648da9fa238-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal\" (UID: \"21cfd4953a54adbfe7241648da9fa238\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal" Jul 29 16:06:43.832043 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.831917 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0895cdd09b066c024f59b1f6d999c0ab-config\") pod \"kube-apiserver-proxy-ip-10-0-129-212.ec2.internal\" (UID: \"0895cdd09b066c024f59b1f6d999c0ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-212.ec2.internal" Jul 29 16:06:43.832043 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.831921 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21cfd4953a54adbfe7241648da9fa238-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal\" (UID: \"21cfd4953a54adbfe7241648da9fa238\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal" Jul 29 16:06:43.832043 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.831941 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/21cfd4953a54adbfe7241648da9fa238-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal\" (UID: \"21cfd4953a54adbfe7241648da9fa238\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal" Jul 29 16:06:43.835955 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:43.835940 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-212.ec2.internal\" not found" Jul 29 16:06:43.936467 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:43.936441 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-212.ec2.internal\" not found" Jul 29 16:06:43.968601 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.968586 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal" Jul 29 16:06:43.972969 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:43.972839 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-212.ec2.internal" Jul 29 16:06:44.036756 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:44.036721 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-212.ec2.internal\" not found" Jul 29 16:06:44.137320 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:44.137271 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-212.ec2.internal\" not found" Jul 29 16:06:44.237733 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:44.237707 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-212.ec2.internal\" not found" Jul 29 16:06:44.269881 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:44.269862 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 29 16:06:44.270232 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:44.269984 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 16:06:44.338185 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:44.338164 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-212.ec2.internal\" not found" Jul 29 16:06:44.339858 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:44.339837 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 16:01:44 +0000 UTC" deadline="2028-02-05 17:12:07.335616226 +0000 UTC" Jul 29 16:06:44.339904 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:44.339867 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13345h5m22.995760203s" Jul 29 16:06:44.361593 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:44.361574 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 16:06:44.378093 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:44.378070 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 16:06:44.438649 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:44.438595 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-212.ec2.internal\" not found" Jul 29 16:06:44.538656 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:44.538636 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-212.ec2.internal\" not found" Jul 29 16:06:44.574637 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:44.574605 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0895cdd09b066c024f59b1f6d999c0ab.slice/crio-1fc2d8c4edcc1f766c5018e15a23f225947cfc2821a19a78a74721b2471a22a4 WatchSource:0}: Error finding container 1fc2d8c4edcc1f766c5018e15a23f225947cfc2821a19a78a74721b2471a22a4: Status 404 returned error can't find the container with id 1fc2d8c4edcc1f766c5018e15a23f225947cfc2821a19a78a74721b2471a22a4 Jul 29 16:06:44.578800 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:44.578783 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 16:06:44.639006 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:44.638988 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-212.ec2.internal\" not found" Jul 29 16:06:44.739112 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:44.739055 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-212.ec2.internal\" not found" Jul 29 16:06:44.769842 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:44.769819 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 16:06:44.830298 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:44.830270 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal" Jul 29 16:06:44.843441 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:44.843420 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 16:06:44.844468 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:44.844456 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-212.ec2.internal" Jul 29 16:06:44.851662 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:44.851647 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 16:06:45.247642 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.247614 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 16:06:45.311202 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.311177 2563 apiserver.go:52] "Watching apiserver" Jul 29 16:06:45.323481 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.323445 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 29 16:06:45.325598 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.325569 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-ttc2b","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxrzk","openshift-cluster-node-tuning-operator/tuned-k2t27","openshift-dns/node-resolver-kvkdw","openshift-image-registry/node-ca-h2bbk","openshift-multus/multus-additional-cni-plugins-rw5kn","openshift-multus/multus-ndx86","openshift-ovn-kubernetes/ovnkube-node-wqzt9","kube-system/konnectivity-agent-b84c6","kube-system/kube-apiserver-proxy-ip-10-0-129-212.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal","openshift-multus/network-metrics-daemon-z978p","openshift-network-diagnostics/network-check-target-pxg62","openshift-network-operator/iptables-alerter-xtclz"] Jul 29 16:06:45.328160 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.328139 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.330697 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.330675 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 29 16:06:45.331451 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.331426 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 29 16:06:45.331554 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.331428 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 29 16:06:45.331554 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.331522 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 29 16:06:45.331677 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.331593 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 29 16:06:45.331731 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.331709 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:06:45.331818 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:45.331795 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxg62" podUID="066859ca-e247-4082-b6f9-d758329a31e5" Jul 29 16:06:45.332321 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.332297 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-s6mv6\"" Jul 29 16:06:45.334486 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.334459 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.336697 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.336673 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kvkdw" Jul 29 16:06:45.338229 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.337401 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vcmcn\"" Jul 29 16:06:45.338229 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.337704 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 29 16:06:45.338229 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.337930 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 29 16:06:45.339164 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.339129 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 29 16:06:45.339866 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.339850 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h2bbk" Jul 29 16:06:45.340197 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.339989 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 29 16:06:45.340283 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.340242 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-os-release\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.340283 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.340268 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-multus-socket-dir-parent\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.340468 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.340293 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-host-var-lib-cni-bin\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.340468 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.340319 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-host-var-lib-kubelet\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.340468 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.340370 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-multus-conf-dir\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.340468 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.340408 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-z4nxg\"" Jul 29 16:06:45.340468 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.340421 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-system-cni-dir\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.340468 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.340447 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/188d7124-3dec-4f1c-96bc-2f334a0d4367-cni-binary-copy\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.340766 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.340483 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/188d7124-3dec-4f1c-96bc-2f334a0d4367-multus-daemon-config\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.340766 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.340511 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-etc-kubernetes\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.340766 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.340536 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwtv5\" (UniqueName: \"kubernetes.io/projected/188d7124-3dec-4f1c-96bc-2f334a0d4367-kube-api-access-cwtv5\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.340766 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.340563 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kpjc\" (UniqueName: \"kubernetes.io/projected/066859ca-e247-4082-b6f9-d758329a31e5-kube-api-access-2kpjc\") pod \"network-check-target-pxg62\" (UID: \"066859ca-e247-4082-b6f9-d758329a31e5\") " pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:06:45.340766 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.340588 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-host-run-k8s-cni-cncf-io\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.340766 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.340612 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-hostroot\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.340766 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.340635 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-host-run-multus-certs\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.340766 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.340661 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-host-run-netns\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.340766 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.340701 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-host-var-lib-cni-multus\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.340766 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.340735 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-multus-cni-dir\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.341312 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.340787 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-cnibin\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.342433 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.342409 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 29 16:06:45.342662 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.342644 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 29 16:06:45.342786 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.342761 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rw5kn" Jul 29 16:06:45.342938 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.342913 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 29 16:06:45.343341 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.343318 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-75787\"" Jul 29 16:06:45.344345 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.344322 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 16:06:45.345124 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.345104 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b84c6" Jul 29 16:06:45.345651 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.345627 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 29 16:06:45.345949 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.345925 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-t9gf5\"" Jul 29 16:06:45.346414 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.346394 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 29 16:06:45.348216 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.347593 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:06:45.348216 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:45.347665 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttc2b" podUID="3f75274e-f78e-4656-ad34-0e149d4dff5b" Jul 29 16:06:45.348216 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.348014 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vvjk9\"" Jul 29 16:06:45.348216 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.348191 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 29 16:06:45.351477 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.348875 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 29 16:06:45.351477 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.350122 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxrzk" Jul 29 16:06:45.352650 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.352630 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 29 16:06:45.352785 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.352743 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xtclz" Jul 29 16:06:45.353358 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.353341 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 29 16:06:45.353440 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.353393 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 29 16:06:45.353531 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.353517 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sngzr\"" Jul 29 16:06:45.355932 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.355915 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.357524 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.357504 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 29 16:06:45.357655 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.357639 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 29 16:06:45.357777 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.357759 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 29 16:06:45.358002 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.357984 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:06:45.358090 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:45.358047 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z978p" podUID="8df6793f-3b49-4b29-ae90-d18f79c16891" Jul 29 16:06:45.358787 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.358505 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bmdsg\"" Jul 29 16:06:45.360087 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.360064 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vt5pz\"" Jul 29 16:06:45.361161 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.361139 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 29 16:06:45.361270 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.361246 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 29 16:06:45.361362 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.361342 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 29 16:06:45.361962 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.361937 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 29 16:06:45.362139 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.362123 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 29 16:06:45.362522 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.362500 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 29 16:06:45.372801 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.372691 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gj8hk" Jul 29 16:06:45.380463 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.380442 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gj8hk" Jul 29 16:06:45.431468 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.431283 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 29 16:06:45.442009 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.441990 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-hostroot\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.442174 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442020 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-hostroot\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.442174 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442046 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-etc-systemd\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.442174 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442069 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-host\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.442174 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442093 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4b898523-6b95-417d-9d35-abf57ef9668d-sys-fs\") pod \"aws-ebs-csi-driver-node-qxrzk\" (UID: \"4b898523-6b95-417d-9d35-abf57ef9668d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxrzk" Jul 29 16:06:45.442174 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442119 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-multus-socket-dir-parent\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.442403 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442176 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-host-var-lib-cni-bin\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.442403 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442204 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-var-lib-kubelet\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.442403 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442229 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8df6793f-3b49-4b29-ae90-d18f79c16891-metrics-certs\") pod \"network-metrics-daemon-z978p\" (UID: \"8df6793f-3b49-4b29-ae90-d18f79c16891\") " pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:06:45.442403 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442236 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-multus-socket-dir-parent\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.442403 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442260 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f75274e-f78e-4656-ad34-0e149d4dff5b-dbus\") pod \"global-pull-secret-syncer-ttc2b\" (UID: \"3f75274e-f78e-4656-ad34-0e149d4dff5b\") " pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:06:45.442403 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442284 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-system-cni-dir\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.442403 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442308 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/188d7124-3dec-4f1c-96bc-2f334a0d4367-multus-daemon-config\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.442403 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442338 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-etc-sysconfig\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.442403 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442360 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-run\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.442403 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442386 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4b898523-6b95-417d-9d35-abf57ef9668d-device-dir\") pod \"aws-ebs-csi-driver-node-qxrzk\" (UID: \"4b898523-6b95-417d-9d35-abf57ef9668d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxrzk" Jul 29 16:06:45.442864 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442409 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7fg7\" (UniqueName: \"kubernetes.io/projected/8df6793f-3b49-4b29-ae90-d18f79c16891-kube-api-access-n7fg7\") pod \"network-metrics-daemon-z978p\" (UID: \"8df6793f-3b49-4b29-ae90-d18f79c16891\") " pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:06:45.442864 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442444 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-host-run-k8s-cni-cncf-io\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.442864 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442469 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-host-run-multus-certs\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.442864 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442495 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c5d99ada-6f3f-478c-8265-6b3fd3868f67-iptables-alerter-script\") pod \"iptables-alerter-xtclz\" (UID: \"c5d99ada-6f3f-478c-8265-6b3fd3868f67\") " pod="openshift-network-operator/iptables-alerter-xtclz" Jul 29 16:06:45.442864 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442521 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-etc-openvswitch\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.442864 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442544 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-run-ovn\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.442864 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442567 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/31819202-a49a-4346-b291-656fc68edcd8-ovnkube-script-lib\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.442864 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442592 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94jxl\" (UniqueName: \"kubernetes.io/projected/4b898523-6b95-417d-9d35-abf57ef9668d-kube-api-access-94jxl\") pod \"aws-ebs-csi-driver-node-qxrzk\" (UID: \"4b898523-6b95-417d-9d35-abf57ef9668d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxrzk" Jul 29 16:06:45.442864 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442628 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-host-run-netns\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.442864 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442651 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-lib-modules\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.442864 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442674 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/76f8dffe-ddd3-416f-a108-9c49f4e33812-serviceca\") pod \"node-ca-h2bbk\" (UID: \"76f8dffe-ddd3-416f-a108-9c49f4e33812\") " pod="openshift-image-registry/node-ca-h2bbk" Jul 29 16:06:45.442864 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442698 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-host-run-ovn-kubernetes\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.442864 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442724 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-host-cni-bin\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.442864 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442750 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.442864 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442776 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b9a3fc6f-b673-4770-a62a-7044ea9d3e72-hosts-file\") pod \"node-resolver-kvkdw\" (UID: \"b9a3fc6f-b673-4770-a62a-7044ea9d3e72\") " pod="openshift-dns/node-resolver-kvkdw" Jul 29 16:06:45.442864 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442825 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rw5kn\" (UID: \"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e\") " pod="openshift-multus/multus-additional-cni-plugins-rw5kn" Jul 29 16:06:45.443625 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442867 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwtv5\" (UniqueName: \"kubernetes.io/projected/188d7124-3dec-4f1c-96bc-2f334a0d4367-kube-api-access-cwtv5\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.443625 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442929 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-multus-cni-dir\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.443625 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442965 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-host-var-lib-kubelet\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.443625 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.442989 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-multus-conf-dir\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.443625 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443013 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-etc-sysctl-conf\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.443625 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443037 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e-cni-binary-copy\") pod \"multus-additional-cni-plugins-rw5kn\" (UID: \"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e\") " pod="openshift-multus/multus-additional-cni-plugins-rw5kn" Jul 29 16:06:45.443625 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443062 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e-cnibin\") pod \"multus-additional-cni-plugins-rw5kn\" (UID: \"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e\") " pod="openshift-multus/multus-additional-cni-plugins-rw5kn" Jul 29 16:06:45.443625 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443106 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-systemd-units\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.443625 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443131 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-host-slash\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.443625 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443134 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-host-var-lib-cni-bin\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.443625 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443153 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-host-run-netns\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.443625 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443178 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-run-systemd\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.443625 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443217 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/31819202-a49a-4346-b291-656fc68edcd8-env-overrides\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.443625 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443240 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-etc-tuned\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.443625 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443266 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rw5kn\" (UID: \"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e\") " pod="openshift-multus/multus-additional-cni-plugins-rw5kn" Jul 29 16:06:45.443625 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443289 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvsxf\" (UniqueName: \"kubernetes.io/projected/31819202-a49a-4346-b291-656fc68edcd8-kube-api-access-lvsxf\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.443625 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443314 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6nw7\" (UniqueName: \"kubernetes.io/projected/b9a3fc6f-b673-4770-a62a-7044ea9d3e72-kube-api-access-v6nw7\") pod \"node-resolver-kvkdw\" (UID: \"b9a3fc6f-b673-4770-a62a-7044ea9d3e72\") " pod="openshift-dns/node-resolver-kvkdw" Jul 29 16:06:45.444536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443375 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-host-var-lib-cni-multus\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.444536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443408 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-etc-modprobe-d\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.444536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443434 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e-system-cni-dir\") pod \"multus-additional-cni-plugins-rw5kn\" (UID: \"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e\") " pod="openshift-multus/multus-additional-cni-plugins-rw5kn" Jul 29 16:06:45.444536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443460 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltfnv\" (UniqueName: \"kubernetes.io/projected/7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e-kube-api-access-ltfnv\") pod \"multus-additional-cni-plugins-rw5kn\" (UID: \"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e\") " pod="openshift-multus/multus-additional-cni-plugins-rw5kn" Jul 29 16:06:45.444536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443485 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-var-lib-openvswitch\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.444536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443511 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9a3fc6f-b673-4770-a62a-7044ea9d3e72-tmp-dir\") pod \"node-resolver-kvkdw\" (UID: \"b9a3fc6f-b673-4770-a62a-7044ea9d3e72\") " pod="openshift-dns/node-resolver-kvkdw" Jul 29 16:06:45.444536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443537 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kpjc\" (UniqueName: \"kubernetes.io/projected/066859ca-e247-4082-b6f9-d758329a31e5-kube-api-access-2kpjc\") pod \"network-check-target-pxg62\" (UID: \"066859ca-e247-4082-b6f9-d758329a31e5\") " pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:06:45.444536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443562 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssp9r\" (UniqueName: \"kubernetes.io/projected/c5d99ada-6f3f-478c-8265-6b3fd3868f67-kube-api-access-ssp9r\") pod \"iptables-alerter-xtclz\" (UID: \"c5d99ada-6f3f-478c-8265-6b3fd3868f67\") " pod="openshift-network-operator/iptables-alerter-xtclz" Jul 29 16:06:45.444536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443602 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-etc-sysctl-d\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.444536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443630 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-cnibin\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.444536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443657 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-os-release\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.444536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443683 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-sys\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.444536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443707 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-node-log\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.444536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443736 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/188d7124-3dec-4f1c-96bc-2f334a0d4367-cni-binary-copy\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.444536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443760 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-tmp\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.444536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443790 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-log-socket\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.444536 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443792 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/188d7124-3dec-4f1c-96bc-2f334a0d4367-multus-daemon-config\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.445435 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443854 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4c0bfb07-ebbd-42da-a385-becaf4056a28-agent-certs\") pod \"konnectivity-agent-b84c6\" (UID: \"4c0bfb07-ebbd-42da-a385-becaf4056a28\") " pod="kube-system/konnectivity-agent-b84c6" Jul 29 16:06:45.445435 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443883 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rw5kn\" (UID: \"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e\") " pod="openshift-multus/multus-additional-cni-plugins-rw5kn" Jul 29 16:06:45.445435 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443916 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4b898523-6b95-417d-9d35-abf57ef9668d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qxrzk\" (UID: \"4b898523-6b95-417d-9d35-abf57ef9668d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxrzk" Jul 29 16:06:45.445435 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.444014 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-host-var-lib-kubelet\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.445435 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.444019 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-host-run-netns\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.445435 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.444054 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-run-openvswitch\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.445435 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.444057 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-multus-conf-dir\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.445435 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.444082 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-etc-kubernetes\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.445435 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.444116 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx2g9\" (UniqueName: \"kubernetes.io/projected/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-kube-api-access-mx2g9\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.445435 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.443218 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-system-cni-dir\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.445435 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.444150 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76f8dffe-ddd3-416f-a108-9c49f4e33812-host\") pod \"node-ca-h2bbk\" (UID: \"76f8dffe-ddd3-416f-a108-9c49f4e33812\") " pod="openshift-image-registry/node-ca-h2bbk" Jul 29 16:06:45.445435 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.444175 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4b898523-6b95-417d-9d35-abf57ef9668d-registration-dir\") pod \"aws-ebs-csi-driver-node-qxrzk\" (UID: \"4b898523-6b95-417d-9d35-abf57ef9668d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxrzk" Jul 29 16:06:45.445435 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.444202 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f75274e-f78e-4656-ad34-0e149d4dff5b-kubelet-config\") pod \"global-pull-secret-syncer-ttc2b\" (UID: \"3f75274e-f78e-4656-ad34-0e149d4dff5b\") " pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:06:45.445435 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.444208 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-host-var-lib-cni-multus\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.445435 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.444238 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4b898523-6b95-417d-9d35-abf57ef9668d-socket-dir\") pod \"aws-ebs-csi-driver-node-qxrzk\" (UID: \"4b898523-6b95-417d-9d35-abf57ef9668d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxrzk" Jul 29 16:06:45.445435 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.444273 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndg2j\" (UniqueName: \"kubernetes.io/projected/76f8dffe-ddd3-416f-a108-9c49f4e33812-kube-api-access-ndg2j\") pod \"node-ca-h2bbk\" (UID: \"76f8dffe-ddd3-416f-a108-9c49f4e33812\") " pod="openshift-image-registry/node-ca-h2bbk" Jul 29 16:06:45.445435 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.444297 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-host-kubelet\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.446246 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.444330 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/31819202-a49a-4346-b291-656fc68edcd8-ovnkube-config\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.446246 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.444357 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/31819202-a49a-4346-b291-656fc68edcd8-ovn-node-metrics-cert\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.446246 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.444383 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f75274e-f78e-4656-ad34-0e149d4dff5b-original-pull-secret\") pod \"global-pull-secret-syncer-ttc2b\" (UID: \"3f75274e-f78e-4656-ad34-0e149d4dff5b\") " pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:06:45.446246 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.444413 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-etc-kubernetes\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.446246 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.444439 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c5d99ada-6f3f-478c-8265-6b3fd3868f67-host-slash\") pod \"iptables-alerter-xtclz\" (UID: \"c5d99ada-6f3f-478c-8265-6b3fd3868f67\") " pod="openshift-network-operator/iptables-alerter-xtclz" Jul 29 16:06:45.446246 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.444464 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e-os-release\") pod \"multus-additional-cni-plugins-rw5kn\" (UID: \"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e\") " pod="openshift-multus/multus-additional-cni-plugins-rw5kn" Jul 29 16:06:45.446246 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.444530 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4b898523-6b95-417d-9d35-abf57ef9668d-etc-selinux\") pod \"aws-ebs-csi-driver-node-qxrzk\" (UID: \"4b898523-6b95-417d-9d35-abf57ef9668d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxrzk" Jul 29 16:06:45.446246 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.444557 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-host-cni-netd\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.446246 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.444583 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4c0bfb07-ebbd-42da-a385-becaf4056a28-konnectivity-ca\") pod \"konnectivity-agent-b84c6\" (UID: \"4c0bfb07-ebbd-42da-a385-becaf4056a28\") " pod="kube-system/konnectivity-agent-b84c6" Jul 29 16:06:45.446246 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.444655 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-host-run-k8s-cni-cncf-io\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.446246 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.444698 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-host-run-multus-certs\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.446246 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.445053 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/188d7124-3dec-4f1c-96bc-2f334a0d4367-cni-binary-copy\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.446246 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.445069 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-multus-cni-dir\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.446246 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.445135 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-etc-kubernetes\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.446246 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.445153 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-os-release\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.446246 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.445185 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/188d7124-3dec-4f1c-96bc-2f334a0d4367-cnibin\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.453971 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.453948 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 29 16:06:45.454139 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:45.454119 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 16:06:45.454234 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:45.454145 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 16:06:45.454234 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:45.454159 2563 projected.go:196] Error preparing data for projected volume kube-api-access-2kpjc for pod openshift-network-diagnostics/network-check-target-pxg62: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:06:45.454234 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:45.454227 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/066859ca-e247-4082-b6f9-d758329a31e5-kube-api-access-2kpjc podName:066859ca-e247-4082-b6f9-d758329a31e5 nodeName:}" failed. No retries permitted until 2026-07-29 16:06:45.954205923 +0000 UTC m=+2.972027155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2kpjc" (UniqueName: "kubernetes.io/projected/066859ca-e247-4082-b6f9-d758329a31e5-kube-api-access-2kpjc") pod "network-check-target-pxg62" (UID: "066859ca-e247-4082-b6f9-d758329a31e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:06:45.458015 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.457992 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwtv5\" (UniqueName: \"kubernetes.io/projected/188d7124-3dec-4f1c-96bc-2f334a0d4367-kube-api-access-cwtv5\") pod \"multus-ndx86\" (UID: \"188d7124-3dec-4f1c-96bc-2f334a0d4367\") " pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.540958 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.540888 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-212.ec2.internal" event={"ID":"0895cdd09b066c024f59b1f6d999c0ab","Type":"ContainerStarted","Data":"1fc2d8c4edcc1f766c5018e15a23f225947cfc2821a19a78a74721b2471a22a4"} Jul 29 16:06:45.545184 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.545161 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssp9r\" (UniqueName: \"kubernetes.io/projected/c5d99ada-6f3f-478c-8265-6b3fd3868f67-kube-api-access-ssp9r\") pod \"iptables-alerter-xtclz\" (UID: \"c5d99ada-6f3f-478c-8265-6b3fd3868f67\") " pod="openshift-network-operator/iptables-alerter-xtclz" Jul 29 16:06:45.545314 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.545194 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-etc-sysctl-d\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.545314 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.545227 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-sys\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.545444 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.545322 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-sys\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.545444 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.545361 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-etc-sysctl-d\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.545444 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.545408 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-node-log\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.545444 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.545425 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-tmp\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.545444 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.545439 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-log-socket\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.545671 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.545460 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-node-log\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.545671 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.545457 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4c0bfb07-ebbd-42da-a385-becaf4056a28-agent-certs\") pod \"konnectivity-agent-b84c6\" (UID: \"4c0bfb07-ebbd-42da-a385-becaf4056a28\") " pod="kube-system/konnectivity-agent-b84c6" Jul 29 16:06:45.545671 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.545535 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rw5kn\" (UID: \"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e\") " pod="openshift-multus/multus-additional-cni-plugins-rw5kn" Jul 29 16:06:45.545671 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.545545 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-log-socket\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.545671 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.545568 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4b898523-6b95-417d-9d35-abf57ef9668d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qxrzk\" (UID: \"4b898523-6b95-417d-9d35-abf57ef9668d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxrzk" Jul 29 16:06:45.545671 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.545600 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-run-openvswitch\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.545671 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.545666 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4b898523-6b95-417d-9d35-abf57ef9668d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qxrzk\" (UID: \"4b898523-6b95-417d-9d35-abf57ef9668d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxrzk" Jul 29 16:06:45.546051 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.545700 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-etc-kubernetes\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.546051 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.545726 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx2g9\" (UniqueName: \"kubernetes.io/projected/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-kube-api-access-mx2g9\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.546051 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.545841 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76f8dffe-ddd3-416f-a108-9c49f4e33812-host\") pod \"node-ca-h2bbk\" (UID: \"76f8dffe-ddd3-416f-a108-9c49f4e33812\") " pod="openshift-image-registry/node-ca-h2bbk" Jul 29 16:06:45.546051 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.545870 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4b898523-6b95-417d-9d35-abf57ef9668d-registration-dir\") pod \"aws-ebs-csi-driver-node-qxrzk\" (UID: \"4b898523-6b95-417d-9d35-abf57ef9668d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxrzk" Jul 29 16:06:45.546051 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.545894 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f75274e-f78e-4656-ad34-0e149d4dff5b-kubelet-config\") pod \"global-pull-secret-syncer-ttc2b\" (UID: \"3f75274e-f78e-4656-ad34-0e149d4dff5b\") " pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:06:45.546051 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.545913 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-etc-kubernetes\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.546051 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.545934 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4b898523-6b95-417d-9d35-abf57ef9668d-socket-dir\") pod \"aws-ebs-csi-driver-node-qxrzk\" (UID: \"4b898523-6b95-417d-9d35-abf57ef9668d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxrzk" Jul 29 16:06:45.546051 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.545958 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndg2j\" (UniqueName: \"kubernetes.io/projected/76f8dffe-ddd3-416f-a108-9c49f4e33812-kube-api-access-ndg2j\") pod \"node-ca-h2bbk\" (UID: \"76f8dffe-ddd3-416f-a108-9c49f4e33812\") " pod="openshift-image-registry/node-ca-h2bbk" Jul 29 16:06:45.546051 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.545966 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-run-openvswitch\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.546051 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.545986 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-host-kubelet\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.546051 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.545970 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76f8dffe-ddd3-416f-a108-9c49f4e33812-host\") pod \"node-ca-h2bbk\" (UID: \"76f8dffe-ddd3-416f-a108-9c49f4e33812\") " pod="openshift-image-registry/node-ca-h2bbk" Jul 29 16:06:45.546590 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.546377 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rw5kn\" (UID: \"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e\") " pod="openshift-multus/multus-additional-cni-plugins-rw5kn" Jul 29 16:06:45.546655 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.546569 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4b898523-6b95-417d-9d35-abf57ef9668d-registration-dir\") pod \"aws-ebs-csi-driver-node-qxrzk\" (UID: \"4b898523-6b95-417d-9d35-abf57ef9668d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxrzk" Jul 29 16:06:45.546655 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.546573 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f75274e-f78e-4656-ad34-0e149d4dff5b-kubelet-config\") pod \"global-pull-secret-syncer-ttc2b\" (UID: \"3f75274e-f78e-4656-ad34-0e149d4dff5b\") " pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:06:45.546758 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.546657 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/31819202-a49a-4346-b291-656fc68edcd8-ovnkube-config\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.546758 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.546689 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/31819202-a49a-4346-b291-656fc68edcd8-ovn-node-metrics-cert\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.546758 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.546717 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f75274e-f78e-4656-ad34-0e149d4dff5b-original-pull-secret\") pod \"global-pull-secret-syncer-ttc2b\" (UID: \"3f75274e-f78e-4656-ad34-0e149d4dff5b\") " pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:06:45.546758 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.546701 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-host-kubelet\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.546758 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.546750 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c5d99ada-6f3f-478c-8265-6b3fd3868f67-host-slash\") pod \"iptables-alerter-xtclz\" (UID: \"c5d99ada-6f3f-478c-8265-6b3fd3868f67\") " pod="openshift-network-operator/iptables-alerter-xtclz" Jul 29 16:06:45.547044 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.546827 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e-os-release\") pod \"multus-additional-cni-plugins-rw5kn\" (UID: \"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e\") " pod="openshift-multus/multus-additional-cni-plugins-rw5kn" Jul 29 16:06:45.547044 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.546870 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4b898523-6b95-417d-9d35-abf57ef9668d-etc-selinux\") pod \"aws-ebs-csi-driver-node-qxrzk\" (UID: \"4b898523-6b95-417d-9d35-abf57ef9668d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxrzk" Jul 29 16:06:45.547044 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.546868 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4b898523-6b95-417d-9d35-abf57ef9668d-socket-dir\") pod \"aws-ebs-csi-driver-node-qxrzk\" (UID: \"4b898523-6b95-417d-9d35-abf57ef9668d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxrzk" Jul 29 16:06:45.547044 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.546902 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-host-cni-netd\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.547044 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.546934 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4c0bfb07-ebbd-42da-a385-becaf4056a28-konnectivity-ca\") pod \"konnectivity-agent-b84c6\" (UID: \"4c0bfb07-ebbd-42da-a385-becaf4056a28\") " pod="kube-system/konnectivity-agent-b84c6" Jul 29 16:06:45.547044 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.546968 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-etc-systemd\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.547044 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.547029 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-host\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.547416 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.547059 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4b898523-6b95-417d-9d35-abf57ef9668d-sys-fs\") pod \"aws-ebs-csi-driver-node-qxrzk\" (UID: \"4b898523-6b95-417d-9d35-abf57ef9668d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxrzk" Jul 29 16:06:45.547416 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.547087 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-var-lib-kubelet\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.547416 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.547117 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8df6793f-3b49-4b29-ae90-d18f79c16891-metrics-certs\") pod \"network-metrics-daemon-z978p\" (UID: \"8df6793f-3b49-4b29-ae90-d18f79c16891\") " pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:06:45.547416 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.547184 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f75274e-f78e-4656-ad34-0e149d4dff5b-dbus\") pod \"global-pull-secret-syncer-ttc2b\" (UID: \"3f75274e-f78e-4656-ad34-0e149d4dff5b\") " pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:06:45.547416 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.547216 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-etc-sysconfig\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.547416 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.547239 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-run\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.547416 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.547288 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4b898523-6b95-417d-9d35-abf57ef9668d-device-dir\") pod \"aws-ebs-csi-driver-node-qxrzk\" (UID: \"4b898523-6b95-417d-9d35-abf57ef9668d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxrzk" Jul 29 16:06:45.547416 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.547307 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-run\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.547416 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.547349 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7fg7\" (UniqueName: \"kubernetes.io/projected/8df6793f-3b49-4b29-ae90-d18f79c16891-kube-api-access-n7fg7\") pod \"network-metrics-daemon-z978p\" (UID: \"8df6793f-3b49-4b29-ae90-d18f79c16891\") " pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:06:45.547416 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.547379 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c5d99ada-6f3f-478c-8265-6b3fd3868f67-iptables-alerter-script\") pod \"iptables-alerter-xtclz\" (UID: \"c5d99ada-6f3f-478c-8265-6b3fd3868f67\") " pod="openshift-network-operator/iptables-alerter-xtclz" Jul 29 16:06:45.547416 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.547389 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-etc-systemd\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.547975 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.547403 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-etc-openvswitch\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.547975 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.547442 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-host\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.547975 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.547450 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-run-ovn\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.547975 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.547517 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-run-ovn\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.547975 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.547530 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/31819202-a49a-4346-b291-656fc68edcd8-ovnkube-script-lib\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.547975 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.547564 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94jxl\" (UniqueName: \"kubernetes.io/projected/4b898523-6b95-417d-9d35-abf57ef9668d-kube-api-access-94jxl\") pod \"aws-ebs-csi-driver-node-qxrzk\" (UID: \"4b898523-6b95-417d-9d35-abf57ef9668d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxrzk" Jul 29 16:06:45.547975 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.547595 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-lib-modules\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.547975 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.547644 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/76f8dffe-ddd3-416f-a108-9c49f4e33812-serviceca\") pod \"node-ca-h2bbk\" (UID: \"76f8dffe-ddd3-416f-a108-9c49f4e33812\") " pod="openshift-image-registry/node-ca-h2bbk" Jul 29 16:06:45.547975 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:45.547654 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 16:06:45.547975 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.547670 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-host-run-ovn-kubernetes\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.547975 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.547695 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-host-cni-bin\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.547975 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:45.547738 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f75274e-f78e-4656-ad34-0e149d4dff5b-original-pull-secret podName:3f75274e-f78e-4656-ad34-0e149d4dff5b nodeName:}" failed. No retries permitted until 2026-07-29 16:06:46.047698067 +0000 UTC m=+3.065519367 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f75274e-f78e-4656-ad34-0e149d4dff5b-original-pull-secret") pod "global-pull-secret-syncer-ttc2b" (UID: "3f75274e-f78e-4656-ad34-0e149d4dff5b") : object "kube-system"/"original-pull-secret" not registered Jul 29 16:06:45.547975 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.547740 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-host-cni-bin\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.547975 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.547801 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4b898523-6b95-417d-9d35-abf57ef9668d-sys-fs\") pod \"aws-ebs-csi-driver-node-qxrzk\" (UID: \"4b898523-6b95-417d-9d35-abf57ef9668d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxrzk" Jul 29 16:06:45.547975 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.547791 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.547975 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.547879 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.547975 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.547902 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c5d99ada-6f3f-478c-8265-6b3fd3868f67-host-slash\") pod \"iptables-alerter-xtclz\" (UID: \"c5d99ada-6f3f-478c-8265-6b3fd3868f67\") " pod="openshift-network-operator/iptables-alerter-xtclz" Jul 29 16:06:45.548852 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.547916 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/31819202-a49a-4346-b291-656fc68edcd8-ovnkube-config\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.548852 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.547937 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-var-lib-kubelet\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.548852 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.547984 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-etc-openvswitch\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.548852 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.548042 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-etc-sysconfig\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.548852 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.548207 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b9a3fc6f-b673-4770-a62a-7044ea9d3e72-hosts-file\") pod \"node-resolver-kvkdw\" (UID: \"b9a3fc6f-b673-4770-a62a-7044ea9d3e72\") " pod="openshift-dns/node-resolver-kvkdw" Jul 29 16:06:45.548852 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.548242 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rw5kn\" (UID: \"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e\") " pod="openshift-multus/multus-additional-cni-plugins-rw5kn" Jul 29 16:06:45.548852 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.548445 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-etc-sysctl-conf\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.548852 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.548480 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e-cni-binary-copy\") pod \"multus-additional-cni-plugins-rw5kn\" (UID: \"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e\") " pod="openshift-multus/multus-additional-cni-plugins-rw5kn" Jul 29 16:06:45.548852 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.548511 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-tmp\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.548852 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.548520 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e-cnibin\") pod \"multus-additional-cni-plugins-rw5kn\" (UID: \"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e\") " pod="openshift-multus/multus-additional-cni-plugins-rw5kn" Jul 29 16:06:45.548852 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.548547 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-systemd-units\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.548852 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.548574 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-host-slash\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.548852 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.548620 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-host-run-netns\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.548852 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.548723 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/31819202-a49a-4346-b291-656fc68edcd8-ovnkube-script-lib\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.549855 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.548994 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f75274e-f78e-4656-ad34-0e149d4dff5b-dbus\") pod \"global-pull-secret-syncer-ttc2b\" (UID: \"3f75274e-f78e-4656-ad34-0e149d4dff5b\") " pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:06:45.549855 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.549202 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c5d99ada-6f3f-478c-8265-6b3fd3868f67-iptables-alerter-script\") pod \"iptables-alerter-xtclz\" (UID: \"c5d99ada-6f3f-478c-8265-6b3fd3868f67\") " pod="openshift-network-operator/iptables-alerter-xtclz" Jul 29 16:06:45.549855 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.549227 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-run-systemd\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.549855 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.549274 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/31819202-a49a-4346-b291-656fc68edcd8-env-overrides\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.549855 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.549271 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-host-cni-netd\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.549855 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.549307 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-etc-tuned\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.549855 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.549329 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rw5kn\" (UID: \"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e\") " pod="openshift-multus/multus-additional-cni-plugins-rw5kn" Jul 29 16:06:45.549855 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.549366 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvsxf\" (UniqueName: \"kubernetes.io/projected/31819202-a49a-4346-b291-656fc68edcd8-kube-api-access-lvsxf\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.549855 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.549397 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-host-run-ovn-kubernetes\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.549855 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.549406 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6nw7\" (UniqueName: \"kubernetes.io/projected/b9a3fc6f-b673-4770-a62a-7044ea9d3e72-kube-api-access-v6nw7\") pod \"node-resolver-kvkdw\" (UID: \"b9a3fc6f-b673-4770-a62a-7044ea9d3e72\") " pod="openshift-dns/node-resolver-kvkdw" Jul 29 16:06:45.549855 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.549443 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-etc-modprobe-d\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.551149 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.551099 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rw5kn\" (UID: \"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e\") " pod="openshift-multus/multus-additional-cni-plugins-rw5kn" Jul 29 16:06:45.551297 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.551267 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-lib-modules\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.553619 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:45.551476 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:06:45.553619 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:45.551550 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8df6793f-3b49-4b29-ae90-d18f79c16891-metrics-certs podName:8df6793f-3b49-4b29-ae90-d18f79c16891 nodeName:}" failed. No retries permitted until 2026-07-29 16:06:46.051531666 +0000 UTC m=+3.069352910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8df6793f-3b49-4b29-ae90-d18f79c16891-metrics-certs") pod "network-metrics-daemon-z978p" (UID: "8df6793f-3b49-4b29-ae90-d18f79c16891") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:06:45.553619 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.551541 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e-cnibin\") pod \"multus-additional-cni-plugins-rw5kn\" (UID: \"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e\") " pod="openshift-multus/multus-additional-cni-plugins-rw5kn" Jul 29 16:06:45.553619 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.551716 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/31819202-a49a-4346-b291-656fc68edcd8-ovn-node-metrics-cert\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.553619 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.551760 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/76f8dffe-ddd3-416f-a108-9c49f4e33812-serviceca\") pod \"node-ca-h2bbk\" (UID: \"76f8dffe-ddd3-416f-a108-9c49f4e33812\") " pod="openshift-image-registry/node-ca-h2bbk" Jul 29 16:06:45.553619 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.552276 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e-cni-binary-copy\") pod \"multus-additional-cni-plugins-rw5kn\" (UID: \"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e\") " pod="openshift-multus/multus-additional-cni-plugins-rw5kn" Jul 29 16:06:45.553619 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.552529 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-host-slash\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.553619 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.552591 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-etc-modprobe-d\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.553619 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.552596 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-host-run-netns\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.553619 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.553312 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-run-systemd\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.553619 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.553394 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4b898523-6b95-417d-9d35-abf57ef9668d-device-dir\") pod \"aws-ebs-csi-driver-node-qxrzk\" (UID: \"4b898523-6b95-417d-9d35-abf57ef9668d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxrzk" Jul 29 16:06:45.553619 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.553427 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e-system-cni-dir\") pod \"multus-additional-cni-plugins-rw5kn\" (UID: \"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e\") " pod="openshift-multus/multus-additional-cni-plugins-rw5kn" Jul 29 16:06:45.553619 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.553539 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-etc-sysctl-conf\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.554391 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.553790 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltfnv\" (UniqueName: \"kubernetes.io/projected/7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e-kube-api-access-ltfnv\") pod \"multus-additional-cni-plugins-rw5kn\" (UID: \"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e\") " pod="openshift-multus/multus-additional-cni-plugins-rw5kn" Jul 29 16:06:45.554391 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.553967 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-var-lib-openvswitch\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.554391 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.554050 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9a3fc6f-b673-4770-a62a-7044ea9d3e72-tmp-dir\") pod \"node-resolver-kvkdw\" (UID: \"b9a3fc6f-b673-4770-a62a-7044ea9d3e72\") " pod="openshift-dns/node-resolver-kvkdw" Jul 29 16:06:45.554391 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.554078 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4c0bfb07-ebbd-42da-a385-becaf4056a28-konnectivity-ca\") pod \"konnectivity-agent-b84c6\" (UID: \"4c0bfb07-ebbd-42da-a385-becaf4056a28\") " pod="kube-system/konnectivity-agent-b84c6" Jul 29 16:06:45.554391 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.554158 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e-os-release\") pod \"multus-additional-cni-plugins-rw5kn\" (UID: \"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e\") " pod="openshift-multus/multus-additional-cni-plugins-rw5kn" Jul 29 16:06:45.554391 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.554238 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-var-lib-openvswitch\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.554391 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.554358 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4b898523-6b95-417d-9d35-abf57ef9668d-etc-selinux\") pod \"aws-ebs-csi-driver-node-qxrzk\" (UID: \"4b898523-6b95-417d-9d35-abf57ef9668d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxrzk" Jul 29 16:06:45.554807 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.554772 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9a3fc6f-b673-4770-a62a-7044ea9d3e72-tmp-dir\") pod \"node-resolver-kvkdw\" (UID: \"b9a3fc6f-b673-4770-a62a-7044ea9d3e72\") " pod="openshift-dns/node-resolver-kvkdw" Jul 29 16:06:45.554887 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.554871 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/31819202-a49a-4346-b291-656fc68edcd8-env-overrides\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.556142 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.555028 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rw5kn\" (UID: \"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e\") " pod="openshift-multus/multus-additional-cni-plugins-rw5kn" Jul 29 16:06:45.556142 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.555079 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/31819202-a49a-4346-b291-656fc68edcd8-systemd-units\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.556142 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.555140 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b9a3fc6f-b673-4770-a62a-7044ea9d3e72-hosts-file\") pod \"node-resolver-kvkdw\" (UID: \"b9a3fc6f-b673-4770-a62a-7044ea9d3e72\") " pod="openshift-dns/node-resolver-kvkdw" Jul 29 16:06:45.556142 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.555123 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4c0bfb07-ebbd-42da-a385-becaf4056a28-agent-certs\") pod \"konnectivity-agent-b84c6\" (UID: \"4c0bfb07-ebbd-42da-a385-becaf4056a28\") " pod="kube-system/konnectivity-agent-b84c6" Jul 29 16:06:45.556142 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.555280 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e-system-cni-dir\") pod \"multus-additional-cni-plugins-rw5kn\" (UID: \"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e\") " pod="openshift-multus/multus-additional-cni-plugins-rw5kn" Jul 29 16:06:45.558699 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.558672 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-etc-tuned\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.559764 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.559500 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndg2j\" (UniqueName: \"kubernetes.io/projected/76f8dffe-ddd3-416f-a108-9c49f4e33812-kube-api-access-ndg2j\") pod \"node-ca-h2bbk\" (UID: \"76f8dffe-ddd3-416f-a108-9c49f4e33812\") " pod="openshift-image-registry/node-ca-h2bbk" Jul 29 16:06:45.559764 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.559691 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7fg7\" (UniqueName: \"kubernetes.io/projected/8df6793f-3b49-4b29-ae90-d18f79c16891-kube-api-access-n7fg7\") pod \"network-metrics-daemon-z978p\" (UID: \"8df6793f-3b49-4b29-ae90-d18f79c16891\") " pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:06:45.560253 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.560218 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx2g9\" (UniqueName: \"kubernetes.io/projected/2f886ffd-1453-4088-9cb3-4e5c4c0f13c6-kube-api-access-mx2g9\") pod \"tuned-k2t27\" (UID: \"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6\") " pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.561299 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.561277 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssp9r\" (UniqueName: \"kubernetes.io/projected/c5d99ada-6f3f-478c-8265-6b3fd3868f67-kube-api-access-ssp9r\") pod \"iptables-alerter-xtclz\" (UID: \"c5d99ada-6f3f-478c-8265-6b3fd3868f67\") " pod="openshift-network-operator/iptables-alerter-xtclz" Jul 29 16:06:45.561390 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.561275 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94jxl\" (UniqueName: \"kubernetes.io/projected/4b898523-6b95-417d-9d35-abf57ef9668d-kube-api-access-94jxl\") pod \"aws-ebs-csi-driver-node-qxrzk\" (UID: \"4b898523-6b95-417d-9d35-abf57ef9668d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxrzk" Jul 29 16:06:45.562261 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.562232 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvsxf\" (UniqueName: \"kubernetes.io/projected/31819202-a49a-4346-b291-656fc68edcd8-kube-api-access-lvsxf\") pod \"ovnkube-node-wqzt9\" (UID: \"31819202-a49a-4346-b291-656fc68edcd8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.563991 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.563971 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6nw7\" (UniqueName: \"kubernetes.io/projected/b9a3fc6f-b673-4770-a62a-7044ea9d3e72-kube-api-access-v6nw7\") pod \"node-resolver-kvkdw\" (UID: \"b9a3fc6f-b673-4770-a62a-7044ea9d3e72\") " pod="openshift-dns/node-resolver-kvkdw" Jul 29 16:06:45.568007 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.567986 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltfnv\" (UniqueName: \"kubernetes.io/projected/7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e-kube-api-access-ltfnv\") pod \"multus-additional-cni-plugins-rw5kn\" (UID: \"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e\") " pod="openshift-multus/multus-additional-cni-plugins-rw5kn" Jul 29 16:06:45.642180 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.642149 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ndx86" Jul 29 16:06:45.651242 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.651209 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k2t27" Jul 29 16:06:45.664594 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.664576 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kvkdw" Jul 29 16:06:45.671370 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.671341 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h2bbk" Jul 29 16:06:45.678238 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.678219 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rw5kn" Jul 29 16:06:45.687074 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.687050 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b84c6" Jul 29 16:06:45.696949 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.696930 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxrzk" Jul 29 16:06:45.704851 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.704835 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xtclz" Jul 29 16:06:45.710908 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.710889 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:06:45.956519 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:45.956438 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kpjc\" (UniqueName: \"kubernetes.io/projected/066859ca-e247-4082-b6f9-d758329a31e5-kube-api-access-2kpjc\") pod \"network-check-target-pxg62\" (UID: \"066859ca-e247-4082-b6f9-d758329a31e5\") " pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:06:45.956659 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:45.956640 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 16:06:45.956706 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:45.956665 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 16:06:45.956706 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:45.956676 2563 projected.go:196] Error preparing data for projected volume kube-api-access-2kpjc for pod openshift-network-diagnostics/network-check-target-pxg62: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:06:45.956786 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:45.956732 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/066859ca-e247-4082-b6f9-d758329a31e5-kube-api-access-2kpjc podName:066859ca-e247-4082-b6f9-d758329a31e5 nodeName:}" failed. No retries permitted until 2026-07-29 16:06:46.956716627 +0000 UTC m=+3.974537854 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2kpjc" (UniqueName: "kubernetes.io/projected/066859ca-e247-4082-b6f9-d758329a31e5-kube-api-access-2kpjc") pod "network-check-target-pxg62" (UID: "066859ca-e247-4082-b6f9-d758329a31e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:06:46.056846 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:46.056810 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8df6793f-3b49-4b29-ae90-d18f79c16891-metrics-certs\") pod \"network-metrics-daemon-z978p\" (UID: \"8df6793f-3b49-4b29-ae90-d18f79c16891\") " pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:06:46.057027 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:46.056936 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f75274e-f78e-4656-ad34-0e149d4dff5b-original-pull-secret\") pod \"global-pull-secret-syncer-ttc2b\" (UID: \"3f75274e-f78e-4656-ad34-0e149d4dff5b\") " pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:06:46.057027 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:46.056998 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:06:46.057027 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:46.057023 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 16:06:46.057210 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:46.057080 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8df6793f-3b49-4b29-ae90-d18f79c16891-metrics-certs podName:8df6793f-3b49-4b29-ae90-d18f79c16891 nodeName:}" failed. No retries permitted until 2026-07-29 16:06:47.057056548 +0000 UTC m=+4.074877796 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8df6793f-3b49-4b29-ae90-d18f79c16891-metrics-certs") pod "network-metrics-daemon-z978p" (UID: "8df6793f-3b49-4b29-ae90-d18f79c16891") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:06:46.057210 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:46.057103 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f75274e-f78e-4656-ad34-0e149d4dff5b-original-pull-secret podName:3f75274e-f78e-4656-ad34-0e149d4dff5b nodeName:}" failed. No retries permitted until 2026-07-29 16:06:47.057092079 +0000 UTC m=+4.074913307 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f75274e-f78e-4656-ad34-0e149d4dff5b-original-pull-secret") pod "global-pull-secret-syncer-ttc2b" (UID: "3f75274e-f78e-4656-ad34-0e149d4dff5b") : object "kube-system"/"original-pull-secret" not registered Jul 29 16:06:46.248071 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:46.247989 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b92bd00_f9d7_4285_b1ea_163dc3e5ef4e.slice/crio-b92dba30d8a259db7c49e405a912f9d6aaa9f1264b46a315cb97aa12f6ea912e WatchSource:0}: Error finding container b92dba30d8a259db7c49e405a912f9d6aaa9f1264b46a315cb97aa12f6ea912e: Status 404 returned error can't find the container with id b92dba30d8a259db7c49e405a912f9d6aaa9f1264b46a315cb97aa12f6ea912e Jul 29 16:06:46.248859 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:46.248822 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f886ffd_1453_4088_9cb3_4e5c4c0f13c6.slice/crio-49e1c1d91631a91820d8f52b8d7b729d73c67901bf2489ccacf7f06c81f3df40 WatchSource:0}: Error finding container 49e1c1d91631a91820d8f52b8d7b729d73c67901bf2489ccacf7f06c81f3df40: Status 404 returned error can't find the container with id 49e1c1d91631a91820d8f52b8d7b729d73c67901bf2489ccacf7f06c81f3df40 Jul 29 16:06:46.251788 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:46.251662 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod188d7124_3dec_4f1c_96bc_2f334a0d4367.slice/crio-d17944b591432792a0b8823c0865bbde49f9d43e15a28afbcae7d88e8ac3035e WatchSource:0}: Error finding container d17944b591432792a0b8823c0865bbde49f9d43e15a28afbcae7d88e8ac3035e: Status 404 returned error can't find the container with id d17944b591432792a0b8823c0865bbde49f9d43e15a28afbcae7d88e8ac3035e Jul 29 16:06:46.252676 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:46.252655 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76f8dffe_ddd3_416f_a108_9c49f4e33812.slice/crio-29946e91812078cd7bff711cf594fb3edf5e26659901beec8d5d5e7d625071a5 WatchSource:0}: Error finding container 29946e91812078cd7bff711cf594fb3edf5e26659901beec8d5d5e7d625071a5: Status 404 returned error can't find the container with id 29946e91812078cd7bff711cf594fb3edf5e26659901beec8d5d5e7d625071a5 Jul 29 16:06:46.254289 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:46.254270 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31819202_a49a_4346_b291_656fc68edcd8.slice/crio-e0b39d155efa8388049c192854dc96503e6869a6cae821b32a7b991c18182336 WatchSource:0}: Error finding container e0b39d155efa8388049c192854dc96503e6869a6cae821b32a7b991c18182336: Status 404 returned error can't find the container with id e0b39d155efa8388049c192854dc96503e6869a6cae821b32a7b991c18182336 Jul 29 16:06:46.255983 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:46.255959 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b898523_6b95_417d_9d35_abf57ef9668d.slice/crio-a33e36606b4082fa4319a579f59bf900673bbc80d8e586b055b4a41b8ccc248c WatchSource:0}: Error finding container a33e36606b4082fa4319a579f59bf900673bbc80d8e586b055b4a41b8ccc248c: Status 404 returned error can't find the container with id a33e36606b4082fa4319a579f59bf900673bbc80d8e586b055b4a41b8ccc248c Jul 29 16:06:46.257264 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:46.257237 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5d99ada_6f3f_478c_8265_6b3fd3868f67.slice/crio-89777cf1271a24d42ac92f19022baa386143dc02f8adec5b6ffe5794787655d3 WatchSource:0}: Error finding container 89777cf1271a24d42ac92f19022baa386143dc02f8adec5b6ffe5794787655d3: Status 404 returned error can't find the container with id 89777cf1271a24d42ac92f19022baa386143dc02f8adec5b6ffe5794787655d3 Jul 29 16:06:46.258243 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:46.258194 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9a3fc6f_b673_4770_a62a_7044ea9d3e72.slice/crio-bea203e7ca1eca9f686f9010fd26567d10020e24e87460767ce91e0ce49ec8fa WatchSource:0}: Error finding container bea203e7ca1eca9f686f9010fd26567d10020e24e87460767ce91e0ce49ec8fa: Status 404 returned error can't find the container with id bea203e7ca1eca9f686f9010fd26567d10020e24e87460767ce91e0ce49ec8fa Jul 29 16:06:46.260078 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:46.259949 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c0bfb07_ebbd_42da_a385_becaf4056a28.slice/crio-aecc6e748fcb9d1e8652a45a5d7a11b36be9f200da6cf10a7c2128a8fae3d354 WatchSource:0}: Error finding container aecc6e748fcb9d1e8652a45a5d7a11b36be9f200da6cf10a7c2128a8fae3d354: Status 404 returned error can't find the container with id aecc6e748fcb9d1e8652a45a5d7a11b36be9f200da6cf10a7c2128a8fae3d354 Jul 29 16:06:46.303531 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:06:46.303511 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21cfd4953a54adbfe7241648da9fa238.slice/crio-16d7bb584958e16151683643625457d7f49c171503f47e520d077ed65ad54b38 WatchSource:0}: Error finding container 16d7bb584958e16151683643625457d7f49c171503f47e520d077ed65ad54b38: Status 404 returned error can't find the container with id 16d7bb584958e16151683643625457d7f49c171503f47e520d077ed65ad54b38 Jul 29 16:06:46.384143 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:46.384113 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 16:01:46 +0000 UTC" deadline="2028-04-17 18:42:55.532940198 +0000 UTC" Jul 29 16:06:46.384509 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:46.384144 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15074h36m9.148801085s" Jul 29 16:06:46.543917 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:46.543849 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xtclz" event={"ID":"c5d99ada-6f3f-478c-8265-6b3fd3868f67","Type":"ContainerStarted","Data":"89777cf1271a24d42ac92f19022baa386143dc02f8adec5b6ffe5794787655d3"} Jul 29 16:06:46.544832 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:46.544804 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k2t27" event={"ID":"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6","Type":"ContainerStarted","Data":"49e1c1d91631a91820d8f52b8d7b729d73c67901bf2489ccacf7f06c81f3df40"} Jul 29 16:06:46.546540 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:46.546512 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-212.ec2.internal" event={"ID":"0895cdd09b066c024f59b1f6d999c0ab","Type":"ContainerStarted","Data":"888d099f598368b4fe497b806cd9d82bcc6a6c72550ddb7f9146ff151566f55b"} Jul 29 16:06:46.547683 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:46.547650 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal" event={"ID":"21cfd4953a54adbfe7241648da9fa238","Type":"ContainerStarted","Data":"16d7bb584958e16151683643625457d7f49c171503f47e520d077ed65ad54b38"} Jul 29 16:06:46.548688 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:46.548672 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kvkdw" event={"ID":"b9a3fc6f-b673-4770-a62a-7044ea9d3e72","Type":"ContainerStarted","Data":"bea203e7ca1eca9f686f9010fd26567d10020e24e87460767ce91e0ce49ec8fa"} Jul 29 16:06:46.549685 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:46.549659 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxrzk" event={"ID":"4b898523-6b95-417d-9d35-abf57ef9668d","Type":"ContainerStarted","Data":"a33e36606b4082fa4319a579f59bf900673bbc80d8e586b055b4a41b8ccc248c"} Jul 29 16:06:46.550756 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:46.550732 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" event={"ID":"31819202-a49a-4346-b291-656fc68edcd8","Type":"ContainerStarted","Data":"e0b39d155efa8388049c192854dc96503e6869a6cae821b32a7b991c18182336"} Jul 29 16:06:46.551683 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:46.551666 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h2bbk" event={"ID":"76f8dffe-ddd3-416f-a108-9c49f4e33812","Type":"ContainerStarted","Data":"29946e91812078cd7bff711cf594fb3edf5e26659901beec8d5d5e7d625071a5"} Jul 29 16:06:46.552693 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:46.552676 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ndx86" event={"ID":"188d7124-3dec-4f1c-96bc-2f334a0d4367","Type":"ContainerStarted","Data":"d17944b591432792a0b8823c0865bbde49f9d43e15a28afbcae7d88e8ac3035e"} Jul 29 16:06:46.553720 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:46.553686 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rw5kn" event={"ID":"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e","Type":"ContainerStarted","Data":"b92dba30d8a259db7c49e405a912f9d6aaa9f1264b46a315cb97aa12f6ea912e"} Jul 29 16:06:46.554636 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:46.554612 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b84c6" event={"ID":"4c0bfb07-ebbd-42da-a385-becaf4056a28","Type":"ContainerStarted","Data":"aecc6e748fcb9d1e8652a45a5d7a11b36be9f200da6cf10a7c2128a8fae3d354"} Jul 29 16:06:46.589948 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:46.589896 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-212.ec2.internal" podStartSLOduration=1.589882494 podStartE2EDuration="1.589882494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:06:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:06:46.587829514 +0000 UTC m=+3.605650763" watchObservedRunningTime="2026-07-29 16:06:46.589882494 +0000 UTC m=+3.607703744" Jul 29 16:06:46.963754 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:46.963708 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kpjc\" (UniqueName: \"kubernetes.io/projected/066859ca-e247-4082-b6f9-d758329a31e5-kube-api-access-2kpjc\") pod \"network-check-target-pxg62\" (UID: \"066859ca-e247-4082-b6f9-d758329a31e5\") " pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:06:46.963937 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:46.963916 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 16:06:46.963937 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:46.963937 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 16:06:46.964065 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:46.963953 2563 projected.go:196] Error preparing data for projected volume kube-api-access-2kpjc for pod openshift-network-diagnostics/network-check-target-pxg62: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:06:46.964065 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:46.964015 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/066859ca-e247-4082-b6f9-d758329a31e5-kube-api-access-2kpjc podName:066859ca-e247-4082-b6f9-d758329a31e5 nodeName:}" failed. No retries permitted until 2026-07-29 16:06:48.96399456 +0000 UTC m=+5.981815790 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2kpjc" (UniqueName: "kubernetes.io/projected/066859ca-e247-4082-b6f9-d758329a31e5-kube-api-access-2kpjc") pod "network-check-target-pxg62" (UID: "066859ca-e247-4082-b6f9-d758329a31e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:06:47.064515 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:47.064477 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f75274e-f78e-4656-ad34-0e149d4dff5b-original-pull-secret\") pod \"global-pull-secret-syncer-ttc2b\" (UID: \"3f75274e-f78e-4656-ad34-0e149d4dff5b\") " pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:06:47.064686 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:47.064536 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8df6793f-3b49-4b29-ae90-d18f79c16891-metrics-certs\") pod \"network-metrics-daemon-z978p\" (UID: \"8df6793f-3b49-4b29-ae90-d18f79c16891\") " pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:06:47.064686 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:47.064668 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:06:47.064810 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:47.064730 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8df6793f-3b49-4b29-ae90-d18f79c16891-metrics-certs podName:8df6793f-3b49-4b29-ae90-d18f79c16891 nodeName:}" failed. No retries permitted until 2026-07-29 16:06:49.064710569 +0000 UTC m=+6.082531812 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8df6793f-3b49-4b29-ae90-d18f79c16891-metrics-certs") pod "network-metrics-daemon-z978p" (UID: "8df6793f-3b49-4b29-ae90-d18f79c16891") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:06:47.064940 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:47.064920 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 16:06:47.065018 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:47.064975 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f75274e-f78e-4656-ad34-0e149d4dff5b-original-pull-secret podName:3f75274e-f78e-4656-ad34-0e149d4dff5b nodeName:}" failed. No retries permitted until 2026-07-29 16:06:49.064960633 +0000 UTC m=+6.082781865 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f75274e-f78e-4656-ad34-0e149d4dff5b-original-pull-secret") pod "global-pull-secret-syncer-ttc2b" (UID: "3f75274e-f78e-4656-ad34-0e149d4dff5b") : object "kube-system"/"original-pull-secret" not registered Jul 29 16:06:47.385118 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:47.384992 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 16:01:46 +0000 UTC" deadline="2028-02-11 06:36:46.190585673 +0000 UTC" Jul 29 16:06:47.385118 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:47.385039 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13478h29m58.805552194s" Jul 29 16:06:47.538004 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:47.537961 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:06:47.538168 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:47.538110 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttc2b" podUID="3f75274e-f78e-4656-ad34-0e149d4dff5b" Jul 29 16:06:47.538869 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:47.537961 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:06:47.538869 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:47.538603 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxg62" podUID="066859ca-e247-4082-b6f9-d758329a31e5" Jul 29 16:06:47.538869 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:47.538700 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:06:47.538869 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:47.538799 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z978p" podUID="8df6793f-3b49-4b29-ae90-d18f79c16891" Jul 29 16:06:48.980754 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:48.980706 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kpjc\" (UniqueName: \"kubernetes.io/projected/066859ca-e247-4082-b6f9-d758329a31e5-kube-api-access-2kpjc\") pod \"network-check-target-pxg62\" (UID: \"066859ca-e247-4082-b6f9-d758329a31e5\") " pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:06:48.981303 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:48.980917 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 16:06:48.981303 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:48.980962 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 16:06:48.981303 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:48.980977 2563 projected.go:196] Error preparing data for projected volume kube-api-access-2kpjc for pod openshift-network-diagnostics/network-check-target-pxg62: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:06:48.981303 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:48.981043 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/066859ca-e247-4082-b6f9-d758329a31e5-kube-api-access-2kpjc podName:066859ca-e247-4082-b6f9-d758329a31e5 nodeName:}" failed. No retries permitted until 2026-07-29 16:06:52.981022231 +0000 UTC m=+9.998843463 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2kpjc" (UniqueName: "kubernetes.io/projected/066859ca-e247-4082-b6f9-d758329a31e5-kube-api-access-2kpjc") pod "network-check-target-pxg62" (UID: "066859ca-e247-4082-b6f9-d758329a31e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:06:49.081682 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:49.081637 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8df6793f-3b49-4b29-ae90-d18f79c16891-metrics-certs\") pod \"network-metrics-daemon-z978p\" (UID: \"8df6793f-3b49-4b29-ae90-d18f79c16891\") " pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:06:49.081897 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:49.081751 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f75274e-f78e-4656-ad34-0e149d4dff5b-original-pull-secret\") pod \"global-pull-secret-syncer-ttc2b\" (UID: \"3f75274e-f78e-4656-ad34-0e149d4dff5b\") " pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:06:49.081947 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:49.081919 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 16:06:49.082004 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:49.081990 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f75274e-f78e-4656-ad34-0e149d4dff5b-original-pull-secret podName:3f75274e-f78e-4656-ad34-0e149d4dff5b nodeName:}" failed. No retries permitted until 2026-07-29 16:06:53.081969118 +0000 UTC m=+10.099790350 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f75274e-f78e-4656-ad34-0e149d4dff5b-original-pull-secret") pod "global-pull-secret-syncer-ttc2b" (UID: "3f75274e-f78e-4656-ad34-0e149d4dff5b") : object "kube-system"/"original-pull-secret" not registered Jul 29 16:06:49.082450 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:49.082432 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:06:49.082511 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:49.082492 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8df6793f-3b49-4b29-ae90-d18f79c16891-metrics-certs podName:8df6793f-3b49-4b29-ae90-d18f79c16891 nodeName:}" failed. No retries permitted until 2026-07-29 16:06:53.082475277 +0000 UTC m=+10.100296503 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8df6793f-3b49-4b29-ae90-d18f79c16891-metrics-certs") pod "network-metrics-daemon-z978p" (UID: "8df6793f-3b49-4b29-ae90-d18f79c16891") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:06:49.537942 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:49.537908 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:06:49.538143 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:49.537957 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:06:49.538143 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:49.538045 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxg62" podUID="066859ca-e247-4082-b6f9-d758329a31e5" Jul 29 16:06:49.538143 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:49.538119 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:06:49.538311 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:49.538240 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z978p" podUID="8df6793f-3b49-4b29-ae90-d18f79c16891" Jul 29 16:06:49.538383 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:49.538326 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttc2b" podUID="3f75274e-f78e-4656-ad34-0e149d4dff5b" Jul 29 16:06:51.537486 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:51.537452 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:06:51.538060 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:51.537453 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:06:51.538060 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:51.537631 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z978p" podUID="8df6793f-3b49-4b29-ae90-d18f79c16891" Jul 29 16:06:51.538060 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:51.537739 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxg62" podUID="066859ca-e247-4082-b6f9-d758329a31e5" Jul 29 16:06:51.538060 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:51.537809 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:06:51.538060 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:51.537890 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttc2b" podUID="3f75274e-f78e-4656-ad34-0e149d4dff5b" Jul 29 16:06:53.017326 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:53.017267 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kpjc\" (UniqueName: \"kubernetes.io/projected/066859ca-e247-4082-b6f9-d758329a31e5-kube-api-access-2kpjc\") pod \"network-check-target-pxg62\" (UID: \"066859ca-e247-4082-b6f9-d758329a31e5\") " pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:06:53.017918 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:53.017468 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 16:06:53.017918 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:53.017490 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 16:06:53.017918 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:53.017500 2563 projected.go:196] Error preparing data for projected volume kube-api-access-2kpjc for pod openshift-network-diagnostics/network-check-target-pxg62: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:06:53.017918 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:53.017552 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/066859ca-e247-4082-b6f9-d758329a31e5-kube-api-access-2kpjc podName:066859ca-e247-4082-b6f9-d758329a31e5 nodeName:}" failed. No retries permitted until 2026-07-29 16:07:01.017532583 +0000 UTC m=+18.035353812 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2kpjc" (UniqueName: "kubernetes.io/projected/066859ca-e247-4082-b6f9-d758329a31e5-kube-api-access-2kpjc") pod "network-check-target-pxg62" (UID: "066859ca-e247-4082-b6f9-d758329a31e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:06:53.117730 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:53.117691 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8df6793f-3b49-4b29-ae90-d18f79c16891-metrics-certs\") pod \"network-metrics-daemon-z978p\" (UID: \"8df6793f-3b49-4b29-ae90-d18f79c16891\") " pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:06:53.117914 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:53.117816 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f75274e-f78e-4656-ad34-0e149d4dff5b-original-pull-secret\") pod \"global-pull-secret-syncer-ttc2b\" (UID: \"3f75274e-f78e-4656-ad34-0e149d4dff5b\") " pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:06:53.117962 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:53.117953 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 16:06:53.118006 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:53.117964 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:06:53.118042 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:53.118015 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f75274e-f78e-4656-ad34-0e149d4dff5b-original-pull-secret podName:3f75274e-f78e-4656-ad34-0e149d4dff5b nodeName:}" failed. No retries permitted until 2026-07-29 16:07:01.117995374 +0000 UTC m=+18.135816615 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f75274e-f78e-4656-ad34-0e149d4dff5b-original-pull-secret") pod "global-pull-secret-syncer-ttc2b" (UID: "3f75274e-f78e-4656-ad34-0e149d4dff5b") : object "kube-system"/"original-pull-secret" not registered Jul 29 16:06:53.118042 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:53.118037 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8df6793f-3b49-4b29-ae90-d18f79c16891-metrics-certs podName:8df6793f-3b49-4b29-ae90-d18f79c16891 nodeName:}" failed. No retries permitted until 2026-07-29 16:07:01.11802615 +0000 UTC m=+18.135847376 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8df6793f-3b49-4b29-ae90-d18f79c16891-metrics-certs") pod "network-metrics-daemon-z978p" (UID: "8df6793f-3b49-4b29-ae90-d18f79c16891") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:06:53.538698 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:53.537944 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:06:53.538698 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:53.538078 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z978p" podUID="8df6793f-3b49-4b29-ae90-d18f79c16891" Jul 29 16:06:53.538698 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:53.538449 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:06:53.538698 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:53.538539 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxg62" podUID="066859ca-e247-4082-b6f9-d758329a31e5" Jul 29 16:06:53.538698 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:53.538596 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:06:53.538698 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:53.538664 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttc2b" podUID="3f75274e-f78e-4656-ad34-0e149d4dff5b" Jul 29 16:06:55.538662 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:55.538626 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:06:55.539139 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:55.538781 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z978p" podUID="8df6793f-3b49-4b29-ae90-d18f79c16891" Jul 29 16:06:55.539202 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:55.539169 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:06:55.539454 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:55.539265 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxg62" podUID="066859ca-e247-4082-b6f9-d758329a31e5" Jul 29 16:06:55.539454 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:55.539424 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:06:55.539593 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:55.539505 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttc2b" podUID="3f75274e-f78e-4656-ad34-0e149d4dff5b" Jul 29 16:06:57.537859 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:57.537827 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:06:57.538270 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:57.537829 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:06:57.538270 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:57.537957 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttc2b" podUID="3f75274e-f78e-4656-ad34-0e149d4dff5b" Jul 29 16:06:57.538270 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:57.537829 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:06:57.538270 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:57.538032 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z978p" podUID="8df6793f-3b49-4b29-ae90-d18f79c16891" Jul 29 16:06:57.538270 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:57.538079 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxg62" podUID="066859ca-e247-4082-b6f9-d758329a31e5" Jul 29 16:06:59.537241 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:59.537201 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:06:59.537713 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:59.537246 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:06:59.537713 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:06:59.537341 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:06:59.537713 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:59.537354 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z978p" podUID="8df6793f-3b49-4b29-ae90-d18f79c16891" Jul 29 16:06:59.537713 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:59.537447 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxg62" podUID="066859ca-e247-4082-b6f9-d758329a31e5" Jul 29 16:06:59.537713 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:06:59.537526 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttc2b" podUID="3f75274e-f78e-4656-ad34-0e149d4dff5b" Jul 29 16:07:01.080581 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:01.080541 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kpjc\" (UniqueName: \"kubernetes.io/projected/066859ca-e247-4082-b6f9-d758329a31e5-kube-api-access-2kpjc\") pod \"network-check-target-pxg62\" (UID: \"066859ca-e247-4082-b6f9-d758329a31e5\") " pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:07:01.081049 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:01.080705 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 16:07:01.081049 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:01.080728 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 16:07:01.081049 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:01.080739 2563 projected.go:196] Error preparing data for projected volume kube-api-access-2kpjc for pod openshift-network-diagnostics/network-check-target-pxg62: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:07:01.081049 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:01.080809 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/066859ca-e247-4082-b6f9-d758329a31e5-kube-api-access-2kpjc podName:066859ca-e247-4082-b6f9-d758329a31e5 nodeName:}" failed. No retries permitted until 2026-07-29 16:07:17.080791046 +0000 UTC m=+34.098612270 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2kpjc" (UniqueName: "kubernetes.io/projected/066859ca-e247-4082-b6f9-d758329a31e5-kube-api-access-2kpjc") pod "network-check-target-pxg62" (UID: "066859ca-e247-4082-b6f9-d758329a31e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:07:01.181403 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:01.181356 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f75274e-f78e-4656-ad34-0e149d4dff5b-original-pull-secret\") pod \"global-pull-secret-syncer-ttc2b\" (UID: \"3f75274e-f78e-4656-ad34-0e149d4dff5b\") " pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:07:01.181589 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:01.181424 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8df6793f-3b49-4b29-ae90-d18f79c16891-metrics-certs\") pod \"network-metrics-daemon-z978p\" (UID: \"8df6793f-3b49-4b29-ae90-d18f79c16891\") " pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:07:01.181589 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:01.181511 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 16:07:01.181589 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:01.181553 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:07:01.181589 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:01.181578 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f75274e-f78e-4656-ad34-0e149d4dff5b-original-pull-secret podName:3f75274e-f78e-4656-ad34-0e149d4dff5b nodeName:}" failed. No retries permitted until 2026-07-29 16:07:17.18156188 +0000 UTC m=+34.199383108 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f75274e-f78e-4656-ad34-0e149d4dff5b-original-pull-secret") pod "global-pull-secret-syncer-ttc2b" (UID: "3f75274e-f78e-4656-ad34-0e149d4dff5b") : object "kube-system"/"original-pull-secret" not registered Jul 29 16:07:01.181756 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:01.181601 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8df6793f-3b49-4b29-ae90-d18f79c16891-metrics-certs podName:8df6793f-3b49-4b29-ae90-d18f79c16891 nodeName:}" failed. No retries permitted until 2026-07-29 16:07:17.181587065 +0000 UTC m=+34.199408312 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8df6793f-3b49-4b29-ae90-d18f79c16891-metrics-certs") pod "network-metrics-daemon-z978p" (UID: "8df6793f-3b49-4b29-ae90-d18f79c16891") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:07:01.537210 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:01.537172 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:07:01.537210 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:01.537195 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:07:01.537457 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:01.537311 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttc2b" podUID="3f75274e-f78e-4656-ad34-0e149d4dff5b" Jul 29 16:07:01.537457 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:01.537410 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z978p" podUID="8df6793f-3b49-4b29-ae90-d18f79c16891" Jul 29 16:07:01.537570 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:01.537477 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:07:01.537570 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:01.537546 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxg62" podUID="066859ca-e247-4082-b6f9-d758329a31e5" Jul 29 16:07:03.538659 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:03.538611 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:07:03.539061 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:03.538721 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:07:03.539061 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:03.538768 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxg62" podUID="066859ca-e247-4082-b6f9-d758329a31e5" Jul 29 16:07:03.539061 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:03.538824 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z978p" podUID="8df6793f-3b49-4b29-ae90-d18f79c16891" Jul 29 16:07:03.539061 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:03.538853 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:07:03.539061 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:03.538920 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttc2b" podUID="3f75274e-f78e-4656-ad34-0e149d4dff5b" Jul 29 16:07:05.537814 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:05.537788 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:07:05.537814 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:05.537806 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:07:05.537814 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:05.537818 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:07:05.538296 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:05.537925 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z978p" podUID="8df6793f-3b49-4b29-ae90-d18f79c16891" Jul 29 16:07:05.538296 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:05.537996 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxg62" podUID="066859ca-e247-4082-b6f9-d758329a31e5" Jul 29 16:07:05.538296 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:05.538071 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttc2b" podUID="3f75274e-f78e-4656-ad34-0e149d4dff5b" Jul 29 16:07:06.614887 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:06.614461 2563 generic.go:356] "Generic (PLEG): container finished" podID="7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e" containerID="cfc5694a87f276ec3e34dbdea9163101df3af521298bd8aa8978e1b3f58a670f" exitCode=0 Jul 29 16:07:06.615414 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:06.614518 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rw5kn" event={"ID":"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e","Type":"ContainerDied","Data":"cfc5694a87f276ec3e34dbdea9163101df3af521298bd8aa8978e1b3f58a670f"} Jul 29 16:07:06.616487 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:06.616459 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b84c6" event={"ID":"4c0bfb07-ebbd-42da-a385-becaf4056a28","Type":"ContainerStarted","Data":"ea43d0a6dab19860e9f7b3be07f8a40657b6334776734c90eb6a567301972cc4"} Jul 29 16:07:06.617969 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:06.617942 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k2t27" event={"ID":"2f886ffd-1453-4088-9cb3-4e5c4c0f13c6","Type":"ContainerStarted","Data":"28d7f4609c1b66fdb4fbc59c5a54294d778aa27d726fc8d828b73ca2cae76642"} Jul 29 16:07:06.619231 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:06.619210 2563 generic.go:356] "Generic (PLEG): container finished" podID="21cfd4953a54adbfe7241648da9fa238" containerID="7540b49213d59c4cb7a659e12c6f337389bd2bf2cd2b61e3f05e70b2ebd50d56" exitCode=0 Jul 29 16:07:06.619384 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:06.619274 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal" event={"ID":"21cfd4953a54adbfe7241648da9fa238","Type":"ContainerDied","Data":"7540b49213d59c4cb7a659e12c6f337389bd2bf2cd2b61e3f05e70b2ebd50d56"} Jul 29 16:07:06.620599 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:06.620576 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kvkdw" event={"ID":"b9a3fc6f-b673-4770-a62a-7044ea9d3e72","Type":"ContainerStarted","Data":"4fabdd18858bde52bc309d2c40c3e52121bb3da59a6a9afd124d6c51d0677771"} Jul 29 16:07:06.622203 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:06.622184 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxrzk" event={"ID":"4b898523-6b95-417d-9d35-abf57ef9668d","Type":"ContainerStarted","Data":"87a196361cc13fe17f8a70a828f333169616ca6cbec3d0ddd5d1b4d246b35157"} Jul 29 16:07:06.627144 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:06.627121 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" event={"ID":"31819202-a49a-4346-b291-656fc68edcd8","Type":"ContainerStarted","Data":"17d50eb0b4f35a6fe78c3d36e7383df8174fe54702ec71e68e20e5abc606ecd6"} Jul 29 16:07:06.627252 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:06.627196 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" event={"ID":"31819202-a49a-4346-b291-656fc68edcd8","Type":"ContainerStarted","Data":"aa0b56c5deb2f24f54e4d7781eb66bfe3e1dd605aa24b158f455872c4cb27cfd"} Jul 29 16:07:06.627252 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:06.627247 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" event={"ID":"31819202-a49a-4346-b291-656fc68edcd8","Type":"ContainerStarted","Data":"335234715d8d84a191ab4da115f1a2ad9f6ad79adb1d12b6d4365856b86f034d"} Jul 29 16:07:06.627413 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:06.627295 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" event={"ID":"31819202-a49a-4346-b291-656fc68edcd8","Type":"ContainerStarted","Data":"772eb71e5c698e90e2cb2d7df0c92e23a77379325fab8140724ef1ad51979335"} Jul 29 16:07:06.627413 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:06.627344 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" event={"ID":"31819202-a49a-4346-b291-656fc68edcd8","Type":"ContainerStarted","Data":"0b26e6b00b81c3572f9677fceabae2f77a3ddf92c5d29fc975396f2dc96c25ea"} Jul 29 16:07:06.627413 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:06.627388 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" event={"ID":"31819202-a49a-4346-b291-656fc68edcd8","Type":"ContainerStarted","Data":"c1e432e54be6bbe6e0a45bfad0f543eb0385e9deb67156141c01923a632215b1"} Jul 29 16:07:06.628550 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:06.628530 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h2bbk" event={"ID":"76f8dffe-ddd3-416f-a108-9c49f4e33812","Type":"ContainerStarted","Data":"fc3f33f6c2291103d7fd8b55c631f9cfbb5eb120014ab5d27453b6e3d28a3a7a"} Jul 29 16:07:06.630084 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:06.630060 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ndx86" event={"ID":"188d7124-3dec-4f1c-96bc-2f334a0d4367","Type":"ContainerStarted","Data":"b7fa19aa6a8633c9be3b36cc25e03d663612d8c68d0d8d3a779eb46ffd0149e8"} Jul 29 16:07:06.677262 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:06.677222 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kvkdw" podStartSLOduration=3.460217075 podStartE2EDuration="22.677209756s" totalImagesPullingTime="19.216992681s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:06:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:07:06.676988146 +0000 UTC m=+23.694809393" watchObservedRunningTime="2026-07-29 16:07:06.677209756 +0000 UTC m=+23.695031003" Jul 29 16:07:06.695625 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:06.695591 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-b84c6" podStartSLOduration=3.097251801 podStartE2EDuration="22.695579765s" totalImagesPullingTime="19.598327964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:06:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:07:06.69532427 +0000 UTC m=+23.713145516" watchObservedRunningTime="2026-07-29 16:07:06.695579765 +0000 UTC m=+23.713401012" Jul 29 16:07:06.715606 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:06.715574 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ndx86" podStartSLOduration=3.113089954 podStartE2EDuration="22.715562376s" totalImagesPullingTime="19.602472422s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:06:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:07:06.715228786 +0000 UTC m=+23.733050033" watchObservedRunningTime="2026-07-29 16:07:06.715562376 +0000 UTC m=+23.733383623" Jul 29 16:07:06.733247 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:06.733209 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-k2t27" podStartSLOduration=3.128002556 podStartE2EDuration="22.733197129s" totalImagesPullingTime="19.605194573s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:06:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:07:06.733189284 +0000 UTC m=+23.751010522" watchObservedRunningTime="2026-07-29 16:07:06.733197129 +0000 UTC m=+23.751018376" Jul 29 16:07:06.753109 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:06.753071 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-h2bbk" podStartSLOduration=3.131162432 podStartE2EDuration="22.75305945s" totalImagesPullingTime="19.621897018s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:06:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:07:06.752784608 +0000 UTC m=+23.770605854" watchObservedRunningTime="2026-07-29 16:07:06.75305945 +0000 UTC m=+23.770880698" Jul 29 16:07:07.017784 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:07.017727 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b84c6_4c0bfb07-ebbd-42da-a385-becaf4056a28/konnectivity-agent/0.log" limit=1024 Jul 29 16:07:07.228591 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:07.228561 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b84c6_4c0bfb07-ebbd-42da-a385-becaf4056a28/konnectivity-agent/0.log" limit=1024 Jul 29 16:07:07.422663 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:07.422634 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b84c6_4c0bfb07-ebbd-42da-a385-becaf4056a28/konnectivity-agent/0.log" limit=1024 Jul 29 16:07:07.537300 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:07.537279 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:07:07.537449 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:07.537385 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxg62" podUID="066859ca-e247-4082-b6f9-d758329a31e5" Jul 29 16:07:07.537449 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:07.537289 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:07:07.537449 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:07.537407 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:07:07.537612 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:07.537460 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttc2b" podUID="3f75274e-f78e-4656-ad34-0e149d4dff5b" Jul 29 16:07:07.537612 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:07.537526 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z978p" podUID="8df6793f-3b49-4b29-ae90-d18f79c16891" Jul 29 16:07:07.551222 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:07.551191 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 29 16:07:07.634550 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:07.634485 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal" event={"ID":"21cfd4953a54adbfe7241648da9fa238","Type":"ContainerStarted","Data":"1d805da4d32fa4fb64427eaf4c06f60066be7220506b9d3732b860ae7b13e698"} Jul 29 16:07:07.636573 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:07.636544 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxrzk" event={"ID":"4b898523-6b95-417d-9d35-abf57ef9668d","Type":"ContainerStarted","Data":"b296850802c619d13db79a329ef1d88906b07d15ae07ee94cb7e86f1dacab147"} Jul 29 16:07:07.638229 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:07.638204 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xtclz" event={"ID":"c5d99ada-6f3f-478c-8265-6b3fd3868f67","Type":"ContainerStarted","Data":"da5680f4f374c4d29d8c5a3380c9ee9f89f94a88f3ba65c2a94912177b5b73c9"} Jul 29 16:07:07.664798 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:07.664702 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal" podStartSLOduration=22.664689437 podStartE2EDuration="22.664689437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:06:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:07:07.649770629 +0000 UTC m=+24.667591876" watchObservedRunningTime="2026-07-29 16:07:07.664689437 +0000 UTC m=+24.682510683" Jul 29 16:07:07.664939 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:07.664862 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xtclz" podStartSLOduration=4.090847627 podStartE2EDuration="23.664855008s" totalImagesPullingTime="19.574007381s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:06:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:07:07.664323223 +0000 UTC m=+24.682144482" watchObservedRunningTime="2026-07-29 16:07:07.664855008 +0000 UTC m=+24.682676254" Jul 29 16:07:07.829659 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:07.829579 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b84c6_4c0bfb07-ebbd-42da-a385-becaf4056a28/konnectivity-agent/0.log" limit=1024 Jul 29 16:07:08.030616 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:08.030579 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b84c6_4c0bfb07-ebbd-42da-a385-becaf4056a28/konnectivity-agent/0.log" limit=1024 Jul 29 16:07:08.225209 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:08.225161 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b84c6_4c0bfb07-ebbd-42da-a385-becaf4056a28/konnectivity-agent/0.log" limit=1024 Jul 29 16:07:08.403282 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:08.403151 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T16:07:07.551207567Z","UUID":"f2400425-0576-4bae-9e06-fde3db8da43f","Handler":null,"Name":"","Endpoint":""} Jul 29 16:07:08.404854 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:08.404833 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 29 16:07:08.404976 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:08.404874 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 29 16:07:09.537882 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:09.537846 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:07:09.538417 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:09.537988 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z978p" podUID="8df6793f-3b49-4b29-ae90-d18f79c16891" Jul 29 16:07:09.538417 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:09.538386 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:07:09.538529 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:09.538479 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxg62" podUID="066859ca-e247-4082-b6f9-d758329a31e5" Jul 29 16:07:09.538585 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:09.538571 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:07:09.538687 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:09.538669 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttc2b" podUID="3f75274e-f78e-4656-ad34-0e149d4dff5b" Jul 29 16:07:09.645078 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:09.645038 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxrzk" event={"ID":"4b898523-6b95-417d-9d35-abf57ef9668d","Type":"ContainerStarted","Data":"c12f19b3fce2183c018b0873e97bb81e431ca3e4dc0ea433c23861c1808e96b0"} Jul 29 16:07:09.648768 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:09.648724 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" event={"ID":"31819202-a49a-4346-b291-656fc68edcd8","Type":"ContainerStarted","Data":"1374bea83cb2db0ae4a0b71359142370e751d7e3fe63de9258dbb35ebe49728f"} Jul 29 16:07:09.664807 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:09.664770 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxrzk" podStartSLOduration=3.855386984 podStartE2EDuration="25.664757938s" totalImagesPullingTime="21.809370954s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:06:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:07:09.664577249 +0000 UTC m=+26.682398495" watchObservedRunningTime="2026-07-29 16:07:09.664757938 +0000 UTC m=+26.682579176" Jul 29 16:07:10.028193 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:10.028164 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-b84c6" Jul 29 16:07:10.028795 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:10.028770 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-b84c6" Jul 29 16:07:10.651103 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:10.651074 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-b84c6" Jul 29 16:07:10.651504 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:10.651381 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-b84c6" Jul 29 16:07:11.537656 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:11.537459 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:07:11.537825 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:11.537470 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:07:11.537825 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:11.537799 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxg62" podUID="066859ca-e247-4082-b6f9-d758329a31e5" Jul 29 16:07:11.537825 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:11.537685 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttc2b" podUID="3f75274e-f78e-4656-ad34-0e149d4dff5b" Jul 29 16:07:11.538033 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:11.537470 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:07:11.538033 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:11.537919 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z978p" podUID="8df6793f-3b49-4b29-ae90-d18f79c16891" Jul 29 16:07:11.658965 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:11.658924 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" event={"ID":"31819202-a49a-4346-b291-656fc68edcd8","Type":"ContainerStarted","Data":"3feb033cff01f41578ceb4709c8dbba680901eaf8037a74943b0769bb51af113"} Jul 29 16:07:11.659820 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:11.659289 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:07:11.659820 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:11.659353 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:07:11.659820 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:11.659402 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:07:11.661299 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:11.661270 2563 generic.go:356] "Generic (PLEG): container finished" podID="7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e" containerID="33859357035bf6552f43b9e5f64aabc02ffd28caf52d8d8441cfaf257a6a5716" exitCode=0 Jul 29 16:07:11.661401 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:11.661328 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rw5kn" event={"ID":"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e","Type":"ContainerDied","Data":"33859357035bf6552f43b9e5f64aabc02ffd28caf52d8d8441cfaf257a6a5716"} Jul 29 16:07:11.676302 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:11.676283 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:07:11.676399 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:11.676391 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:07:11.687290 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:11.687251 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" podStartSLOduration=8.033346255 podStartE2EDuration="27.687238949s" totalImagesPullingTime="19.653892694s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:06:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:07:11.68670779 +0000 UTC m=+28.704529050" watchObservedRunningTime="2026-07-29 16:07:11.687238949 +0000 UTC m=+28.705060195" Jul 29 16:07:13.538685 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:13.538517 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:07:13.539116 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:13.538610 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:07:13.539116 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:13.538768 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxg62" podUID="066859ca-e247-4082-b6f9-d758329a31e5" Jul 29 16:07:13.539116 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:13.538646 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:07:13.539116 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:13.538874 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttc2b" podUID="3f75274e-f78e-4656-ad34-0e149d4dff5b" Jul 29 16:07:13.539116 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:13.538931 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z978p" podUID="8df6793f-3b49-4b29-ae90-d18f79c16891" Jul 29 16:07:13.667666 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:13.667627 2563 generic.go:356] "Generic (PLEG): container finished" podID="7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e" containerID="04d1f7b94eb92ae2ec2eb5c0c936ba3f03f071861f724d669009d345f305584d" exitCode=0 Jul 29 16:07:13.667877 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:13.667703 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rw5kn" event={"ID":"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e","Type":"ContainerDied","Data":"04d1f7b94eb92ae2ec2eb5c0c936ba3f03f071861f724d669009d345f305584d"} Jul 29 16:07:15.537556 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:15.537527 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:07:15.538027 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:15.537531 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:07:15.538027 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:15.537649 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxg62" podUID="066859ca-e247-4082-b6f9-d758329a31e5" Jul 29 16:07:15.538027 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:15.537531 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:07:15.538027 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:15.537725 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z978p" podUID="8df6793f-3b49-4b29-ae90-d18f79c16891" Jul 29 16:07:15.538027 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:15.537789 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttc2b" podUID="3f75274e-f78e-4656-ad34-0e149d4dff5b" Jul 29 16:07:15.674112 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:15.674087 2563 generic.go:356] "Generic (PLEG): container finished" podID="7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e" containerID="d0841e029fb4ec1e02c3c15c1073954347eb8982ea8128b6f7ca5edd0dc4bd3d" exitCode=0 Jul 29 16:07:15.674112 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:15.674122 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rw5kn" event={"ID":"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e","Type":"ContainerDied","Data":"d0841e029fb4ec1e02c3c15c1073954347eb8982ea8128b6f7ca5edd0dc4bd3d"} Jul 29 16:07:17.100792 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:17.100736 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kpjc\" (UniqueName: \"kubernetes.io/projected/066859ca-e247-4082-b6f9-d758329a31e5-kube-api-access-2kpjc\") pod \"network-check-target-pxg62\" (UID: \"066859ca-e247-4082-b6f9-d758329a31e5\") " pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:07:17.101255 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:17.100913 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 16:07:17.101255 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:17.100937 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 16:07:17.101255 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:17.100949 2563 projected.go:196] Error preparing data for projected volume kube-api-access-2kpjc for pod openshift-network-diagnostics/network-check-target-pxg62: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:07:17.101255 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:17.100999 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/066859ca-e247-4082-b6f9-d758329a31e5-kube-api-access-2kpjc podName:066859ca-e247-4082-b6f9-d758329a31e5 nodeName:}" failed. No retries permitted until 2026-07-29 16:07:49.100985766 +0000 UTC m=+66.118806993 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2kpjc" (UniqueName: "kubernetes.io/projected/066859ca-e247-4082-b6f9-d758329a31e5-kube-api-access-2kpjc") pod "network-check-target-pxg62" (UID: "066859ca-e247-4082-b6f9-d758329a31e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:07:17.201958 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:17.201929 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f75274e-f78e-4656-ad34-0e149d4dff5b-original-pull-secret\") pod \"global-pull-secret-syncer-ttc2b\" (UID: \"3f75274e-f78e-4656-ad34-0e149d4dff5b\") " pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:07:17.202127 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:17.201976 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8df6793f-3b49-4b29-ae90-d18f79c16891-metrics-certs\") pod \"network-metrics-daemon-z978p\" (UID: \"8df6793f-3b49-4b29-ae90-d18f79c16891\") " pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:07:17.202127 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:17.202092 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:07:17.202127 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:17.202092 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 16:07:17.202264 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:17.202153 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8df6793f-3b49-4b29-ae90-d18f79c16891-metrics-certs podName:8df6793f-3b49-4b29-ae90-d18f79c16891 nodeName:}" failed. No retries permitted until 2026-07-29 16:07:49.20213536 +0000 UTC m=+66.219956591 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8df6793f-3b49-4b29-ae90-d18f79c16891-metrics-certs") pod "network-metrics-daemon-z978p" (UID: "8df6793f-3b49-4b29-ae90-d18f79c16891") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:07:17.202264 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:17.202172 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f75274e-f78e-4656-ad34-0e149d4dff5b-original-pull-secret podName:3f75274e-f78e-4656-ad34-0e149d4dff5b nodeName:}" failed. No retries permitted until 2026-07-29 16:07:49.202162229 +0000 UTC m=+66.219983456 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f75274e-f78e-4656-ad34-0e149d4dff5b-original-pull-secret") pod "global-pull-secret-syncer-ttc2b" (UID: "3f75274e-f78e-4656-ad34-0e149d4dff5b") : object "kube-system"/"original-pull-secret" not registered Jul 29 16:07:17.537722 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:17.537687 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:07:17.537937 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:17.537694 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:07:17.537937 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:17.537828 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:07:17.537937 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:17.537841 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxg62" podUID="066859ca-e247-4082-b6f9-d758329a31e5" Jul 29 16:07:17.538088 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:17.537961 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z978p" podUID="8df6793f-3b49-4b29-ae90-d18f79c16891" Jul 29 16:07:17.538088 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:17.538019 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttc2b" podUID="3f75274e-f78e-4656-ad34-0e149d4dff5b" Jul 29 16:07:19.541643 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:19.541616 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:07:19.542153 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:19.541657 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:07:19.542153 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:19.541761 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z978p" podUID="8df6793f-3b49-4b29-ae90-d18f79c16891" Jul 29 16:07:19.542153 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:19.541791 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxg62" podUID="066859ca-e247-4082-b6f9-d758329a31e5" Jul 29 16:07:19.542153 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:19.541813 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:07:19.542153 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:19.541924 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttc2b" podUID="3f75274e-f78e-4656-ad34-0e149d4dff5b" Jul 29 16:07:19.921652 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:19.921585 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pxg62"] Jul 29 16:07:19.921841 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:19.921824 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:07:19.922157 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:19.921959 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxg62" podUID="066859ca-e247-4082-b6f9-d758329a31e5" Jul 29 16:07:19.922348 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:19.922332 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z978p"] Jul 29 16:07:19.922447 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:19.922434 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:07:19.922552 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:19.922535 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z978p" podUID="8df6793f-3b49-4b29-ae90-d18f79c16891" Jul 29 16:07:19.923298 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:19.923278 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ttc2b"] Jul 29 16:07:19.923393 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:19.923364 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:07:19.923472 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:19.923453 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttc2b" podUID="3f75274e-f78e-4656-ad34-0e149d4dff5b" Jul 29 16:07:20.689496 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:20.689462 2563 generic.go:356] "Generic (PLEG): container finished" podID="7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e" containerID="99576347afc0d9216c40242783c2a90d68a22b399cf6bf15dd0ef094ac0323c4" exitCode=0 Jul 29 16:07:20.689969 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:20.689506 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rw5kn" event={"ID":"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e","Type":"ContainerDied","Data":"99576347afc0d9216c40242783c2a90d68a22b399cf6bf15dd0ef094ac0323c4"} Jul 29 16:07:21.537594 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:21.537405 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:07:21.537799 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:21.537411 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:07:21.537799 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:21.537672 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z978p" podUID="8df6793f-3b49-4b29-ae90-d18f79c16891" Jul 29 16:07:21.537799 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:21.537434 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:07:21.537964 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:21.537733 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxg62" podUID="066859ca-e247-4082-b6f9-d758329a31e5" Jul 29 16:07:21.537964 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:21.537907 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttc2b" podUID="3f75274e-f78e-4656-ad34-0e149d4dff5b" Jul 29 16:07:21.697762 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:21.697712 2563 generic.go:356] "Generic (PLEG): container finished" podID="7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e" containerID="bc38f94844dc25b0afd7e899c5fc928bfebbace774483681428d8c68c2734975" exitCode=0 Jul 29 16:07:21.698126 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:21.697774 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rw5kn" event={"ID":"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e","Type":"ContainerDied","Data":"bc38f94844dc25b0afd7e899c5fc928bfebbace774483681428d8c68c2734975"} Jul 29 16:07:22.703469 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:22.703436 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rw5kn" event={"ID":"7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e","Type":"ContainerStarted","Data":"cac990023d10858e0b2c333ba392d035c4f4901c8abc68df43ec1fc0b4a5c852"} Jul 29 16:07:22.734174 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:22.734112 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rw5kn" podStartSLOduration=8.688698194 podStartE2EDuration="38.734093292s" totalImagesPullingTime="30.045395098s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:06:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:07:22.733527677 +0000 UTC m=+39.751348945" watchObservedRunningTime="2026-07-29 16:07:22.734093292 +0000 UTC m=+39.751914540" Jul 29 16:07:23.538615 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.538577 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:07:23.538820 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:23.538665 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z978p" podUID="8df6793f-3b49-4b29-ae90-d18f79c16891" Jul 29 16:07:23.538820 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.538678 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:07:23.538820 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.538707 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:07:23.538820 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:23.538789 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttc2b" podUID="3f75274e-f78e-4656-ad34-0e149d4dff5b" Jul 29 16:07:23.539043 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:23.538848 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxg62" podUID="066859ca-e247-4082-b6f9-d758329a31e5" Jul 29 16:07:23.768108 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.768077 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeReady" Jul 29 16:07:23.768453 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.768205 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 29 16:07:23.814167 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.814136 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9ztrz"] Jul 29 16:07:23.831409 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.831381 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2pj7r"] Jul 29 16:07:23.831559 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.831519 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9ztrz" Jul 29 16:07:23.834862 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.834840 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 29 16:07:23.834970 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.834862 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 29 16:07:23.834970 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.834911 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kmsg5\"" Jul 29 16:07:23.842332 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.842313 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2pj7r"] Jul 29 16:07:23.842445 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.842339 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9ztrz"] Jul 29 16:07:23.842504 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.842440 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2pj7r" Jul 29 16:07:23.843252 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.843229 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5wpts"] Jul 29 16:07:23.845608 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.845580 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 29 16:07:23.846055 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.846031 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 29 16:07:23.846146 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.846099 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 29 16:07:23.847069 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.846452 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nvl9j\"" Jul 29 16:07:23.854719 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.854699 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5wpts" Jul 29 16:07:23.857163 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.857130 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5tf75\"" Jul 29 16:07:23.857659 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.857635 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02eb49b6-5f4d-4ecb-b1fd-d679167d5cdf-cert\") pod \"ingress-canary-2pj7r\" (UID: \"02eb49b6-5f4d-4ecb-b1fd-d679167d5cdf\") " pod="openshift-ingress-canary/ingress-canary-2pj7r" Jul 29 16:07:23.857787 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.857675 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9a69276-083b-4878-a79c-3fce6807d2a6-metrics-tls\") pod \"dns-default-9ztrz\" (UID: \"b9a69276-083b-4878-a79c-3fce6807d2a6\") " pod="openshift-dns/dns-default-9ztrz" Jul 29 16:07:23.857787 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.857734 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25dmx\" (UniqueName: \"kubernetes.io/projected/02eb49b6-5f4d-4ecb-b1fd-d679167d5cdf-kube-api-access-25dmx\") pod \"ingress-canary-2pj7r\" (UID: \"02eb49b6-5f4d-4ecb-b1fd-d679167d5cdf\") " pod="openshift-ingress-canary/ingress-canary-2pj7r" Jul 29 16:07:23.857902 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.857786 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b9a69276-083b-4878-a79c-3fce6807d2a6-config-volume\") pod \"dns-default-9ztrz\" (UID: \"b9a69276-083b-4878-a79c-3fce6807d2a6\") " pod="openshift-dns/dns-default-9ztrz" Jul 29 16:07:23.857902 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.857807 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5sr8\" (UniqueName: \"kubernetes.io/projected/b9a69276-083b-4878-a79c-3fce6807d2a6-kube-api-access-c5sr8\") pod \"dns-default-9ztrz\" (UID: \"b9a69276-083b-4878-a79c-3fce6807d2a6\") " pod="openshift-dns/dns-default-9ztrz" Jul 29 16:07:23.857902 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.857856 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9a69276-083b-4878-a79c-3fce6807d2a6-tmp-dir\") pod \"dns-default-9ztrz\" (UID: \"b9a69276-083b-4878-a79c-3fce6807d2a6\") " pod="openshift-dns/dns-default-9ztrz" Jul 29 16:07:23.858458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.858437 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 29 16:07:23.858556 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.858471 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 29 16:07:23.858556 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.858518 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 29 16:07:23.858556 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.858478 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 29 16:07:23.859059 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.859040 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5wpts"] Jul 29 16:07:23.958390 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.958353 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kxvj\" (UniqueName: \"kubernetes.io/projected/b0b08927-6c7c-4d93-91e2-e023adda7f88-kube-api-access-2kxvj\") pod \"insights-runtime-extractor-5wpts\" (UID: \"b0b08927-6c7c-4d93-91e2-e023adda7f88\") " pod="openshift-insights/insights-runtime-extractor-5wpts" Jul 29 16:07:23.958390 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.958395 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02eb49b6-5f4d-4ecb-b1fd-d679167d5cdf-cert\") pod \"ingress-canary-2pj7r\" (UID: \"02eb49b6-5f4d-4ecb-b1fd-d679167d5cdf\") " pod="openshift-ingress-canary/ingress-canary-2pj7r" Jul 29 16:07:23.958591 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.958415 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b0b08927-6c7c-4d93-91e2-e023adda7f88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5wpts\" (UID: \"b0b08927-6c7c-4d93-91e2-e023adda7f88\") " pod="openshift-insights/insights-runtime-extractor-5wpts" Jul 29 16:07:23.958591 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.958446 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9a69276-083b-4878-a79c-3fce6807d2a6-metrics-tls\") pod \"dns-default-9ztrz\" (UID: \"b9a69276-083b-4878-a79c-3fce6807d2a6\") " pod="openshift-dns/dns-default-9ztrz" Jul 29 16:07:23.958591 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.958471 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0b08927-6c7c-4d93-91e2-e023adda7f88-data-volume\") pod \"insights-runtime-extractor-5wpts\" (UID: \"b0b08927-6c7c-4d93-91e2-e023adda7f88\") " pod="openshift-insights/insights-runtime-extractor-5wpts" Jul 29 16:07:23.958706 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.958598 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25dmx\" (UniqueName: \"kubernetes.io/projected/02eb49b6-5f4d-4ecb-b1fd-d679167d5cdf-kube-api-access-25dmx\") pod \"ingress-canary-2pj7r\" (UID: \"02eb49b6-5f4d-4ecb-b1fd-d679167d5cdf\") " pod="openshift-ingress-canary/ingress-canary-2pj7r" Jul 29 16:07:23.958706 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.958628 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b9a69276-083b-4878-a79c-3fce6807d2a6-config-volume\") pod \"dns-default-9ztrz\" (UID: \"b9a69276-083b-4878-a79c-3fce6807d2a6\") " pod="openshift-dns/dns-default-9ztrz" Jul 29 16:07:23.958706 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.958651 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5sr8\" (UniqueName: \"kubernetes.io/projected/b9a69276-083b-4878-a79c-3fce6807d2a6-kube-api-access-c5sr8\") pod \"dns-default-9ztrz\" (UID: \"b9a69276-083b-4878-a79c-3fce6807d2a6\") " pod="openshift-dns/dns-default-9ztrz" Jul 29 16:07:23.958706 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.958674 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b0b08927-6c7c-4d93-91e2-e023adda7f88-crio-socket\") pod \"insights-runtime-extractor-5wpts\" (UID: \"b0b08927-6c7c-4d93-91e2-e023adda7f88\") " pod="openshift-insights/insights-runtime-extractor-5wpts" Jul 29 16:07:23.958919 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.958815 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b0b08927-6c7c-4d93-91e2-e023adda7f88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5wpts\" (UID: \"b0b08927-6c7c-4d93-91e2-e023adda7f88\") " pod="openshift-insights/insights-runtime-extractor-5wpts" Jul 29 16:07:23.958919 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.958872 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9a69276-083b-4878-a79c-3fce6807d2a6-tmp-dir\") pod \"dns-default-9ztrz\" (UID: \"b9a69276-083b-4878-a79c-3fce6807d2a6\") " pod="openshift-dns/dns-default-9ztrz" Jul 29 16:07:23.959249 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.959222 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9a69276-083b-4878-a79c-3fce6807d2a6-tmp-dir\") pod \"dns-default-9ztrz\" (UID: \"b9a69276-083b-4878-a79c-3fce6807d2a6\") " pod="openshift-dns/dns-default-9ztrz" Jul 29 16:07:23.959374 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.959255 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b9a69276-083b-4878-a79c-3fce6807d2a6-config-volume\") pod \"dns-default-9ztrz\" (UID: \"b9a69276-083b-4878-a79c-3fce6807d2a6\") " pod="openshift-dns/dns-default-9ztrz" Jul 29 16:07:23.962360 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.962338 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9a69276-083b-4878-a79c-3fce6807d2a6-metrics-tls\") pod \"dns-default-9ztrz\" (UID: \"b9a69276-083b-4878-a79c-3fce6807d2a6\") " pod="openshift-dns/dns-default-9ztrz" Jul 29 16:07:23.962613 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.962592 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02eb49b6-5f4d-4ecb-b1fd-d679167d5cdf-cert\") pod \"ingress-canary-2pj7r\" (UID: \"02eb49b6-5f4d-4ecb-b1fd-d679167d5cdf\") " pod="openshift-ingress-canary/ingress-canary-2pj7r" Jul 29 16:07:23.967082 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.967058 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5sr8\" (UniqueName: \"kubernetes.io/projected/b9a69276-083b-4878-a79c-3fce6807d2a6-kube-api-access-c5sr8\") pod \"dns-default-9ztrz\" (UID: \"b9a69276-083b-4878-a79c-3fce6807d2a6\") " pod="openshift-dns/dns-default-9ztrz" Jul 29 16:07:23.967183 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:23.967164 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25dmx\" (UniqueName: \"kubernetes.io/projected/02eb49b6-5f4d-4ecb-b1fd-d679167d5cdf-kube-api-access-25dmx\") pod \"ingress-canary-2pj7r\" (UID: \"02eb49b6-5f4d-4ecb-b1fd-d679167d5cdf\") " pod="openshift-ingress-canary/ingress-canary-2pj7r" Jul 29 16:07:24.060216 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:24.060140 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kxvj\" (UniqueName: \"kubernetes.io/projected/b0b08927-6c7c-4d93-91e2-e023adda7f88-kube-api-access-2kxvj\") pod \"insights-runtime-extractor-5wpts\" (UID: \"b0b08927-6c7c-4d93-91e2-e023adda7f88\") " pod="openshift-insights/insights-runtime-extractor-5wpts" Jul 29 16:07:24.060216 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:24.060175 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b0b08927-6c7c-4d93-91e2-e023adda7f88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5wpts\" (UID: \"b0b08927-6c7c-4d93-91e2-e023adda7f88\") " pod="openshift-insights/insights-runtime-extractor-5wpts" Jul 29 16:07:24.060216 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:24.060193 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0b08927-6c7c-4d93-91e2-e023adda7f88-data-volume\") pod \"insights-runtime-extractor-5wpts\" (UID: \"b0b08927-6c7c-4d93-91e2-e023adda7f88\") " pod="openshift-insights/insights-runtime-extractor-5wpts" Jul 29 16:07:24.060482 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:24.060233 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b0b08927-6c7c-4d93-91e2-e023adda7f88-crio-socket\") pod \"insights-runtime-extractor-5wpts\" (UID: \"b0b08927-6c7c-4d93-91e2-e023adda7f88\") " pod="openshift-insights/insights-runtime-extractor-5wpts" Jul 29 16:07:24.060482 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:24.060256 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b0b08927-6c7c-4d93-91e2-e023adda7f88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5wpts\" (UID: \"b0b08927-6c7c-4d93-91e2-e023adda7f88\") " pod="openshift-insights/insights-runtime-extractor-5wpts" Jul 29 16:07:24.060482 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:24.060458 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b0b08927-6c7c-4d93-91e2-e023adda7f88-crio-socket\") pod \"insights-runtime-extractor-5wpts\" (UID: \"b0b08927-6c7c-4d93-91e2-e023adda7f88\") " pod="openshift-insights/insights-runtime-extractor-5wpts" Jul 29 16:07:24.060626 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:24.060587 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0b08927-6c7c-4d93-91e2-e023adda7f88-data-volume\") pod \"insights-runtime-extractor-5wpts\" (UID: \"b0b08927-6c7c-4d93-91e2-e023adda7f88\") " pod="openshift-insights/insights-runtime-extractor-5wpts" Jul 29 16:07:24.060786 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:24.060771 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b0b08927-6c7c-4d93-91e2-e023adda7f88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5wpts\" (UID: \"b0b08927-6c7c-4d93-91e2-e023adda7f88\") " pod="openshift-insights/insights-runtime-extractor-5wpts" Jul 29 16:07:24.062563 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:24.062541 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b0b08927-6c7c-4d93-91e2-e023adda7f88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5wpts\" (UID: \"b0b08927-6c7c-4d93-91e2-e023adda7f88\") " pod="openshift-insights/insights-runtime-extractor-5wpts" Jul 29 16:07:24.068574 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:24.068550 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kxvj\" (UniqueName: \"kubernetes.io/projected/b0b08927-6c7c-4d93-91e2-e023adda7f88-kube-api-access-2kxvj\") pod \"insights-runtime-extractor-5wpts\" (UID: \"b0b08927-6c7c-4d93-91e2-e023adda7f88\") " pod="openshift-insights/insights-runtime-extractor-5wpts" Jul 29 16:07:24.141599 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:24.141563 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9ztrz" Jul 29 16:07:24.152632 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:24.152604 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2pj7r" Jul 29 16:07:24.164002 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:24.163983 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5wpts" Jul 29 16:07:24.371727 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:24.371481 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2pj7r"] Jul 29 16:07:24.378383 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:07:24.378356 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02eb49b6_5f4d_4ecb_b1fd_d679167d5cdf.slice/crio-036cd55fe00cf2a91db53774f13aba61452a571c677aa6d974fc477a14eec3b0 WatchSource:0}: Error finding container 036cd55fe00cf2a91db53774f13aba61452a571c677aa6d974fc477a14eec3b0: Status 404 returned error can't find the container with id 036cd55fe00cf2a91db53774f13aba61452a571c677aa6d974fc477a14eec3b0 Jul 29 16:07:24.385012 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:24.384982 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9ztrz"] Jul 29 16:07:24.387676 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:07:24.387655 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9a69276_083b_4878_a79c_3fce6807d2a6.slice/crio-b204b2d8dc0d96604090a1b152af65087de6ea2e582013f1ad4d06b915d61da3 WatchSource:0}: Error finding container b204b2d8dc0d96604090a1b152af65087de6ea2e582013f1ad4d06b915d61da3: Status 404 returned error can't find the container with id b204b2d8dc0d96604090a1b152af65087de6ea2e582013f1ad4d06b915d61da3 Jul 29 16:07:24.402930 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:24.402905 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5wpts"] Jul 29 16:07:24.405619 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:07:24.405600 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0b08927_6c7c_4d93_91e2_e023adda7f88.slice/crio-12213f08cdbb1f4f458e75a470a84e3e92c4876de60d68942c26cb922f7e33aa WatchSource:0}: Error finding container 12213f08cdbb1f4f458e75a470a84e3e92c4876de60d68942c26cb922f7e33aa: Status 404 returned error can't find the container with id 12213f08cdbb1f4f458e75a470a84e3e92c4876de60d68942c26cb922f7e33aa Jul 29 16:07:24.709678 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:24.709641 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5wpts" event={"ID":"b0b08927-6c7c-4d93-91e2-e023adda7f88","Type":"ContainerStarted","Data":"12213f08cdbb1f4f458e75a470a84e3e92c4876de60d68942c26cb922f7e33aa"} Jul 29 16:07:24.710836 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:24.710812 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2pj7r" event={"ID":"02eb49b6-5f4d-4ecb-b1fd-d679167d5cdf","Type":"ContainerStarted","Data":"036cd55fe00cf2a91db53774f13aba61452a571c677aa6d974fc477a14eec3b0"} Jul 29 16:07:24.711870 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:24.711852 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9ztrz" event={"ID":"b9a69276-083b-4878-a79c-3fce6807d2a6","Type":"ContainerStarted","Data":"b204b2d8dc0d96604090a1b152af65087de6ea2e582013f1ad4d06b915d61da3"} Jul 29 16:07:25.537914 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:25.537881 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:07:25.538856 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:25.538832 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:07:25.539329 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:25.539314 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:07:25.541613 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:25.541589 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 16:07:25.541709 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:25.541589 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bvftr\"" Jul 29 16:07:25.541783 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:25.541635 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 16:07:25.542904 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:25.542885 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bdnwf\"" Jul 29 16:07:25.543767 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:25.543003 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 16:07:25.543767 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:25.543083 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 16:07:28.515646 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:28.515616 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6789f44b6d-8wl5j"] Jul 29 16:07:28.638685 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:28.638642 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6789f44b6d-8wl5j"] Jul 29 16:07:28.638883 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:28.638802 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6789f44b6d-8wl5j" Jul 29 16:07:28.641689 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:28.641664 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 29 16:07:28.641689 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:28.641664 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vnbr8\"" Jul 29 16:07:28.641945 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:28.641666 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 29 16:07:28.642664 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:28.642640 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 29 16:07:28.642801 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:28.642679 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 29 16:07:28.642801 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:28.642709 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 29 16:07:28.642917 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:28.642811 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 29 16:07:28.643033 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:28.643016 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 29 16:07:28.697527 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:28.697485 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/581d7b81-d058-476e-b2a6-f2f4c55624f6-console-serving-cert\") pod \"console-6789f44b6d-8wl5j\" (UID: \"581d7b81-d058-476e-b2a6-f2f4c55624f6\") " pod="openshift-console/console-6789f44b6d-8wl5j" Jul 29 16:07:28.697527 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:28.697523 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/581d7b81-d058-476e-b2a6-f2f4c55624f6-console-oauth-config\") pod \"console-6789f44b6d-8wl5j\" (UID: \"581d7b81-d058-476e-b2a6-f2f4c55624f6\") " pod="openshift-console/console-6789f44b6d-8wl5j" Jul 29 16:07:28.697730 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:28.697643 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/581d7b81-d058-476e-b2a6-f2f4c55624f6-console-config\") pod \"console-6789f44b6d-8wl5j\" (UID: \"581d7b81-d058-476e-b2a6-f2f4c55624f6\") " pod="openshift-console/console-6789f44b6d-8wl5j" Jul 29 16:07:28.697730 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:28.697679 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/581d7b81-d058-476e-b2a6-f2f4c55624f6-service-ca\") pod \"console-6789f44b6d-8wl5j\" (UID: \"581d7b81-d058-476e-b2a6-f2f4c55624f6\") " pod="openshift-console/console-6789f44b6d-8wl5j" Jul 29 16:07:28.697826 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:28.697764 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw4l9\" (UniqueName: \"kubernetes.io/projected/581d7b81-d058-476e-b2a6-f2f4c55624f6-kube-api-access-qw4l9\") pod \"console-6789f44b6d-8wl5j\" (UID: \"581d7b81-d058-476e-b2a6-f2f4c55624f6\") " pod="openshift-console/console-6789f44b6d-8wl5j" Jul 29 16:07:28.697826 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:28.697793 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/581d7b81-d058-476e-b2a6-f2f4c55624f6-oauth-serving-cert\") pod \"console-6789f44b6d-8wl5j\" (UID: \"581d7b81-d058-476e-b2a6-f2f4c55624f6\") " pod="openshift-console/console-6789f44b6d-8wl5j" Jul 29 16:07:28.798441 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:28.798355 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/581d7b81-d058-476e-b2a6-f2f4c55624f6-console-serving-cert\") pod \"console-6789f44b6d-8wl5j\" (UID: \"581d7b81-d058-476e-b2a6-f2f4c55624f6\") " pod="openshift-console/console-6789f44b6d-8wl5j" Jul 29 16:07:28.798441 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:28.798406 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/581d7b81-d058-476e-b2a6-f2f4c55624f6-console-oauth-config\") pod \"console-6789f44b6d-8wl5j\" (UID: \"581d7b81-d058-476e-b2a6-f2f4c55624f6\") " pod="openshift-console/console-6789f44b6d-8wl5j" Jul 29 16:07:28.798665 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:28.798471 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/581d7b81-d058-476e-b2a6-f2f4c55624f6-console-config\") pod \"console-6789f44b6d-8wl5j\" (UID: \"581d7b81-d058-476e-b2a6-f2f4c55624f6\") " pod="openshift-console/console-6789f44b6d-8wl5j" Jul 29 16:07:28.798665 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:28.798616 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/581d7b81-d058-476e-b2a6-f2f4c55624f6-service-ca\") pod \"console-6789f44b6d-8wl5j\" (UID: \"581d7b81-d058-476e-b2a6-f2f4c55624f6\") " pod="openshift-console/console-6789f44b6d-8wl5j" Jul 29 16:07:28.798793 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:28.798689 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw4l9\" (UniqueName: \"kubernetes.io/projected/581d7b81-d058-476e-b2a6-f2f4c55624f6-kube-api-access-qw4l9\") pod \"console-6789f44b6d-8wl5j\" (UID: \"581d7b81-d058-476e-b2a6-f2f4c55624f6\") " pod="openshift-console/console-6789f44b6d-8wl5j" Jul 29 16:07:28.798793 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:28.798722 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/581d7b81-d058-476e-b2a6-f2f4c55624f6-oauth-serving-cert\") pod \"console-6789f44b6d-8wl5j\" (UID: \"581d7b81-d058-476e-b2a6-f2f4c55624f6\") " pod="openshift-console/console-6789f44b6d-8wl5j" Jul 29 16:07:28.799188 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:28.799169 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/581d7b81-d058-476e-b2a6-f2f4c55624f6-console-config\") pod \"console-6789f44b6d-8wl5j\" (UID: \"581d7b81-d058-476e-b2a6-f2f4c55624f6\") " pod="openshift-console/console-6789f44b6d-8wl5j" Jul 29 16:07:28.799304 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:28.799226 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/581d7b81-d058-476e-b2a6-f2f4c55624f6-service-ca\") pod \"console-6789f44b6d-8wl5j\" (UID: \"581d7b81-d058-476e-b2a6-f2f4c55624f6\") " pod="openshift-console/console-6789f44b6d-8wl5j" Jul 29 16:07:28.799581 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:28.799561 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/581d7b81-d058-476e-b2a6-f2f4c55624f6-oauth-serving-cert\") pod \"console-6789f44b6d-8wl5j\" (UID: \"581d7b81-d058-476e-b2a6-f2f4c55624f6\") " pod="openshift-console/console-6789f44b6d-8wl5j" Jul 29 16:07:28.801218 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:28.801194 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/581d7b81-d058-476e-b2a6-f2f4c55624f6-console-oauth-config\") pod \"console-6789f44b6d-8wl5j\" (UID: \"581d7b81-d058-476e-b2a6-f2f4c55624f6\") " pod="openshift-console/console-6789f44b6d-8wl5j" Jul 29 16:07:28.801382 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:28.801362 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/581d7b81-d058-476e-b2a6-f2f4c55624f6-console-serving-cert\") pod \"console-6789f44b6d-8wl5j\" (UID: \"581d7b81-d058-476e-b2a6-f2f4c55624f6\") " pod="openshift-console/console-6789f44b6d-8wl5j" Jul 29 16:07:28.808090 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:28.808041 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw4l9\" (UniqueName: \"kubernetes.io/projected/581d7b81-d058-476e-b2a6-f2f4c55624f6-kube-api-access-qw4l9\") pod \"console-6789f44b6d-8wl5j\" (UID: \"581d7b81-d058-476e-b2a6-f2f4c55624f6\") " pod="openshift-console/console-6789f44b6d-8wl5j" Jul 29 16:07:28.949686 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:28.949648 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6789f44b6d-8wl5j" Jul 29 16:07:31.185156 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:31.185128 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6789f44b6d-8wl5j"] Jul 29 16:07:31.186964 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:07:31.186944 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod581d7b81_d058_476e_b2a6_f2f4c55624f6.slice/crio-708faf812d904dfd74340249a0b54a49bce59b35cc0777ad4612176de27439a8 WatchSource:0}: Error finding container 708faf812d904dfd74340249a0b54a49bce59b35cc0777ad4612176de27439a8: Status 404 returned error can't find the container with id 708faf812d904dfd74340249a0b54a49bce59b35cc0777ad4612176de27439a8 Jul 29 16:07:31.732875 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:31.732837 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9ztrz" event={"ID":"b9a69276-083b-4878-a79c-3fce6807d2a6","Type":"ContainerStarted","Data":"da1fc2181c706c7e7c4f56f8e609b9abddee4b569b819f1004272fb4e1724f00"} Jul 29 16:07:31.733045 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:31.732903 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9ztrz" event={"ID":"b9a69276-083b-4878-a79c-3fce6807d2a6","Type":"ContainerStarted","Data":"c377c5c522c4a24209b4123090594170ecde4e8a17a6ac86856155046f7d550f"} Jul 29 16:07:31.733045 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:31.732962 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9ztrz" Jul 29 16:07:31.734211 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:31.734190 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5wpts" event={"ID":"b0b08927-6c7c-4d93-91e2-e023adda7f88","Type":"ContainerStarted","Data":"4c764c32ad13b1c107c1b50ab5a906ee804133a45452bed705de4b5209928075"} Jul 29 16:07:31.735478 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:31.735452 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2pj7r" event={"ID":"02eb49b6-5f4d-4ecb-b1fd-d679167d5cdf","Type":"ContainerStarted","Data":"99ca5a22aa9c811e148581769c8adf53f172d9d93e5238ad18ba9a7e61d2f396"} Jul 29 16:07:31.736627 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:31.736606 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6789f44b6d-8wl5j" event={"ID":"581d7b81-d058-476e-b2a6-f2f4c55624f6","Type":"ContainerStarted","Data":"708faf812d904dfd74340249a0b54a49bce59b35cc0777ad4612176de27439a8"} Jul 29 16:07:31.750186 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:31.750132 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9ztrz" podStartSLOduration=2.102185373 podStartE2EDuration="8.750120594s" totalImagesPullingTime="6.647935221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:07:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:07:31.749012898 +0000 UTC m=+48.766834144" watchObservedRunningTime="2026-07-29 16:07:31.750120594 +0000 UTC m=+48.767941835" Jul 29 16:07:31.767521 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:31.767485 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2pj7r" podStartSLOduration=2.111540325 podStartE2EDuration="8.767472541s" totalImagesPullingTime="6.655932216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:07:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:07:31.767005359 +0000 UTC m=+48.784826626" watchObservedRunningTime="2026-07-29 16:07:31.767472541 +0000 UTC m=+48.785293788" Jul 29 16:07:37.756789 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:37.756732 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6789f44b6d-8wl5j" event={"ID":"581d7b81-d058-476e-b2a6-f2f4c55624f6","Type":"ContainerStarted","Data":"3fa39c2b76ceedf9bda677a131c3c16024076f39891d5ba2426a749adb8bebfb"} Jul 29 16:07:37.758727 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:37.758695 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5wpts" event={"ID":"b0b08927-6c7c-4d93-91e2-e023adda7f88","Type":"ContainerStarted","Data":"4ac3c7d2836bd13b50d4887788a438d6b58b0d65d393def25b6400285947cf69"} Jul 29 16:07:37.774398 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:37.774345 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6789f44b6d-8wl5j" podStartSLOduration=3.981087153 podStartE2EDuration="9.774327831s" totalImagesPullingTime="5.793240678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:07:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:07:37.773654188 +0000 UTC m=+54.791475436" watchObservedRunningTime="2026-07-29 16:07:37.774327831 +0000 UTC m=+54.792149080" Jul 29 16:07:38.709795 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:38.709764 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5956b5f675-k6sdr"] Jul 29 16:07:38.711693 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:38.711673 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5956b5f675-k6sdr" Jul 29 16:07:38.722180 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:38.722145 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 29 16:07:38.724993 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:38.724969 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5956b5f675-k6sdr"] Jul 29 16:07:38.779275 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:38.779249 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03829d99-4712-4182-8c21-f596670dcd87-trusted-ca-bundle\") pod \"console-5956b5f675-k6sdr\" (UID: \"03829d99-4712-4182-8c21-f596670dcd87\") " pod="openshift-console/console-5956b5f675-k6sdr" Jul 29 16:07:38.779653 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:38.779284 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03829d99-4712-4182-8c21-f596670dcd87-oauth-serving-cert\") pod \"console-5956b5f675-k6sdr\" (UID: \"03829d99-4712-4182-8c21-f596670dcd87\") " pod="openshift-console/console-5956b5f675-k6sdr" Jul 29 16:07:38.779653 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:38.779332 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03829d99-4712-4182-8c21-f596670dcd87-console-config\") pod \"console-5956b5f675-k6sdr\" (UID: \"03829d99-4712-4182-8c21-f596670dcd87\") " pod="openshift-console/console-5956b5f675-k6sdr" Jul 29 16:07:38.779653 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:38.779355 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03829d99-4712-4182-8c21-f596670dcd87-console-oauth-config\") pod \"console-5956b5f675-k6sdr\" (UID: \"03829d99-4712-4182-8c21-f596670dcd87\") " pod="openshift-console/console-5956b5f675-k6sdr" Jul 29 16:07:38.779653 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:38.779370 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03829d99-4712-4182-8c21-f596670dcd87-service-ca\") pod \"console-5956b5f675-k6sdr\" (UID: \"03829d99-4712-4182-8c21-f596670dcd87\") " pod="openshift-console/console-5956b5f675-k6sdr" Jul 29 16:07:38.779653 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:38.779399 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03829d99-4712-4182-8c21-f596670dcd87-console-serving-cert\") pod \"console-5956b5f675-k6sdr\" (UID: \"03829d99-4712-4182-8c21-f596670dcd87\") " pod="openshift-console/console-5956b5f675-k6sdr" Jul 29 16:07:38.779653 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:38.779510 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n2r5\" (UniqueName: \"kubernetes.io/projected/03829d99-4712-4182-8c21-f596670dcd87-kube-api-access-4n2r5\") pod \"console-5956b5f675-k6sdr\" (UID: \"03829d99-4712-4182-8c21-f596670dcd87\") " pod="openshift-console/console-5956b5f675-k6sdr" Jul 29 16:07:38.880260 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:38.880229 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03829d99-4712-4182-8c21-f596670dcd87-console-config\") pod \"console-5956b5f675-k6sdr\" (UID: \"03829d99-4712-4182-8c21-f596670dcd87\") " pod="openshift-console/console-5956b5f675-k6sdr" Jul 29 16:07:38.880260 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:38.880262 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03829d99-4712-4182-8c21-f596670dcd87-console-oauth-config\") pod \"console-5956b5f675-k6sdr\" (UID: \"03829d99-4712-4182-8c21-f596670dcd87\") " pod="openshift-console/console-5956b5f675-k6sdr" Jul 29 16:07:38.880461 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:38.880276 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03829d99-4712-4182-8c21-f596670dcd87-service-ca\") pod \"console-5956b5f675-k6sdr\" (UID: \"03829d99-4712-4182-8c21-f596670dcd87\") " pod="openshift-console/console-5956b5f675-k6sdr" Jul 29 16:07:38.880461 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:38.880303 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03829d99-4712-4182-8c21-f596670dcd87-console-serving-cert\") pod \"console-5956b5f675-k6sdr\" (UID: \"03829d99-4712-4182-8c21-f596670dcd87\") " pod="openshift-console/console-5956b5f675-k6sdr" Jul 29 16:07:38.880461 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:38.880344 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n2r5\" (UniqueName: \"kubernetes.io/projected/03829d99-4712-4182-8c21-f596670dcd87-kube-api-access-4n2r5\") pod \"console-5956b5f675-k6sdr\" (UID: \"03829d99-4712-4182-8c21-f596670dcd87\") " pod="openshift-console/console-5956b5f675-k6sdr" Jul 29 16:07:38.880461 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:38.880431 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03829d99-4712-4182-8c21-f596670dcd87-trusted-ca-bundle\") pod \"console-5956b5f675-k6sdr\" (UID: \"03829d99-4712-4182-8c21-f596670dcd87\") " pod="openshift-console/console-5956b5f675-k6sdr" Jul 29 16:07:38.880717 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:38.880469 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03829d99-4712-4182-8c21-f596670dcd87-oauth-serving-cert\") pod \"console-5956b5f675-k6sdr\" (UID: \"03829d99-4712-4182-8c21-f596670dcd87\") " pod="openshift-console/console-5956b5f675-k6sdr" Jul 29 16:07:38.881043 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:38.881015 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03829d99-4712-4182-8c21-f596670dcd87-console-config\") pod \"console-5956b5f675-k6sdr\" (UID: \"03829d99-4712-4182-8c21-f596670dcd87\") " pod="openshift-console/console-5956b5f675-k6sdr" Jul 29 16:07:38.881132 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:38.881073 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03829d99-4712-4182-8c21-f596670dcd87-oauth-serving-cert\") pod \"console-5956b5f675-k6sdr\" (UID: \"03829d99-4712-4182-8c21-f596670dcd87\") " pod="openshift-console/console-5956b5f675-k6sdr" Jul 29 16:07:38.881288 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:38.881260 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03829d99-4712-4182-8c21-f596670dcd87-service-ca\") pod \"console-5956b5f675-k6sdr\" (UID: \"03829d99-4712-4182-8c21-f596670dcd87\") " pod="openshift-console/console-5956b5f675-k6sdr" Jul 29 16:07:38.881551 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:38.881541 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03829d99-4712-4182-8c21-f596670dcd87-trusted-ca-bundle\") pod \"console-5956b5f675-k6sdr\" (UID: \"03829d99-4712-4182-8c21-f596670dcd87\") " pod="openshift-console/console-5956b5f675-k6sdr" Jul 29 16:07:38.882998 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:38.882973 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03829d99-4712-4182-8c21-f596670dcd87-console-oauth-config\") pod \"console-5956b5f675-k6sdr\" (UID: \"03829d99-4712-4182-8c21-f596670dcd87\") " pod="openshift-console/console-5956b5f675-k6sdr" Jul 29 16:07:38.883593 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:38.883575 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03829d99-4712-4182-8c21-f596670dcd87-console-serving-cert\") pod \"console-5956b5f675-k6sdr\" (UID: \"03829d99-4712-4182-8c21-f596670dcd87\") " pod="openshift-console/console-5956b5f675-k6sdr" Jul 29 16:07:38.890136 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:38.890107 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n2r5\" (UniqueName: \"kubernetes.io/projected/03829d99-4712-4182-8c21-f596670dcd87-kube-api-access-4n2r5\") pod \"console-5956b5f675-k6sdr\" (UID: \"03829d99-4712-4182-8c21-f596670dcd87\") " pod="openshift-console/console-5956b5f675-k6sdr" Jul 29 16:07:38.950378 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:38.950353 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6789f44b6d-8wl5j" Jul 29 16:07:38.950498 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:38.950403 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6789f44b6d-8wl5j" Jul 29 16:07:38.955768 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:38.955720 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6789f44b6d-8wl5j" Jul 29 16:07:39.026807 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.026560 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5956b5f675-k6sdr" Jul 29 16:07:39.715435 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.715394 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-nrqlx"] Jul 29 16:07:39.724955 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.724926 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-w9r4f"] Jul 29 16:07:39.725073 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.725052 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nrqlx" Jul 29 16:07:39.727229 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.727206 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w9r4f" Jul 29 16:07:39.727367 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.727235 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 29 16:07:39.727474 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.727240 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 29 16:07:39.727831 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.727811 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 29 16:07:39.727923 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.727811 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 29 16:07:39.727923 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.727819 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 29 16:07:39.728760 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.728707 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 29 16:07:39.728864 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.728783 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-s6584\"" Jul 29 16:07:39.730378 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.730359 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 29 16:07:39.730378 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.730394 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 29 16:07:39.730559 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.730403 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4qvr5\"" Jul 29 16:07:39.730559 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.730420 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 29 16:07:39.733606 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.733383 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-nrqlx"] Jul 29 16:07:39.771338 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.771317 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6789f44b6d-8wl5j" Jul 29 16:07:39.788856 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.788828 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b33515c5-677c-478f-9547-b9521f9e44e7-root\") pod \"node-exporter-w9r4f\" (UID: \"b33515c5-677c-478f-9547-b9521f9e44e7\") " pod="openshift-monitoring/node-exporter-w9r4f" Jul 29 16:07:39.789200 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.788871 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5z24\" (UniqueName: \"kubernetes.io/projected/b33515c5-677c-478f-9547-b9521f9e44e7-kube-api-access-l5z24\") pod \"node-exporter-w9r4f\" (UID: \"b33515c5-677c-478f-9547-b9521f9e44e7\") " pod="openshift-monitoring/node-exporter-w9r4f" Jul 29 16:07:39.789200 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.788934 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b33515c5-677c-478f-9547-b9521f9e44e7-node-exporter-textfile\") pod \"node-exporter-w9r4f\" (UID: \"b33515c5-677c-478f-9547-b9521f9e44e7\") " pod="openshift-monitoring/node-exporter-w9r4f" Jul 29 16:07:39.789200 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.788964 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f5658cd-d6c9-46d9-8e24-6cc5190d9b20-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-nrqlx\" (UID: \"9f5658cd-d6c9-46d9-8e24-6cc5190d9b20\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nrqlx" Jul 29 16:07:39.789200 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.789057 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j28zj\" (UniqueName: \"kubernetes.io/projected/9f5658cd-d6c9-46d9-8e24-6cc5190d9b20-kube-api-access-j28zj\") pod \"kube-state-metrics-56d9f944b4-nrqlx\" (UID: \"9f5658cd-d6c9-46d9-8e24-6cc5190d9b20\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nrqlx" Jul 29 16:07:39.789200 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.789111 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b33515c5-677c-478f-9547-b9521f9e44e7-sys\") pod \"node-exporter-w9r4f\" (UID: \"b33515c5-677c-478f-9547-b9521f9e44e7\") " pod="openshift-monitoring/node-exporter-w9r4f" Jul 29 16:07:39.789200 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.789168 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9f5658cd-d6c9-46d9-8e24-6cc5190d9b20-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-nrqlx\" (UID: \"9f5658cd-d6c9-46d9-8e24-6cc5190d9b20\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nrqlx" Jul 29 16:07:39.789392 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.789201 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b33515c5-677c-478f-9547-b9521f9e44e7-node-exporter-wtmp\") pod \"node-exporter-w9r4f\" (UID: \"b33515c5-677c-478f-9547-b9521f9e44e7\") " pod="openshift-monitoring/node-exporter-w9r4f" Jul 29 16:07:39.789392 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.789227 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b33515c5-677c-478f-9547-b9521f9e44e7-node-exporter-tls\") pod \"node-exporter-w9r4f\" (UID: \"b33515c5-677c-478f-9547-b9521f9e44e7\") " pod="openshift-monitoring/node-exporter-w9r4f" Jul 29 16:07:39.789392 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.789245 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9f5658cd-d6c9-46d9-8e24-6cc5190d9b20-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-nrqlx\" (UID: \"9f5658cd-d6c9-46d9-8e24-6cc5190d9b20\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nrqlx" Jul 29 16:07:39.789392 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.789270 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f5658cd-d6c9-46d9-8e24-6cc5190d9b20-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-nrqlx\" (UID: \"9f5658cd-d6c9-46d9-8e24-6cc5190d9b20\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nrqlx" Jul 29 16:07:39.789392 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.789296 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b33515c5-677c-478f-9547-b9521f9e44e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w9r4f\" (UID: \"b33515c5-677c-478f-9547-b9521f9e44e7\") " pod="openshift-monitoring/node-exporter-w9r4f" Jul 29 16:07:39.789392 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.789318 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b33515c5-677c-478f-9547-b9521f9e44e7-metrics-client-ca\") pod \"node-exporter-w9r4f\" (UID: \"b33515c5-677c-478f-9547-b9521f9e44e7\") " pod="openshift-monitoring/node-exporter-w9r4f" Jul 29 16:07:39.789392 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.789332 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f5658cd-d6c9-46d9-8e24-6cc5190d9b20-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-nrqlx\" (UID: \"9f5658cd-d6c9-46d9-8e24-6cc5190d9b20\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nrqlx" Jul 29 16:07:39.789392 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.789354 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b33515c5-677c-478f-9547-b9521f9e44e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-w9r4f\" (UID: \"b33515c5-677c-478f-9547-b9521f9e44e7\") " pod="openshift-monitoring/node-exporter-w9r4f" Jul 29 16:07:39.889982 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.889943 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f5658cd-d6c9-46d9-8e24-6cc5190d9b20-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-nrqlx\" (UID: \"9f5658cd-d6c9-46d9-8e24-6cc5190d9b20\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nrqlx" Jul 29 16:07:39.890152 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.889994 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j28zj\" (UniqueName: \"kubernetes.io/projected/9f5658cd-d6c9-46d9-8e24-6cc5190d9b20-kube-api-access-j28zj\") pod \"kube-state-metrics-56d9f944b4-nrqlx\" (UID: \"9f5658cd-d6c9-46d9-8e24-6cc5190d9b20\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nrqlx" Jul 29 16:07:39.890152 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.890023 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b33515c5-677c-478f-9547-b9521f9e44e7-sys\") pod \"node-exporter-w9r4f\" (UID: \"b33515c5-677c-478f-9547-b9521f9e44e7\") " pod="openshift-monitoring/node-exporter-w9r4f" Jul 29 16:07:39.890152 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.890056 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9f5658cd-d6c9-46d9-8e24-6cc5190d9b20-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-nrqlx\" (UID: \"9f5658cd-d6c9-46d9-8e24-6cc5190d9b20\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nrqlx" Jul 29 16:07:39.890152 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.890089 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b33515c5-677c-478f-9547-b9521f9e44e7-node-exporter-wtmp\") pod \"node-exporter-w9r4f\" (UID: \"b33515c5-677c-478f-9547-b9521f9e44e7\") " pod="openshift-monitoring/node-exporter-w9r4f" Jul 29 16:07:39.890152 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.890120 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b33515c5-677c-478f-9547-b9521f9e44e7-node-exporter-tls\") pod \"node-exporter-w9r4f\" (UID: \"b33515c5-677c-478f-9547-b9521f9e44e7\") " pod="openshift-monitoring/node-exporter-w9r4f" Jul 29 16:07:39.890152 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.890143 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9f5658cd-d6c9-46d9-8e24-6cc5190d9b20-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-nrqlx\" (UID: \"9f5658cd-d6c9-46d9-8e24-6cc5190d9b20\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nrqlx" Jul 29 16:07:39.890354 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.890187 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f5658cd-d6c9-46d9-8e24-6cc5190d9b20-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-nrqlx\" (UID: \"9f5658cd-d6c9-46d9-8e24-6cc5190d9b20\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nrqlx" Jul 29 16:07:39.890354 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.890211 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b33515c5-677c-478f-9547-b9521f9e44e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w9r4f\" (UID: \"b33515c5-677c-478f-9547-b9521f9e44e7\") " pod="openshift-monitoring/node-exporter-w9r4f" Jul 29 16:07:39.890354 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.890241 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b33515c5-677c-478f-9547-b9521f9e44e7-metrics-client-ca\") pod \"node-exporter-w9r4f\" (UID: \"b33515c5-677c-478f-9547-b9521f9e44e7\") " pod="openshift-monitoring/node-exporter-w9r4f" Jul 29 16:07:39.890354 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.890256 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f5658cd-d6c9-46d9-8e24-6cc5190d9b20-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-nrqlx\" (UID: \"9f5658cd-d6c9-46d9-8e24-6cc5190d9b20\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nrqlx" Jul 29 16:07:39.890354 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.890272 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b33515c5-677c-478f-9547-b9521f9e44e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-w9r4f\" (UID: \"b33515c5-677c-478f-9547-b9521f9e44e7\") " pod="openshift-monitoring/node-exporter-w9r4f" Jul 29 16:07:39.890354 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.890330 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b33515c5-677c-478f-9547-b9521f9e44e7-root\") pod \"node-exporter-w9r4f\" (UID: \"b33515c5-677c-478f-9547-b9521f9e44e7\") " pod="openshift-monitoring/node-exporter-w9r4f" Jul 29 16:07:39.890354 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.890353 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5z24\" (UniqueName: \"kubernetes.io/projected/b33515c5-677c-478f-9547-b9521f9e44e7-kube-api-access-l5z24\") pod \"node-exporter-w9r4f\" (UID: \"b33515c5-677c-478f-9547-b9521f9e44e7\") " pod="openshift-monitoring/node-exporter-w9r4f" Jul 29 16:07:39.890877 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.890425 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b33515c5-677c-478f-9547-b9521f9e44e7-node-exporter-textfile\") pod \"node-exporter-w9r4f\" (UID: \"b33515c5-677c-478f-9547-b9521f9e44e7\") " pod="openshift-monitoring/node-exporter-w9r4f" Jul 29 16:07:39.890877 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.890552 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9f5658cd-d6c9-46d9-8e24-6cc5190d9b20-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-nrqlx\" (UID: \"9f5658cd-d6c9-46d9-8e24-6cc5190d9b20\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nrqlx" Jul 29 16:07:39.890877 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.890721 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b33515c5-677c-478f-9547-b9521f9e44e7-node-exporter-textfile\") pod \"node-exporter-w9r4f\" (UID: \"b33515c5-677c-478f-9547-b9521f9e44e7\") " pod="openshift-monitoring/node-exporter-w9r4f" Jul 29 16:07:39.891033 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.890901 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b33515c5-677c-478f-9547-b9521f9e44e7-sys\") pod \"node-exporter-w9r4f\" (UID: \"b33515c5-677c-478f-9547-b9521f9e44e7\") " pod="openshift-monitoring/node-exporter-w9r4f" Jul 29 16:07:39.891033 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:39.891018 2563 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 29 16:07:39.891134 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:39.891079 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f5658cd-d6c9-46d9-8e24-6cc5190d9b20-kube-state-metrics-tls podName:9f5658cd-d6c9-46d9-8e24-6cc5190d9b20 nodeName:}" failed. No retries permitted until 2026-07-29 16:07:40.391063011 +0000 UTC m=+57.408884240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9f5658cd-d6c9-46d9-8e24-6cc5190d9b20-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-nrqlx" (UID: "9f5658cd-d6c9-46d9-8e24-6cc5190d9b20") : secret "kube-state-metrics-tls" not found Jul 29 16:07:39.891200 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.891135 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b33515c5-677c-478f-9547-b9521f9e44e7-node-exporter-wtmp\") pod \"node-exporter-w9r4f\" (UID: \"b33515c5-677c-478f-9547-b9521f9e44e7\") " pod="openshift-monitoring/node-exporter-w9r4f" Jul 29 16:07:39.892788 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:39.891363 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 29 16:07:39.892788 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:39.891705 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33515c5-677c-478f-9547-b9521f9e44e7-node-exporter-tls podName:b33515c5-677c-478f-9547-b9521f9e44e7 nodeName:}" failed. No retries permitted until 2026-07-29 16:07:40.391406194 +0000 UTC m=+57.409227446 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b33515c5-677c-478f-9547-b9521f9e44e7-node-exporter-tls") pod "node-exporter-w9r4f" (UID: "b33515c5-677c-478f-9547-b9521f9e44e7") : secret "node-exporter-tls" not found Jul 29 16:07:39.892788 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.892081 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9f5658cd-d6c9-46d9-8e24-6cc5190d9b20-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-nrqlx\" (UID: \"9f5658cd-d6c9-46d9-8e24-6cc5190d9b20\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nrqlx" Jul 29 16:07:39.892788 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.892130 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b33515c5-677c-478f-9547-b9521f9e44e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-w9r4f\" (UID: \"b33515c5-677c-478f-9547-b9521f9e44e7\") " pod="openshift-monitoring/node-exporter-w9r4f" Jul 29 16:07:39.892788 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.892297 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b33515c5-677c-478f-9547-b9521f9e44e7-metrics-client-ca\") pod \"node-exporter-w9r4f\" (UID: \"b33515c5-677c-478f-9547-b9521f9e44e7\") " pod="openshift-monitoring/node-exporter-w9r4f" Jul 29 16:07:39.892788 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.892601 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f5658cd-d6c9-46d9-8e24-6cc5190d9b20-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-nrqlx\" (UID: \"9f5658cd-d6c9-46d9-8e24-6cc5190d9b20\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nrqlx" Jul 29 16:07:39.892788 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.892648 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b33515c5-677c-478f-9547-b9521f9e44e7-root\") pod \"node-exporter-w9r4f\" (UID: \"b33515c5-677c-478f-9547-b9521f9e44e7\") " pod="openshift-monitoring/node-exporter-w9r4f" Jul 29 16:07:39.893203 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.893012 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f5658cd-d6c9-46d9-8e24-6cc5190d9b20-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-nrqlx\" (UID: \"9f5658cd-d6c9-46d9-8e24-6cc5190d9b20\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nrqlx" Jul 29 16:07:39.897053 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.897025 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b33515c5-677c-478f-9547-b9521f9e44e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w9r4f\" (UID: \"b33515c5-677c-478f-9547-b9521f9e44e7\") " pod="openshift-monitoring/node-exporter-w9r4f" Jul 29 16:07:39.902985 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.902963 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j28zj\" (UniqueName: \"kubernetes.io/projected/9f5658cd-d6c9-46d9-8e24-6cc5190d9b20-kube-api-access-j28zj\") pod \"kube-state-metrics-56d9f944b4-nrqlx\" (UID: \"9f5658cd-d6c9-46d9-8e24-6cc5190d9b20\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nrqlx" Jul 29 16:07:39.904676 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:39.904656 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5z24\" (UniqueName: \"kubernetes.io/projected/b33515c5-677c-478f-9547-b9521f9e44e7-kube-api-access-l5z24\") pod \"node-exporter-w9r4f\" (UID: \"b33515c5-677c-478f-9547-b9521f9e44e7\") " pod="openshift-monitoring/node-exporter-w9r4f" Jul 29 16:07:40.394906 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.394872 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b33515c5-677c-478f-9547-b9521f9e44e7-node-exporter-tls\") pod \"node-exporter-w9r4f\" (UID: \"b33515c5-677c-478f-9547-b9521f9e44e7\") " pod="openshift-monitoring/node-exporter-w9r4f" Jul 29 16:07:40.395093 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.394912 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f5658cd-d6c9-46d9-8e24-6cc5190d9b20-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-nrqlx\" (UID: \"9f5658cd-d6c9-46d9-8e24-6cc5190d9b20\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nrqlx" Jul 29 16:07:40.397561 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.397538 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b33515c5-677c-478f-9547-b9521f9e44e7-node-exporter-tls\") pod \"node-exporter-w9r4f\" (UID: \"b33515c5-677c-478f-9547-b9521f9e44e7\") " pod="openshift-monitoring/node-exporter-w9r4f" Jul 29 16:07:40.397561 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.397550 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f5658cd-d6c9-46d9-8e24-6cc5190d9b20-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-nrqlx\" (UID: \"9f5658cd-d6c9-46d9-8e24-6cc5190d9b20\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nrqlx" Jul 29 16:07:40.638139 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.637876 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nrqlx" Jul 29 16:07:40.643981 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.643900 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w9r4f" Jul 29 16:07:40.711406 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.711375 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5956b5f675-k6sdr"] Jul 29 16:07:40.714530 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:07:40.714502 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03829d99_4712_4182_8c21_f596670dcd87.slice/crio-252e739937a6ceeb9f68722a2457d27f9f19874554de9113ab55a2aee7633db6 WatchSource:0}: Error finding container 252e739937a6ceeb9f68722a2457d27f9f19874554de9113ab55a2aee7633db6: Status 404 returned error can't find the container with id 252e739937a6ceeb9f68722a2457d27f9f19874554de9113ab55a2aee7633db6 Jul 29 16:07:40.763958 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.763932 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 16:07:40.766961 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.766940 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:40.769519 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.769498 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 29 16:07:40.769649 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.769504 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hkgn2\"" Jul 29 16:07:40.769864 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.769846 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 29 16:07:40.769975 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.769866 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 29 16:07:40.769975 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.769951 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 29 16:07:40.770080 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.769976 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 29 16:07:40.770128 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.770087 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 29 16:07:40.770178 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.770150 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 29 16:07:40.770265 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.770250 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 29 16:07:40.770365 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.770348 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 29 16:07:40.771056 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.771032 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w9r4f" event={"ID":"b33515c5-677c-478f-9547-b9521f9e44e7","Type":"ContainerStarted","Data":"b66e3c348728b1192f0373f017dee5d965907e68cf8b7841585f02719f3df535"} Jul 29 16:07:40.772487 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.772447 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5956b5f675-k6sdr" event={"ID":"03829d99-4712-4182-8c21-f596670dcd87","Type":"ContainerStarted","Data":"252e739937a6ceeb9f68722a2457d27f9f19874554de9113ab55a2aee7633db6"} Jul 29 16:07:40.774963 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.774942 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5wpts" event={"ID":"b0b08927-6c7c-4d93-91e2-e023adda7f88","Type":"ContainerStarted","Data":"93643eb8c9fbf8247f447ef7df71aab97631712fc113c1e445f138084777c7ff"} Jul 29 16:07:40.779175 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.779157 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-nrqlx"] Jul 29 16:07:40.781923 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:07:40.781899 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f5658cd_d6c9_46d9_8e24_6cc5190d9b20.slice/crio-32e9c8b50cf47fc96cb5a93cb2c97bc6784b4a7f13aa02f7083ca85caff20432 WatchSource:0}: Error finding container 32e9c8b50cf47fc96cb5a93cb2c97bc6784b4a7f13aa02f7083ca85caff20432: Status 404 returned error can't find the container with id 32e9c8b50cf47fc96cb5a93cb2c97bc6784b4a7f13aa02f7083ca85caff20432 Jul 29 16:07:40.784286 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.784269 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 16:07:40.824324 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.824277 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5wpts" podStartSLOduration=1.823659181 podStartE2EDuration="17.824261164s" totalImagesPullingTime="16.000601983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:07:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:07:40.823845125 +0000 UTC m=+57.841666374" watchObservedRunningTime="2026-07-29 16:07:40.824261164 +0000 UTC m=+57.842082410" Jul 29 16:07:40.899470 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.899385 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-config-volume\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:40.899470 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.899457 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca3b7e45-cde4-4a88-b755-547d366cd90e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:40.899675 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.899601 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca3b7e45-cde4-4a88-b755-547d366cd90e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:40.899675 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.899633 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:40.899817 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.899721 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:40.899817 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.899780 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-web-config\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:40.899923 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.899902 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:40.899975 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.899927 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca3b7e45-cde4-4a88-b755-547d366cd90e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:40.900015 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.899995 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3b7e45-cde4-4a88-b755-547d366cd90e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:40.900058 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.900021 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:40.900094 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.900067 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:40.900138 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.900094 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca3b7e45-cde4-4a88-b755-547d366cd90e-config-out\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:40.900248 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:40.900231 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5brbd\" (UniqueName: \"kubernetes.io/projected/ca3b7e45-cde4-4a88-b755-547d366cd90e-kube-api-access-5brbd\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:41.001259 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.001231 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca3b7e45-cde4-4a88-b755-547d366cd90e-config-out\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:41.001399 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.001285 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5brbd\" (UniqueName: \"kubernetes.io/projected/ca3b7e45-cde4-4a88-b755-547d366cd90e-kube-api-access-5brbd\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:41.001399 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.001304 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-config-volume\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:41.001516 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.001421 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca3b7e45-cde4-4a88-b755-547d366cd90e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:41.001516 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.001464 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca3b7e45-cde4-4a88-b755-547d366cd90e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:41.001516 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.001500 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:41.001664 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.001556 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:41.001664 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.001586 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-web-config\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:41.001806 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.001721 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:41.001806 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.001773 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca3b7e45-cde4-4a88-b755-547d366cd90e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:41.001904 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.001813 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3b7e45-cde4-4a88-b755-547d366cd90e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:41.001904 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.001844 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:41.001904 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.001873 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:41.002442 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.002402 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca3b7e45-cde4-4a88-b755-547d366cd90e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:41.002555 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.002535 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca3b7e45-cde4-4a88-b755-547d366cd90e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:41.003286 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.003242 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3b7e45-cde4-4a88-b755-547d366cd90e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:41.004644 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.004564 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca3b7e45-cde4-4a88-b755-547d366cd90e-config-out\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:41.004788 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.004645 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:41.005207 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.004921 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-config-volume\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:41.005207 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.005026 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:41.005207 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.005079 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:41.005687 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.005667 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca3b7e45-cde4-4a88-b755-547d366cd90e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:41.005855 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.005836 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-web-config\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:41.006189 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.006167 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:41.006289 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.006260 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:41.008790 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.008769 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5brbd\" (UniqueName: \"kubernetes.io/projected/ca3b7e45-cde4-4a88-b755-547d366cd90e-kube-api-access-5brbd\") pod \"alertmanager-main-0\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:41.077827 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.077801 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:07:41.208891 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.208855 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 16:07:41.211098 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:07:41.211073 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca3b7e45_cde4_4a88_b755_547d366cd90e.slice/crio-1ddd04b06bb2b666d1f03f779340a8e64ce61c413a123b4f1696611f19626456 WatchSource:0}: Error finding container 1ddd04b06bb2b666d1f03f779340a8e64ce61c413a123b4f1696611f19626456: Status 404 returned error can't find the container with id 1ddd04b06bb2b666d1f03f779340a8e64ce61c413a123b4f1696611f19626456 Jul 29 16:07:41.742740 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.742716 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9ztrz" Jul 29 16:07:41.781253 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.781206 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nrqlx" event={"ID":"9f5658cd-d6c9-46d9-8e24-6cc5190d9b20","Type":"ContainerStarted","Data":"32e9c8b50cf47fc96cb5a93cb2c97bc6784b4a7f13aa02f7083ca85caff20432"} Jul 29 16:07:41.783174 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.783150 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5956b5f675-k6sdr" event={"ID":"03829d99-4712-4182-8c21-f596670dcd87","Type":"ContainerStarted","Data":"6abc0765945fd6c8fdc7e222d6771099c5d05c8bcc580e6a99c2605c201253f8"} Jul 29 16:07:41.787186 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.787162 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3b7e45-cde4-4a88-b755-547d366cd90e","Type":"ContainerStarted","Data":"1ddd04b06bb2b666d1f03f779340a8e64ce61c413a123b4f1696611f19626456"} Jul 29 16:07:41.803902 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:41.803850 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5956b5f675-k6sdr" podStartSLOduration=3.803831115 podStartE2EDuration="3.803831115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:07:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:07:41.80283362 +0000 UTC m=+58.820654894" watchObservedRunningTime="2026-07-29 16:07:41.803831115 +0000 UTC m=+58.821652362" Jul 29 16:07:42.791953 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:42.791923 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nrqlx" event={"ID":"9f5658cd-d6c9-46d9-8e24-6cc5190d9b20","Type":"ContainerStarted","Data":"cdeec033013b7aea6e53235b3b32b6ea9b25e23fde5f21d050fce73d5f1ec9cd"} Jul 29 16:07:42.793297 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:42.793274 2563 generic.go:356] "Generic (PLEG): container finished" podID="b33515c5-677c-478f-9547-b9521f9e44e7" containerID="7a998833eabbd08eda93f135c40a58c8f38d7faa6ba345404ef1fea5f2357956" exitCode=0 Jul 29 16:07:42.793400 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:42.793353 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w9r4f" event={"ID":"b33515c5-677c-478f-9547-b9521f9e44e7","Type":"ContainerDied","Data":"7a998833eabbd08eda93f135c40a58c8f38d7faa6ba345404ef1fea5f2357956"} Jul 29 16:07:42.794675 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:42.794656 2563 generic.go:356] "Generic (PLEG): container finished" podID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerID="293a5e516e91c4f35dd7f3bb208bfa745940c3877e09aafd908d38ccad0c9bf3" exitCode=0 Jul 29 16:07:42.794789 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:42.794731 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3b7e45-cde4-4a88-b755-547d366cd90e","Type":"ContainerDied","Data":"293a5e516e91c4f35dd7f3bb208bfa745940c3877e09aafd908d38ccad0c9bf3"} Jul 29 16:07:43.688162 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:43.688121 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wqzt9" Jul 29 16:07:43.799926 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:43.799891 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nrqlx" event={"ID":"9f5658cd-d6c9-46d9-8e24-6cc5190d9b20","Type":"ContainerStarted","Data":"4feaee15ea68590d9036a9419d8dd471d0bf2afbec761bd57fca74b1fdda1e62"} Jul 29 16:07:43.800387 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:43.799955 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nrqlx" event={"ID":"9f5658cd-d6c9-46d9-8e24-6cc5190d9b20","Type":"ContainerStarted","Data":"7e9c724c2dc640de0a324753db020af09c5da10c25874d56fe32d7346ed37ff9"} Jul 29 16:07:43.802233 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:43.802207 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w9r4f" event={"ID":"b33515c5-677c-478f-9547-b9521f9e44e7","Type":"ContainerStarted","Data":"9593134417e950c45a8aca74c48b23f144f230547d7ca459450a00de1c531d3f"} Jul 29 16:07:43.802377 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:43.802255 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w9r4f" event={"ID":"b33515c5-677c-478f-9547-b9521f9e44e7","Type":"ContainerStarted","Data":"bc34144cbb34522b153261fe87d1d8f84c1766c7a00a2b309b65a3bb12554283"} Jul 29 16:07:43.818959 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:43.818915 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nrqlx" podStartSLOduration=2.911991484 podStartE2EDuration="4.818900812s" totalImagesPullingTime="1.906909328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:07:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:07:43.817705636 +0000 UTC m=+60.835526884" watchObservedRunningTime="2026-07-29 16:07:43.818900812 +0000 UTC m=+60.836722059" Jul 29 16:07:43.841023 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:43.840976 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-w9r4f" podStartSLOduration=3.695247718 podStartE2EDuration="4.84096244s" totalImagesPullingTime="1.070560754s" totalInitContainerRuntime="75.153968ms" isStatefulPod=true podCreationTimestamp="2026-07-29 16:07:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:07:43.84032731 +0000 UTC m=+60.858148558" watchObservedRunningTime="2026-07-29 16:07:43.84096244 +0000 UTC m=+60.858783686" Jul 29 16:07:44.475812 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:44.475773 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-fvztz"] Jul 29 16:07:44.497259 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:44.497230 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-fvztz"] Jul 29 16:07:44.497414 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:44.497358 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-fvztz" Jul 29 16:07:44.500323 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:44.500296 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 29 16:07:44.500323 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:44.500309 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-bpbh2\"" Jul 29 16:07:44.635672 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:44.635637 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wgnq\" (UniqueName: \"kubernetes.io/projected/c6b7df92-327e-4274-b0c1-0e057ffb8e13-kube-api-access-8wgnq\") pod \"monitoring-plugin-68b7fc9574-fvztz\" (UID: \"c6b7df92-327e-4274-b0c1-0e057ffb8e13\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-fvztz" Jul 29 16:07:44.635862 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:44.635796 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c6b7df92-327e-4274-b0c1-0e057ffb8e13-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-fvztz\" (UID: \"c6b7df92-327e-4274-b0c1-0e057ffb8e13\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-fvztz" Jul 29 16:07:44.737242 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:44.737155 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wgnq\" (UniqueName: \"kubernetes.io/projected/c6b7df92-327e-4274-b0c1-0e057ffb8e13-kube-api-access-8wgnq\") pod \"monitoring-plugin-68b7fc9574-fvztz\" (UID: \"c6b7df92-327e-4274-b0c1-0e057ffb8e13\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-fvztz" Jul 29 16:07:44.737413 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:44.737282 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c6b7df92-327e-4274-b0c1-0e057ffb8e13-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-fvztz\" (UID: \"c6b7df92-327e-4274-b0c1-0e057ffb8e13\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-fvztz" Jul 29 16:07:44.737485 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:44.737418 2563 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 29 16:07:44.737485 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:07:44.737481 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6b7df92-327e-4274-b0c1-0e057ffb8e13-monitoring-plugin-cert podName:c6b7df92-327e-4274-b0c1-0e057ffb8e13 nodeName:}" failed. No retries permitted until 2026-07-29 16:07:45.237460798 +0000 UTC m=+62.255282039 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/c6b7df92-327e-4274-b0c1-0e057ffb8e13-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-fvztz" (UID: "c6b7df92-327e-4274-b0c1-0e057ffb8e13") : secret "monitoring-plugin-cert" not found Jul 29 16:07:44.746643 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:44.746616 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wgnq\" (UniqueName: \"kubernetes.io/projected/c6b7df92-327e-4274-b0c1-0e057ffb8e13-kube-api-access-8wgnq\") pod \"monitoring-plugin-68b7fc9574-fvztz\" (UID: \"c6b7df92-327e-4274-b0c1-0e057ffb8e13\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-fvztz" Jul 29 16:07:45.242310 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:45.242291 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c6b7df92-327e-4274-b0c1-0e057ffb8e13-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-fvztz\" (UID: \"c6b7df92-327e-4274-b0c1-0e057ffb8e13\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-fvztz" Jul 29 16:07:45.244378 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:45.244358 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c6b7df92-327e-4274-b0c1-0e057ffb8e13-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-fvztz\" (UID: \"c6b7df92-327e-4274-b0c1-0e057ffb8e13\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-fvztz" Jul 29 16:07:45.407501 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:45.407355 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-fvztz" Jul 29 16:07:45.531191 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:45.531042 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-fvztz"] Jul 29 16:07:45.533434 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:07:45.533410 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6b7df92_327e_4274_b0c1_0e057ffb8e13.slice/crio-000274e9ff3a08d033041c51186647ff74ea8407e81860df8466fd103aeb3c4e WatchSource:0}: Error finding container 000274e9ff3a08d033041c51186647ff74ea8407e81860df8466fd103aeb3c4e: Status 404 returned error can't find the container with id 000274e9ff3a08d033041c51186647ff74ea8407e81860df8466fd103aeb3c4e Jul 29 16:07:45.814969 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:45.814934 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3b7e45-cde4-4a88-b755-547d366cd90e","Type":"ContainerStarted","Data":"6acf0e92ff2f8e563f66a6dd20864fdfcf011ca3ab15ca1beeed700c4f8bf3bc"} Jul 29 16:07:45.815196 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:45.815020 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3b7e45-cde4-4a88-b755-547d366cd90e","Type":"ContainerStarted","Data":"39882be35906531f6365bfc9af7fb3f53a68e61ec68a305304a23b3db1d23bac"} Jul 29 16:07:45.815196 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:45.815056 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3b7e45-cde4-4a88-b755-547d366cd90e","Type":"ContainerStarted","Data":"a78a967b40b98e36215cb846d4d0fa5709669cac9dcefb02960af5e353a594ac"} Jul 29 16:07:45.815196 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:45.815092 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3b7e45-cde4-4a88-b755-547d366cd90e","Type":"ContainerStarted","Data":"0032ce5da50b285c12b77912901e17654b3107c9b2efc29f4cf1f26bb02f70ba"} Jul 29 16:07:45.815196 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:45.815125 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3b7e45-cde4-4a88-b755-547d366cd90e","Type":"ContainerStarted","Data":"0c91fd6198022917ae6f813ffcbc3006a3d4663a0e523bf76626fff76a764065"} Jul 29 16:07:45.816405 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:45.816383 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-fvztz" event={"ID":"c6b7df92-327e-4274-b0c1-0e057ffb8e13","Type":"ContainerStarted","Data":"000274e9ff3a08d033041c51186647ff74ea8407e81860df8466fd103aeb3c4e"} Jul 29 16:07:45.936003 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:45.935970 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 16:07:45.938971 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:45.938946 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:45.941612 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:45.941585 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 29 16:07:45.941732 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:45.941660 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 29 16:07:45.941825 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:45.941599 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 29 16:07:45.942132 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:45.942111 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 29 16:07:45.942239 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:45.942208 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 29 16:07:45.943434 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:45.943306 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 29 16:07:45.943532 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:45.943507 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 29 16:07:45.943690 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:45.943673 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 29 16:07:45.943802 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:45.943704 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-l4z7r\"" Jul 29 16:07:45.943898 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:45.943880 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 29 16:07:45.943898 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:45.943893 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 29 16:07:45.944016 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:45.943881 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 29 16:07:45.944016 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:45.943962 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-43dubno5hgja9\"" Jul 29 16:07:45.944160 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:45.944125 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 29 16:07:45.944343 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:45.944247 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 29 16:07:45.944458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:45.944405 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 29 16:07:45.945650 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:45.945629 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 29 16:07:45.953114 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:45.953094 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5956b5f675-k6sdr"] Jul 29 16:07:45.958489 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:45.958462 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 16:07:46.047311 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.047280 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d888846d4-q5scc"] Jul 29 16:07:46.049568 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.049548 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d888846d4-q5scc" Jul 29 16:07:46.049887 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.049862 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.050104 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.049912 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc7j8\" (UniqueName: \"kubernetes.io/projected/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-kube-api-access-wc7j8\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.050104 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.049943 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.050104 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.049981 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.050104 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.050033 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.050104 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.050059 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.050326 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.050133 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-web-config\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.050326 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.050173 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-config\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.050326 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.050198 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.050326 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.050219 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.050326 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.050280 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.050326 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.050315 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-config-out\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.050605 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.050360 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.050605 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.050421 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.050605 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.050477 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.050605 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.050522 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.050605 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.050550 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.050605 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.050586 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.050951 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.050626 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.050951 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.050655 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.108206 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.108182 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d888846d4-q5scc"] Jul 29 16:07:46.151384 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.151351 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.151485 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.151393 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ba2253d-168a-4979-a41e-fe1c923823e2-console-oauth-config\") pod \"console-d888846d4-q5scc\" (UID: \"8ba2253d-168a-4979-a41e-fe1c923823e2\") " pod="openshift-console/console-d888846d4-q5scc" Jul 29 16:07:46.151485 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.151419 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s89rp\" (UniqueName: \"kubernetes.io/projected/8ba2253d-168a-4979-a41e-fe1c923823e2-kube-api-access-s89rp\") pod \"console-d888846d4-q5scc\" (UID: \"8ba2253d-168a-4979-a41e-fe1c923823e2\") " pod="openshift-console/console-d888846d4-q5scc" Jul 29 16:07:46.151566 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.151517 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ba2253d-168a-4979-a41e-fe1c923823e2-console-config\") pod \"console-d888846d4-q5scc\" (UID: \"8ba2253d-168a-4979-a41e-fe1c923823e2\") " pod="openshift-console/console-d888846d4-q5scc" Jul 29 16:07:46.151597 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.151570 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.151629 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.151600 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.151658 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.151641 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.151700 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.151684 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.151779 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.151715 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ba2253d-168a-4979-a41e-fe1c923823e2-trusted-ca-bundle\") pod \"console-d888846d4-q5scc\" (UID: \"8ba2253d-168a-4979-a41e-fe1c923823e2\") " pod="openshift-console/console-d888846d4-q5scc" Jul 29 16:07:46.151830 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.151775 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.151830 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.151802 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.151936 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.151835 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc7j8\" (UniqueName: \"kubernetes.io/projected/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-kube-api-access-wc7j8\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.151936 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.151861 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.151936 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.151883 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.151936 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.151915 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.152126 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.151939 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.152126 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.151961 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ba2253d-168a-4979-a41e-fe1c923823e2-console-serving-cert\") pod \"console-d888846d4-q5scc\" (UID: \"8ba2253d-168a-4979-a41e-fe1c923823e2\") " pod="openshift-console/console-d888846d4-q5scc" Jul 29 16:07:46.152126 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.152003 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-web-config\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.152126 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.152032 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-config\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.152126 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.152055 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.152126 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.152079 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.152126 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.152121 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.152629 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.152152 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-config-out\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.152629 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.152186 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.152629 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.152223 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ba2253d-168a-4979-a41e-fe1c923823e2-oauth-serving-cert\") pod \"console-d888846d4-q5scc\" (UID: \"8ba2253d-168a-4979-a41e-fe1c923823e2\") " pod="openshift-console/console-d888846d4-q5scc" Jul 29 16:07:46.152629 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.152246 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ba2253d-168a-4979-a41e-fe1c923823e2-service-ca\") pod \"console-d888846d4-q5scc\" (UID: \"8ba2253d-168a-4979-a41e-fe1c923823e2\") " pod="openshift-console/console-d888846d4-q5scc" Jul 29 16:07:46.152629 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.152275 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.152913 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.152756 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.152913 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.152805 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.153346 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.153264 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.154024 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.153996 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.154476 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.154449 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.155144 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.155101 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.155582 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.155530 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.156200 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.155600 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.156200 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.155875 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.156200 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.156056 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.156367 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.156246 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.157065 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.157041 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-config-out\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.157212 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.157166 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.157486 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.157467 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.157608 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.157569 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-web-config\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.157709 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.157627 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-config\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.159265 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.158149 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.159265 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.158155 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.159960 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.159824 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.175660 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.175635 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc7j8\" (UniqueName: \"kubernetes.io/projected/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-kube-api-access-wc7j8\") pod \"prometheus-k8s-0\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.253115 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.253082 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ba2253d-168a-4979-a41e-fe1c923823e2-trusted-ca-bundle\") pod \"console-d888846d4-q5scc\" (UID: \"8ba2253d-168a-4979-a41e-fe1c923823e2\") " pod="openshift-console/console-d888846d4-q5scc" Jul 29 16:07:46.253602 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.253125 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ba2253d-168a-4979-a41e-fe1c923823e2-console-serving-cert\") pod \"console-d888846d4-q5scc\" (UID: \"8ba2253d-168a-4979-a41e-fe1c923823e2\") " pod="openshift-console/console-d888846d4-q5scc" Jul 29 16:07:46.253602 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.253181 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ba2253d-168a-4979-a41e-fe1c923823e2-oauth-serving-cert\") pod \"console-d888846d4-q5scc\" (UID: \"8ba2253d-168a-4979-a41e-fe1c923823e2\") " pod="openshift-console/console-d888846d4-q5scc" Jul 29 16:07:46.253602 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.253196 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ba2253d-168a-4979-a41e-fe1c923823e2-service-ca\") pod \"console-d888846d4-q5scc\" (UID: \"8ba2253d-168a-4979-a41e-fe1c923823e2\") " pod="openshift-console/console-d888846d4-q5scc" Jul 29 16:07:46.253602 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.253241 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ba2253d-168a-4979-a41e-fe1c923823e2-console-oauth-config\") pod \"console-d888846d4-q5scc\" (UID: \"8ba2253d-168a-4979-a41e-fe1c923823e2\") " pod="openshift-console/console-d888846d4-q5scc" Jul 29 16:07:46.253602 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.253263 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s89rp\" (UniqueName: \"kubernetes.io/projected/8ba2253d-168a-4979-a41e-fe1c923823e2-kube-api-access-s89rp\") pod \"console-d888846d4-q5scc\" (UID: \"8ba2253d-168a-4979-a41e-fe1c923823e2\") " pod="openshift-console/console-d888846d4-q5scc" Jul 29 16:07:46.253602 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.253320 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ba2253d-168a-4979-a41e-fe1c923823e2-console-config\") pod \"console-d888846d4-q5scc\" (UID: \"8ba2253d-168a-4979-a41e-fe1c923823e2\") " pod="openshift-console/console-d888846d4-q5scc" Jul 29 16:07:46.254047 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.254024 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ba2253d-168a-4979-a41e-fe1c923823e2-oauth-serving-cert\") pod \"console-d888846d4-q5scc\" (UID: \"8ba2253d-168a-4979-a41e-fe1c923823e2\") " pod="openshift-console/console-d888846d4-q5scc" Jul 29 16:07:46.254117 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.254034 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ba2253d-168a-4979-a41e-fe1c923823e2-service-ca\") pod \"console-d888846d4-q5scc\" (UID: \"8ba2253d-168a-4979-a41e-fe1c923823e2\") " pod="openshift-console/console-d888846d4-q5scc" Jul 29 16:07:46.254117 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.254102 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ba2253d-168a-4979-a41e-fe1c923823e2-trusted-ca-bundle\") pod \"console-d888846d4-q5scc\" (UID: \"8ba2253d-168a-4979-a41e-fe1c923823e2\") " pod="openshift-console/console-d888846d4-q5scc" Jul 29 16:07:46.254335 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.254307 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:07:46.254614 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.254309 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ba2253d-168a-4979-a41e-fe1c923823e2-console-config\") pod \"console-d888846d4-q5scc\" (UID: \"8ba2253d-168a-4979-a41e-fe1c923823e2\") " pod="openshift-console/console-d888846d4-q5scc" Jul 29 16:07:46.257075 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.256829 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ba2253d-168a-4979-a41e-fe1c923823e2-console-serving-cert\") pod \"console-d888846d4-q5scc\" (UID: \"8ba2253d-168a-4979-a41e-fe1c923823e2\") " pod="openshift-console/console-d888846d4-q5scc" Jul 29 16:07:46.257075 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.256948 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ba2253d-168a-4979-a41e-fe1c923823e2-console-oauth-config\") pod \"console-d888846d4-q5scc\" (UID: \"8ba2253d-168a-4979-a41e-fe1c923823e2\") " pod="openshift-console/console-d888846d4-q5scc" Jul 29 16:07:46.264322 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.264302 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s89rp\" (UniqueName: \"kubernetes.io/projected/8ba2253d-168a-4979-a41e-fe1c923823e2-kube-api-access-s89rp\") pod \"console-d888846d4-q5scc\" (UID: \"8ba2253d-168a-4979-a41e-fe1c923823e2\") " pod="openshift-console/console-d888846d4-q5scc" Jul 29 16:07:46.361437 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.361363 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d888846d4-q5scc" Jul 29 16:07:46.390380 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.390357 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 16:07:46.392993 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:07:46.392959 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb8d4722_19e1_4303_a0f1_df5a7c778fc4.slice/crio-9e84a4d35755dcc06330c8cd9d50220a19ddb159e91aaa7bc61502f431022cd3 WatchSource:0}: Error finding container 9e84a4d35755dcc06330c8cd9d50220a19ddb159e91aaa7bc61502f431022cd3: Status 404 returned error can't find the container with id 9e84a4d35755dcc06330c8cd9d50220a19ddb159e91aaa7bc61502f431022cd3 Jul 29 16:07:46.498577 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.498547 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d888846d4-q5scc"] Jul 29 16:07:46.529708 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:07:46.529681 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ba2253d_168a_4979_a41e_fe1c923823e2.slice/crio-5bf49aa88c8bad494c1651ffd78c1ec0ff8062738724260b5effca8d75714141 WatchSource:0}: Error finding container 5bf49aa88c8bad494c1651ffd78c1ec0ff8062738724260b5effca8d75714141: Status 404 returned error can't find the container with id 5bf49aa88c8bad494c1651ffd78c1ec0ff8062738724260b5effca8d75714141 Jul 29 16:07:46.821495 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.821460 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d888846d4-q5scc" event={"ID":"8ba2253d-168a-4979-a41e-fe1c923823e2","Type":"ContainerStarted","Data":"85a943131b55412a372680a1063572568981e1bfdba114707e3d7e99735092d9"} Jul 29 16:07:46.821688 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.821513 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d888846d4-q5scc" event={"ID":"8ba2253d-168a-4979-a41e-fe1c923823e2","Type":"ContainerStarted","Data":"5bf49aa88c8bad494c1651ffd78c1ec0ff8062738724260b5effca8d75714141"} Jul 29 16:07:46.822851 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.822829 2563 generic.go:356] "Generic (PLEG): container finished" podID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerID="75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba" exitCode=0 Jul 29 16:07:46.822934 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.822911 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cb8d4722-19e1-4303-a0f1-df5a7c778fc4","Type":"ContainerDied","Data":"75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba"} Jul 29 16:07:46.823040 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.823024 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cb8d4722-19e1-4303-a0f1-df5a7c778fc4","Type":"ContainerStarted","Data":"9e84a4d35755dcc06330c8cd9d50220a19ddb159e91aaa7bc61502f431022cd3"} Jul 29 16:07:46.826321 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.826296 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3b7e45-cde4-4a88-b755-547d366cd90e","Type":"ContainerStarted","Data":"efca421b08d6e8c60eeca0c211097988f80ee5460b7b8e0b28d467cd101cc7a6"} Jul 29 16:07:46.840911 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.840859 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d888846d4-q5scc" podStartSLOduration=1.840842491 podStartE2EDuration="1.840842491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:07:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:07:46.839537228 +0000 UTC m=+63.857358474" watchObservedRunningTime="2026-07-29 16:07:46.840842491 +0000 UTC m=+63.858663737" Jul 29 16:07:46.868568 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:46.868517 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.316343682 podStartE2EDuration="6.86850182s" totalImagesPullingTime="4.528818402s" totalInitContainerRuntime="23.339736ms" isStatefulPod=false podCreationTimestamp="2026-07-29 16:07:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:07:46.867894776 +0000 UTC m=+63.885716042" watchObservedRunningTime="2026-07-29 16:07:46.86850182 +0000 UTC m=+63.886323067" Jul 29 16:07:48.835790 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:48.835728 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-fvztz" event={"ID":"c6b7df92-327e-4274-b0c1-0e057ffb8e13","Type":"ContainerStarted","Data":"92a5ae4b7ba1b1c0319f79e3427054c0ed30027da5075bd4b6f907a3ec643ff3"} Jul 29 16:07:48.836239 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:48.835925 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-fvztz" Jul 29 16:07:48.842790 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:48.842771 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-fvztz" Jul 29 16:07:48.855789 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:48.855721 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-fvztz" podStartSLOduration=1.766078601 podStartE2EDuration="4.855706536s" totalImagesPullingTime="3.089627935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:07:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:07:48.854937694 +0000 UTC m=+65.872758942" watchObservedRunningTime="2026-07-29 16:07:48.855706536 +0000 UTC m=+65.873527807" Jul 29 16:07:49.027012 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:49.026984 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5956b5f675-k6sdr" Jul 29 16:07:49.183762 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:49.183718 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kpjc\" (UniqueName: \"kubernetes.io/projected/066859ca-e247-4082-b6f9-d758329a31e5-kube-api-access-2kpjc\") pod \"network-check-target-pxg62\" (UID: \"066859ca-e247-4082-b6f9-d758329a31e5\") " pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:07:49.186348 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:49.186321 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 16:07:49.197520 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:49.197497 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 16:07:49.207387 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:49.207361 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kpjc\" (UniqueName: \"kubernetes.io/projected/066859ca-e247-4082-b6f9-d758329a31e5-kube-api-access-2kpjc\") pod \"network-check-target-pxg62\" (UID: \"066859ca-e247-4082-b6f9-d758329a31e5\") " pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:07:49.261472 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:49.261441 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bvftr\"" Jul 29 16:07:49.269814 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:49.269798 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:07:49.284421 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:49.284373 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f75274e-f78e-4656-ad34-0e149d4dff5b-original-pull-secret\") pod \"global-pull-secret-syncer-ttc2b\" (UID: \"3f75274e-f78e-4656-ad34-0e149d4dff5b\") " pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:07:49.284521 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:49.284466 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8df6793f-3b49-4b29-ae90-d18f79c16891-metrics-certs\") pod \"network-metrics-daemon-z978p\" (UID: \"8df6793f-3b49-4b29-ae90-d18f79c16891\") " pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:07:49.287260 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:49.287234 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 16:07:49.287260 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:49.287242 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 16:07:49.298323 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:49.298302 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8df6793f-3b49-4b29-ae90-d18f79c16891-metrics-certs\") pod \"network-metrics-daemon-z978p\" (UID: \"8df6793f-3b49-4b29-ae90-d18f79c16891\") " pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:07:49.298420 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:49.298395 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f75274e-f78e-4656-ad34-0e149d4dff5b-original-pull-secret\") pod \"global-pull-secret-syncer-ttc2b\" (UID: \"3f75274e-f78e-4656-ad34-0e149d4dff5b\") " pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:07:49.416147 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:49.416116 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pxg62"] Jul 29 16:07:49.419588 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:07:49.419556 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod066859ca_e247_4082_b6f9_d758329a31e5.slice/crio-e63c42654e4f3f70a65bc50d7071523c8d5b7592d829f47ad8b890e63f8f9cc6 WatchSource:0}: Error finding container e63c42654e4f3f70a65bc50d7071523c8d5b7592d829f47ad8b890e63f8f9cc6: Status 404 returned error can't find the container with id e63c42654e4f3f70a65bc50d7071523c8d5b7592d829f47ad8b890e63f8f9cc6 Jul 29 16:07:49.569993 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:49.569928 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bdnwf\"" Jul 29 16:07:49.576267 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:49.576245 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttc2b" Jul 29 16:07:49.578315 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:49.578294 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z978p" Jul 29 16:07:49.840954 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:49.840856 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pxg62" event={"ID":"066859ca-e247-4082-b6f9-d758329a31e5","Type":"ContainerStarted","Data":"e63c42654e4f3f70a65bc50d7071523c8d5b7592d829f47ad8b890e63f8f9cc6"} Jul 29 16:07:50.786534 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:50.786508 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ttc2b"] Jul 29 16:07:50.788797 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:07:50.788773 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f75274e_f78e_4656_ad34_0e149d4dff5b.slice/crio-14d8e1e200182a1cb86881c892c3b007e0181e99ee5c303bbcf0dfd13dff91bc WatchSource:0}: Error finding container 14d8e1e200182a1cb86881c892c3b007e0181e99ee5c303bbcf0dfd13dff91bc: Status 404 returned error can't find the container with id 14d8e1e200182a1cb86881c892c3b007e0181e99ee5c303bbcf0dfd13dff91bc Jul 29 16:07:50.809134 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:50.809099 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z978p"] Jul 29 16:07:50.811094 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:07:50.811071 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8df6793f_3b49_4b29_ae90_d18f79c16891.slice/crio-f022bd8b0f2cadeae18ba1c7f20de6658e07e38ad82f62eebc7913eba966868a WatchSource:0}: Error finding container f022bd8b0f2cadeae18ba1c7f20de6658e07e38ad82f62eebc7913eba966868a: Status 404 returned error can't find the container with id f022bd8b0f2cadeae18ba1c7f20de6658e07e38ad82f62eebc7913eba966868a Jul 29 16:07:50.846147 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:50.846107 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ttc2b" event={"ID":"3f75274e-f78e-4656-ad34-0e149d4dff5b","Type":"ContainerStarted","Data":"14d8e1e200182a1cb86881c892c3b007e0181e99ee5c303bbcf0dfd13dff91bc"} Jul 29 16:07:50.847855 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:50.847793 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z978p" event={"ID":"8df6793f-3b49-4b29-ae90-d18f79c16891","Type":"ContainerStarted","Data":"f022bd8b0f2cadeae18ba1c7f20de6658e07e38ad82f62eebc7913eba966868a"} Jul 29 16:07:50.850282 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:50.850253 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cb8d4722-19e1-4303-a0f1-df5a7c778fc4","Type":"ContainerStarted","Data":"4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181"} Jul 29 16:07:51.157383 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:51.157296 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d888846d4-q5scc"] Jul 29 16:07:51.195421 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:51.195389 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b7dbbb86-nfcn4"] Jul 29 16:07:51.218619 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:51.218590 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b7dbbb86-nfcn4"] Jul 29 16:07:51.218825 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:51.218715 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b7dbbb86-nfcn4" Jul 29 16:07:51.303711 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:51.303676 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ab82134-438e-4fa2-8bcf-f0027f2505b3-console-serving-cert\") pod \"console-6b7dbbb86-nfcn4\" (UID: \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\") " pod="openshift-console/console-6b7dbbb86-nfcn4" Jul 29 16:07:51.304015 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:51.303765 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ab82134-438e-4fa2-8bcf-f0027f2505b3-service-ca\") pod \"console-6b7dbbb86-nfcn4\" (UID: \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\") " pod="openshift-console/console-6b7dbbb86-nfcn4" Jul 29 16:07:51.304015 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:51.303880 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ab82134-438e-4fa2-8bcf-f0027f2505b3-console-oauth-config\") pod \"console-6b7dbbb86-nfcn4\" (UID: \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\") " pod="openshift-console/console-6b7dbbb86-nfcn4" Jul 29 16:07:51.304015 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:51.303939 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ab82134-438e-4fa2-8bcf-f0027f2505b3-console-config\") pod \"console-6b7dbbb86-nfcn4\" (UID: \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\") " pod="openshift-console/console-6b7dbbb86-nfcn4" Jul 29 16:07:51.304015 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:51.303970 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab82134-438e-4fa2-8bcf-f0027f2505b3-trusted-ca-bundle\") pod \"console-6b7dbbb86-nfcn4\" (UID: \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\") " pod="openshift-console/console-6b7dbbb86-nfcn4" Jul 29 16:07:51.304015 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:51.303993 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ab82134-438e-4fa2-8bcf-f0027f2505b3-oauth-serving-cert\") pod \"console-6b7dbbb86-nfcn4\" (UID: \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\") " pod="openshift-console/console-6b7dbbb86-nfcn4" Jul 29 16:07:51.304317 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:51.304024 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr9hw\" (UniqueName: \"kubernetes.io/projected/2ab82134-438e-4fa2-8bcf-f0027f2505b3-kube-api-access-lr9hw\") pod \"console-6b7dbbb86-nfcn4\" (UID: \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\") " pod="openshift-console/console-6b7dbbb86-nfcn4" Jul 29 16:07:51.405254 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:51.405201 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ab82134-438e-4fa2-8bcf-f0027f2505b3-console-oauth-config\") pod \"console-6b7dbbb86-nfcn4\" (UID: \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\") " pod="openshift-console/console-6b7dbbb86-nfcn4" Jul 29 16:07:51.405551 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:51.405266 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ab82134-438e-4fa2-8bcf-f0027f2505b3-console-config\") pod \"console-6b7dbbb86-nfcn4\" (UID: \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\") " pod="openshift-console/console-6b7dbbb86-nfcn4" Jul 29 16:07:51.405551 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:51.405297 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab82134-438e-4fa2-8bcf-f0027f2505b3-trusted-ca-bundle\") pod \"console-6b7dbbb86-nfcn4\" (UID: \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\") " pod="openshift-console/console-6b7dbbb86-nfcn4" Jul 29 16:07:51.405551 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:51.405325 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ab82134-438e-4fa2-8bcf-f0027f2505b3-oauth-serving-cert\") pod \"console-6b7dbbb86-nfcn4\" (UID: \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\") " pod="openshift-console/console-6b7dbbb86-nfcn4" Jul 29 16:07:51.405551 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:51.405361 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr9hw\" (UniqueName: \"kubernetes.io/projected/2ab82134-438e-4fa2-8bcf-f0027f2505b3-kube-api-access-lr9hw\") pod \"console-6b7dbbb86-nfcn4\" (UID: \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\") " pod="openshift-console/console-6b7dbbb86-nfcn4" Jul 29 16:07:51.405551 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:51.405409 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ab82134-438e-4fa2-8bcf-f0027f2505b3-console-serving-cert\") pod \"console-6b7dbbb86-nfcn4\" (UID: \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\") " pod="openshift-console/console-6b7dbbb86-nfcn4" Jul 29 16:07:51.405551 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:51.405469 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ab82134-438e-4fa2-8bcf-f0027f2505b3-service-ca\") pod \"console-6b7dbbb86-nfcn4\" (UID: \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\") " pod="openshift-console/console-6b7dbbb86-nfcn4" Jul 29 16:07:51.406211 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:51.406181 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ab82134-438e-4fa2-8bcf-f0027f2505b3-console-config\") pod \"console-6b7dbbb86-nfcn4\" (UID: \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\") " pod="openshift-console/console-6b7dbbb86-nfcn4" Jul 29 16:07:51.406362 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:51.406296 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ab82134-438e-4fa2-8bcf-f0027f2505b3-oauth-serving-cert\") pod \"console-6b7dbbb86-nfcn4\" (UID: \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\") " pod="openshift-console/console-6b7dbbb86-nfcn4" Jul 29 16:07:51.406362 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:51.406314 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab82134-438e-4fa2-8bcf-f0027f2505b3-trusted-ca-bundle\") pod \"console-6b7dbbb86-nfcn4\" (UID: \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\") " pod="openshift-console/console-6b7dbbb86-nfcn4" Jul 29 16:07:51.406362 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:51.406278 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ab82134-438e-4fa2-8bcf-f0027f2505b3-service-ca\") pod \"console-6b7dbbb86-nfcn4\" (UID: \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\") " pod="openshift-console/console-6b7dbbb86-nfcn4" Jul 29 16:07:51.408281 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:51.408222 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ab82134-438e-4fa2-8bcf-f0027f2505b3-console-oauth-config\") pod \"console-6b7dbbb86-nfcn4\" (UID: \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\") " pod="openshift-console/console-6b7dbbb86-nfcn4" Jul 29 16:07:51.408923 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:51.408899 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ab82134-438e-4fa2-8bcf-f0027f2505b3-console-serving-cert\") pod \"console-6b7dbbb86-nfcn4\" (UID: \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\") " pod="openshift-console/console-6b7dbbb86-nfcn4" Jul 29 16:07:51.413948 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:51.413927 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr9hw\" (UniqueName: \"kubernetes.io/projected/2ab82134-438e-4fa2-8bcf-f0027f2505b3-kube-api-access-lr9hw\") pod \"console-6b7dbbb86-nfcn4\" (UID: \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\") " pod="openshift-console/console-6b7dbbb86-nfcn4" Jul 29 16:07:51.530492 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:51.530232 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b7dbbb86-nfcn4" Jul 29 16:07:51.720617 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:51.720374 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b7dbbb86-nfcn4"] Jul 29 16:07:51.863639 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:51.863541 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cb8d4722-19e1-4303-a0f1-df5a7c778fc4","Type":"ContainerStarted","Data":"ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007"} Jul 29 16:07:51.868076 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:51.866129 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b7dbbb86-nfcn4" event={"ID":"2ab82134-438e-4fa2-8bcf-f0027f2505b3","Type":"ContainerStarted","Data":"ab7a56a6cb1aa930362e846ef17ce957ffc4eac87ccf641bb3e94663b2596053"} Jul 29 16:07:51.868076 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:51.866181 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b7dbbb86-nfcn4" event={"ID":"2ab82134-438e-4fa2-8bcf-f0027f2505b3","Type":"ContainerStarted","Data":"2fc567425080d4f3727f1b18509b0114af6e855e762826eb4b1c255091afe7c4"} Jul 29 16:07:51.887778 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:51.887628 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b7dbbb86-nfcn4" podStartSLOduration=0.88760537 podStartE2EDuration="887.60537ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:07:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:07:51.884498608 +0000 UTC m=+68.902319862" watchObservedRunningTime="2026-07-29 16:07:51.88760537 +0000 UTC m=+68.905426620" Jul 29 16:07:56.362470 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:56.362440 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d888846d4-q5scc" Jul 29 16:07:56.897756 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:56.897707 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cb8d4722-19e1-4303-a0f1-df5a7c778fc4","Type":"ContainerStarted","Data":"efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8"} Jul 29 16:07:56.897895 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:56.897810 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cb8d4722-19e1-4303-a0f1-df5a7c778fc4","Type":"ContainerStarted","Data":"100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339"} Jul 29 16:07:56.897895 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:56.897855 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cb8d4722-19e1-4303-a0f1-df5a7c778fc4","Type":"ContainerStarted","Data":"445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035"} Jul 29 16:07:56.897895 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:56.897890 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cb8d4722-19e1-4303-a0f1-df5a7c778fc4","Type":"ContainerStarted","Data":"d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5"} Jul 29 16:07:56.899260 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:56.899228 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ttc2b" event={"ID":"3f75274e-f78e-4656-ad34-0e149d4dff5b","Type":"ContainerStarted","Data":"2f7d6a3846a7f36d9c9ceb5e51a3a55e9774f26b23e4be3d5d9818ec848dce05"} Jul 29 16:07:56.900949 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:56.900919 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z978p" event={"ID":"8df6793f-3b49-4b29-ae90-d18f79c16891","Type":"ContainerStarted","Data":"a16e2de017f4051d24ceeee065d2e76756fe9ca793d72b5fb80ebb4668c0e7b7"} Jul 29 16:07:56.901049 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:56.900971 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z978p" event={"ID":"8df6793f-3b49-4b29-ae90-d18f79c16891","Type":"ContainerStarted","Data":"e6d04c8c02d7cf9013adb941c6228452cc5a44256128da3de3d14f4c394afb55"} Jul 29 16:07:56.902119 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:56.902099 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pxg62" event={"ID":"066859ca-e247-4082-b6f9-d758329a31e5","Type":"ContainerStarted","Data":"52e9f5bbb4898f5dfb522b07da038d82064b00c902a9c175230ccdcb0daac90d"} Jul 29 16:07:56.902230 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:56.902220 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:07:56.941191 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:56.941145 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.111409273 podStartE2EDuration="11.941131855s" totalImagesPullingTime="8.811457105s" totalInitContainerRuntime="18.265477ms" isStatefulPod=false podCreationTimestamp="2026-07-29 16:07:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:07:56.940643153 +0000 UTC m=+73.958464401" watchObservedRunningTime="2026-07-29 16:07:56.941131855 +0000 UTC m=+73.958953103" Jul 29 16:07:56.958515 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:56.958474 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-z978p" podStartSLOduration=67.79576398 podStartE2EDuration="1m12.958460227s" totalImagesPullingTime="5.162696247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:06:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:07:56.957338844 +0000 UTC m=+73.975160091" watchObservedRunningTime="2026-07-29 16:07:56.958460227 +0000 UTC m=+73.976281484" Jul 29 16:07:56.972413 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:56.972370 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ttc2b" podStartSLOduration=67.84355446000001 podStartE2EDuration="1m12.972356296s" totalImagesPullingTime="5.128801836s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:06:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:07:56.971393283 +0000 UTC m=+73.989214532" watchObservedRunningTime="2026-07-29 16:07:56.972356296 +0000 UTC m=+73.990177543" Jul 29 16:07:56.989428 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:07:56.989381 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pxg62" podStartSLOduration=66.491494026 podStartE2EDuration="1m12.989367964s" totalImagesPullingTime="6.497873938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:06:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:07:56.989304199 +0000 UTC m=+74.007125446" watchObservedRunningTime="2026-07-29 16:07:56.989367964 +0000 UTC m=+74.007189211" Jul 29 16:08:01.255097 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:01.255044 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:08:01.531179 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:01.531092 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b7dbbb86-nfcn4" Jul 29 16:08:01.531179 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:01.531154 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b7dbbb86-nfcn4" Jul 29 16:08:01.536430 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:01.536409 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b7dbbb86-nfcn4" Jul 29 16:08:01.925874 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:01.925794 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b7dbbb86-nfcn4" Jul 29 16:08:01.975329 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:01.975293 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6789f44b6d-8wl5j"] Jul 29 16:08:10.974677 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:10.974555 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5956b5f675-k6sdr" podUID="03829d99-4712-4182-8c21-f596670dcd87" containerName="console" containerID="cri-o://6abc0765945fd6c8fdc7e222d6771099c5d05c8bcc580e6a99c2605c201253f8" gracePeriod=15 Jul 29 16:08:11.745877 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:11.745854 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5956b5f675-k6sdr" Jul 29 16:08:11.776988 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:11.776961 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03829d99-4712-4182-8c21-f596670dcd87-console-serving-cert\") pod \"03829d99-4712-4182-8c21-f596670dcd87\" (UID: \"03829d99-4712-4182-8c21-f596670dcd87\") " Jul 29 16:08:11.777131 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:11.776994 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03829d99-4712-4182-8c21-f596670dcd87-service-ca\") pod \"03829d99-4712-4182-8c21-f596670dcd87\" (UID: \"03829d99-4712-4182-8c21-f596670dcd87\") " Jul 29 16:08:11.777131 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:11.777022 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03829d99-4712-4182-8c21-f596670dcd87-console-oauth-config\") pod \"03829d99-4712-4182-8c21-f596670dcd87\" (UID: \"03829d99-4712-4182-8c21-f596670dcd87\") " Jul 29 16:08:11.777131 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:11.777047 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03829d99-4712-4182-8c21-f596670dcd87-console-config\") pod \"03829d99-4712-4182-8c21-f596670dcd87\" (UID: \"03829d99-4712-4182-8c21-f596670dcd87\") " Jul 29 16:08:11.777131 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:11.777089 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4n2r5\" (UniqueName: \"kubernetes.io/projected/03829d99-4712-4182-8c21-f596670dcd87-kube-api-access-4n2r5\") pod \"03829d99-4712-4182-8c21-f596670dcd87\" (UID: \"03829d99-4712-4182-8c21-f596670dcd87\") " Jul 29 16:08:11.777348 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:11.777170 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03829d99-4712-4182-8c21-f596670dcd87-oauth-serving-cert\") pod \"03829d99-4712-4182-8c21-f596670dcd87\" (UID: \"03829d99-4712-4182-8c21-f596670dcd87\") " Jul 29 16:08:11.777348 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:11.777219 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03829d99-4712-4182-8c21-f596670dcd87-trusted-ca-bundle\") pod \"03829d99-4712-4182-8c21-f596670dcd87\" (UID: \"03829d99-4712-4182-8c21-f596670dcd87\") " Jul 29 16:08:11.777448 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:11.777365 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03829d99-4712-4182-8c21-f596670dcd87-service-ca" (OuterVolumeSpecName: "service-ca") pod "03829d99-4712-4182-8c21-f596670dcd87" (UID: "03829d99-4712-4182-8c21-f596670dcd87"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:08:11.777712 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:11.777577 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03829d99-4712-4182-8c21-f596670dcd87-console-config" (OuterVolumeSpecName: "console-config") pod "03829d99-4712-4182-8c21-f596670dcd87" (UID: "03829d99-4712-4182-8c21-f596670dcd87"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:08:11.777712 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:11.777611 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03829d99-4712-4182-8c21-f596670dcd87-service-ca\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:08:11.777938 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:11.777904 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03829d99-4712-4182-8c21-f596670dcd87-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "03829d99-4712-4182-8c21-f596670dcd87" (UID: "03829d99-4712-4182-8c21-f596670dcd87"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:08:11.778008 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:11.777976 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03829d99-4712-4182-8c21-f596670dcd87-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "03829d99-4712-4182-8c21-f596670dcd87" (UID: "03829d99-4712-4182-8c21-f596670dcd87"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:08:11.779472 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:11.779437 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03829d99-4712-4182-8c21-f596670dcd87-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "03829d99-4712-4182-8c21-f596670dcd87" (UID: "03829d99-4712-4182-8c21-f596670dcd87"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:08:11.779568 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:11.779512 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03829d99-4712-4182-8c21-f596670dcd87-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "03829d99-4712-4182-8c21-f596670dcd87" (UID: "03829d99-4712-4182-8c21-f596670dcd87"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:08:11.779568 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:11.779513 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03829d99-4712-4182-8c21-f596670dcd87-kube-api-access-4n2r5" (OuterVolumeSpecName: "kube-api-access-4n2r5") pod "03829d99-4712-4182-8c21-f596670dcd87" (UID: "03829d99-4712-4182-8c21-f596670dcd87"). InnerVolumeSpecName "kube-api-access-4n2r5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:08:11.878729 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:11.878675 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03829d99-4712-4182-8c21-f596670dcd87-console-serving-cert\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:08:11.878729 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:11.878694 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03829d99-4712-4182-8c21-f596670dcd87-console-oauth-config\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:08:11.878729 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:11.878704 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03829d99-4712-4182-8c21-f596670dcd87-console-config\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:08:11.878729 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:11.878714 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4n2r5\" (UniqueName: \"kubernetes.io/projected/03829d99-4712-4182-8c21-f596670dcd87-kube-api-access-4n2r5\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:08:11.878729 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:11.878722 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03829d99-4712-4182-8c21-f596670dcd87-oauth-serving-cert\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:08:11.878729 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:11.878730 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03829d99-4712-4182-8c21-f596670dcd87-trusted-ca-bundle\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:08:11.961622 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:11.961597 2563 generic.go:356] "Generic (PLEG): container finished" podID="03829d99-4712-4182-8c21-f596670dcd87" containerID="6abc0765945fd6c8fdc7e222d6771099c5d05c8bcc580e6a99c2605c201253f8" exitCode=0 Jul 29 16:08:11.961715 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:11.961643 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5956b5f675-k6sdr" Jul 29 16:08:11.961715 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:11.961675 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5956b5f675-k6sdr" event={"ID":"03829d99-4712-4182-8c21-f596670dcd87","Type":"ContainerDied","Data":"6abc0765945fd6c8fdc7e222d6771099c5d05c8bcc580e6a99c2605c201253f8"} Jul 29 16:08:11.961715 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:11.961712 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5956b5f675-k6sdr" event={"ID":"03829d99-4712-4182-8c21-f596670dcd87","Type":"ContainerDied","Data":"252e739937a6ceeb9f68722a2457d27f9f19874554de9113ab55a2aee7633db6"} Jul 29 16:08:11.961884 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:11.961731 2563 scope.go:117] "RemoveContainer" containerID="6abc0765945fd6c8fdc7e222d6771099c5d05c8bcc580e6a99c2605c201253f8" Jul 29 16:08:11.981812 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:11.981791 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5956b5f675-k6sdr"] Jul 29 16:08:11.983728 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:11.983700 2563 scope.go:117] "RemoveContainer" containerID="6abc0765945fd6c8fdc7e222d6771099c5d05c8bcc580e6a99c2605c201253f8" Jul 29 16:08:11.983999 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:08:11.983980 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6abc0765945fd6c8fdc7e222d6771099c5d05c8bcc580e6a99c2605c201253f8\": container with ID starting with 6abc0765945fd6c8fdc7e222d6771099c5d05c8bcc580e6a99c2605c201253f8 not found: ID does not exist" containerID="6abc0765945fd6c8fdc7e222d6771099c5d05c8bcc580e6a99c2605c201253f8" Jul 29 16:08:11.984048 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:11.984009 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6abc0765945fd6c8fdc7e222d6771099c5d05c8bcc580e6a99c2605c201253f8"} err="failed to get container status \"6abc0765945fd6c8fdc7e222d6771099c5d05c8bcc580e6a99c2605c201253f8\": rpc error: code = NotFound desc = could not find container \"6abc0765945fd6c8fdc7e222d6771099c5d05c8bcc580e6a99c2605c201253f8\": container with ID starting with 6abc0765945fd6c8fdc7e222d6771099c5d05c8bcc580e6a99c2605c201253f8 not found: ID does not exist" Jul 29 16:08:11.989603 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:11.989584 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5956b5f675-k6sdr"] Jul 29 16:08:13.542582 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:13.542549 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03829d99-4712-4182-8c21-f596670dcd87" path="/var/lib/kubelet/pods/03829d99-4712-4182-8c21-f596670dcd87/volumes" Jul 29 16:08:16.179915 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:16.179857 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d888846d4-q5scc" podUID="8ba2253d-168a-4979-a41e-fe1c923823e2" containerName="console" containerID="cri-o://85a943131b55412a372680a1063572568981e1bfdba114707e3d7e99735092d9" gracePeriod=15 Jul 29 16:08:16.441779 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:16.441739 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d888846d4-q5scc" Jul 29 16:08:16.512041 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:16.512008 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s89rp\" (UniqueName: \"kubernetes.io/projected/8ba2253d-168a-4979-a41e-fe1c923823e2-kube-api-access-s89rp\") pod \"8ba2253d-168a-4979-a41e-fe1c923823e2\" (UID: \"8ba2253d-168a-4979-a41e-fe1c923823e2\") " Jul 29 16:08:16.512041 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:16.512044 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ba2253d-168a-4979-a41e-fe1c923823e2-trusted-ca-bundle\") pod \"8ba2253d-168a-4979-a41e-fe1c923823e2\" (UID: \"8ba2253d-168a-4979-a41e-fe1c923823e2\") " Jul 29 16:08:16.512271 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:16.512075 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ba2253d-168a-4979-a41e-fe1c923823e2-console-serving-cert\") pod \"8ba2253d-168a-4979-a41e-fe1c923823e2\" (UID: \"8ba2253d-168a-4979-a41e-fe1c923823e2\") " Jul 29 16:08:16.512271 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:16.512101 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ba2253d-168a-4979-a41e-fe1c923823e2-oauth-serving-cert\") pod \"8ba2253d-168a-4979-a41e-fe1c923823e2\" (UID: \"8ba2253d-168a-4979-a41e-fe1c923823e2\") " Jul 29 16:08:16.512271 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:16.512231 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ba2253d-168a-4979-a41e-fe1c923823e2-console-oauth-config\") pod \"8ba2253d-168a-4979-a41e-fe1c923823e2\" (UID: \"8ba2253d-168a-4979-a41e-fe1c923823e2\") " Jul 29 16:08:16.512433 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:16.512288 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ba2253d-168a-4979-a41e-fe1c923823e2-console-config\") pod \"8ba2253d-168a-4979-a41e-fe1c923823e2\" (UID: \"8ba2253d-168a-4979-a41e-fe1c923823e2\") " Jul 29 16:08:16.512433 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:16.512324 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ba2253d-168a-4979-a41e-fe1c923823e2-service-ca\") pod \"8ba2253d-168a-4979-a41e-fe1c923823e2\" (UID: \"8ba2253d-168a-4979-a41e-fe1c923823e2\") " Jul 29 16:08:16.512535 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:16.512470 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ba2253d-168a-4979-a41e-fe1c923823e2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8ba2253d-168a-4979-a41e-fe1c923823e2" (UID: "8ba2253d-168a-4979-a41e-fe1c923823e2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:08:16.512586 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:16.512487 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ba2253d-168a-4979-a41e-fe1c923823e2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8ba2253d-168a-4979-a41e-fe1c923823e2" (UID: "8ba2253d-168a-4979-a41e-fe1c923823e2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:08:16.512632 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:16.512621 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ba2253d-168a-4979-a41e-fe1c923823e2-oauth-serving-cert\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:08:16.512797 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:16.512763 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ba2253d-168a-4979-a41e-fe1c923823e2-console-config" (OuterVolumeSpecName: "console-config") pod "8ba2253d-168a-4979-a41e-fe1c923823e2" (UID: "8ba2253d-168a-4979-a41e-fe1c923823e2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:08:16.512882 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:16.512814 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ba2253d-168a-4979-a41e-fe1c923823e2-service-ca" (OuterVolumeSpecName: "service-ca") pod "8ba2253d-168a-4979-a41e-fe1c923823e2" (UID: "8ba2253d-168a-4979-a41e-fe1c923823e2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:08:16.514346 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:16.514324 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ba2253d-168a-4979-a41e-fe1c923823e2-kube-api-access-s89rp" (OuterVolumeSpecName: "kube-api-access-s89rp") pod "8ba2253d-168a-4979-a41e-fe1c923823e2" (UID: "8ba2253d-168a-4979-a41e-fe1c923823e2"). InnerVolumeSpecName "kube-api-access-s89rp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:08:16.514844 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:16.514827 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ba2253d-168a-4979-a41e-fe1c923823e2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8ba2253d-168a-4979-a41e-fe1c923823e2" (UID: "8ba2253d-168a-4979-a41e-fe1c923823e2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:08:16.514914 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:16.514888 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ba2253d-168a-4979-a41e-fe1c923823e2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8ba2253d-168a-4979-a41e-fe1c923823e2" (UID: "8ba2253d-168a-4979-a41e-fe1c923823e2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:08:16.613250 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:16.613224 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s89rp\" (UniqueName: \"kubernetes.io/projected/8ba2253d-168a-4979-a41e-fe1c923823e2-kube-api-access-s89rp\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:08:16.613250 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:16.613248 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ba2253d-168a-4979-a41e-fe1c923823e2-trusted-ca-bundle\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:08:16.613250 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:16.613256 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ba2253d-168a-4979-a41e-fe1c923823e2-console-serving-cert\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:08:16.613455 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:16.613265 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ba2253d-168a-4979-a41e-fe1c923823e2-console-oauth-config\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:08:16.613455 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:16.613273 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ba2253d-168a-4979-a41e-fe1c923823e2-console-config\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:08:16.613455 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:16.613282 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ba2253d-168a-4979-a41e-fe1c923823e2-service-ca\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:08:16.985473 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:16.985441 2563 generic.go:356] "Generic (PLEG): container finished" podID="8ba2253d-168a-4979-a41e-fe1c923823e2" containerID="85a943131b55412a372680a1063572568981e1bfdba114707e3d7e99735092d9" exitCode=0 Jul 29 16:08:16.985629 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:16.985488 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d888846d4-q5scc" Jul 29 16:08:16.985629 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:16.985501 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d888846d4-q5scc" event={"ID":"8ba2253d-168a-4979-a41e-fe1c923823e2","Type":"ContainerDied","Data":"85a943131b55412a372680a1063572568981e1bfdba114707e3d7e99735092d9"} Jul 29 16:08:16.985629 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:16.985542 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d888846d4-q5scc" event={"ID":"8ba2253d-168a-4979-a41e-fe1c923823e2","Type":"ContainerDied","Data":"5bf49aa88c8bad494c1651ffd78c1ec0ff8062738724260b5effca8d75714141"} Jul 29 16:08:16.985629 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:16.985561 2563 scope.go:117] "RemoveContainer" containerID="85a943131b55412a372680a1063572568981e1bfdba114707e3d7e99735092d9" Jul 29 16:08:16.994367 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:16.994347 2563 scope.go:117] "RemoveContainer" containerID="85a943131b55412a372680a1063572568981e1bfdba114707e3d7e99735092d9" Jul 29 16:08:16.995080 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:08:16.995056 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85a943131b55412a372680a1063572568981e1bfdba114707e3d7e99735092d9\": container with ID starting with 85a943131b55412a372680a1063572568981e1bfdba114707e3d7e99735092d9 not found: ID does not exist" containerID="85a943131b55412a372680a1063572568981e1bfdba114707e3d7e99735092d9" Jul 29 16:08:16.995163 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:16.995091 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85a943131b55412a372680a1063572568981e1bfdba114707e3d7e99735092d9"} err="failed to get container status \"85a943131b55412a372680a1063572568981e1bfdba114707e3d7e99735092d9\": rpc error: code = NotFound desc = could not find container \"85a943131b55412a372680a1063572568981e1bfdba114707e3d7e99735092d9\": container with ID starting with 85a943131b55412a372680a1063572568981e1bfdba114707e3d7e99735092d9 not found: ID does not exist" Jul 29 16:08:17.009631 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:17.009605 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d888846d4-q5scc"] Jul 29 16:08:17.013614 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:17.013594 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d888846d4-q5scc"] Jul 29 16:08:17.543655 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:17.543625 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ba2253d-168a-4979-a41e-fe1c923823e2" path="/var/lib/kubelet/pods/8ba2253d-168a-4979-a41e-fe1c923823e2/volumes" Jul 29 16:08:26.994989 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:26.994943 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6789f44b6d-8wl5j" podUID="581d7b81-d058-476e-b2a6-f2f4c55624f6" containerName="console" containerID="cri-o://3fa39c2b76ceedf9bda677a131c3c16024076f39891d5ba2426a749adb8bebfb" gracePeriod=15 Jul 29 16:08:27.223466 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:27.223444 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6789f44b6d-8wl5j" Jul 29 16:08:27.286415 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:27.286358 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/581d7b81-d058-476e-b2a6-f2f4c55624f6-console-config\") pod \"581d7b81-d058-476e-b2a6-f2f4c55624f6\" (UID: \"581d7b81-d058-476e-b2a6-f2f4c55624f6\") " Jul 29 16:08:27.286537 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:27.286418 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/581d7b81-d058-476e-b2a6-f2f4c55624f6-console-serving-cert\") pod \"581d7b81-d058-476e-b2a6-f2f4c55624f6\" (UID: \"581d7b81-d058-476e-b2a6-f2f4c55624f6\") " Jul 29 16:08:27.286537 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:27.286449 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qw4l9\" (UniqueName: \"kubernetes.io/projected/581d7b81-d058-476e-b2a6-f2f4c55624f6-kube-api-access-qw4l9\") pod \"581d7b81-d058-476e-b2a6-f2f4c55624f6\" (UID: \"581d7b81-d058-476e-b2a6-f2f4c55624f6\") " Jul 29 16:08:27.286537 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:27.286474 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/581d7b81-d058-476e-b2a6-f2f4c55624f6-console-oauth-config\") pod \"581d7b81-d058-476e-b2a6-f2f4c55624f6\" (UID: \"581d7b81-d058-476e-b2a6-f2f4c55624f6\") " Jul 29 16:08:27.286537 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:27.286522 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/581d7b81-d058-476e-b2a6-f2f4c55624f6-oauth-serving-cert\") pod \"581d7b81-d058-476e-b2a6-f2f4c55624f6\" (UID: \"581d7b81-d058-476e-b2a6-f2f4c55624f6\") " Jul 29 16:08:27.286726 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:27.286549 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/581d7b81-d058-476e-b2a6-f2f4c55624f6-service-ca\") pod \"581d7b81-d058-476e-b2a6-f2f4c55624f6\" (UID: \"581d7b81-d058-476e-b2a6-f2f4c55624f6\") " Jul 29 16:08:27.286817 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:27.286785 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/581d7b81-d058-476e-b2a6-f2f4c55624f6-console-config" (OuterVolumeSpecName: "console-config") pod "581d7b81-d058-476e-b2a6-f2f4c55624f6" (UID: "581d7b81-d058-476e-b2a6-f2f4c55624f6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:08:27.287039 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:27.287010 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/581d7b81-d058-476e-b2a6-f2f4c55624f6-service-ca" (OuterVolumeSpecName: "service-ca") pod "581d7b81-d058-476e-b2a6-f2f4c55624f6" (UID: "581d7b81-d058-476e-b2a6-f2f4c55624f6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:08:27.287157 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:27.287049 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/581d7b81-d058-476e-b2a6-f2f4c55624f6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "581d7b81-d058-476e-b2a6-f2f4c55624f6" (UID: "581d7b81-d058-476e-b2a6-f2f4c55624f6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:08:27.288870 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:27.288846 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/581d7b81-d058-476e-b2a6-f2f4c55624f6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "581d7b81-d058-476e-b2a6-f2f4c55624f6" (UID: "581d7b81-d058-476e-b2a6-f2f4c55624f6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:08:27.288870 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:27.288848 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/581d7b81-d058-476e-b2a6-f2f4c55624f6-kube-api-access-qw4l9" (OuterVolumeSpecName: "kube-api-access-qw4l9") pod "581d7b81-d058-476e-b2a6-f2f4c55624f6" (UID: "581d7b81-d058-476e-b2a6-f2f4c55624f6"). InnerVolumeSpecName "kube-api-access-qw4l9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:08:27.289029 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:27.288903 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/581d7b81-d058-476e-b2a6-f2f4c55624f6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "581d7b81-d058-476e-b2a6-f2f4c55624f6" (UID: "581d7b81-d058-476e-b2a6-f2f4c55624f6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:08:27.387380 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:27.387358 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/581d7b81-d058-476e-b2a6-f2f4c55624f6-console-config\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:08:27.387380 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:27.387377 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/581d7b81-d058-476e-b2a6-f2f4c55624f6-console-serving-cert\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:08:27.387499 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:27.387386 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qw4l9\" (UniqueName: \"kubernetes.io/projected/581d7b81-d058-476e-b2a6-f2f4c55624f6-kube-api-access-qw4l9\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:08:27.387499 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:27.387394 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/581d7b81-d058-476e-b2a6-f2f4c55624f6-console-oauth-config\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:08:27.387499 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:27.387403 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/581d7b81-d058-476e-b2a6-f2f4c55624f6-oauth-serving-cert\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:08:27.387499 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:27.387411 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/581d7b81-d058-476e-b2a6-f2f4c55624f6-service-ca\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:08:27.910399 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:27.910322 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pxg62" Jul 29 16:08:28.026674 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:28.026637 2563 generic.go:356] "Generic (PLEG): container finished" podID="581d7b81-d058-476e-b2a6-f2f4c55624f6" containerID="3fa39c2b76ceedf9bda677a131c3c16024076f39891d5ba2426a749adb8bebfb" exitCode=0 Jul 29 16:08:28.027053 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:28.026686 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6789f44b6d-8wl5j" Jul 29 16:08:28.027053 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:28.026695 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6789f44b6d-8wl5j" event={"ID":"581d7b81-d058-476e-b2a6-f2f4c55624f6","Type":"ContainerDied","Data":"3fa39c2b76ceedf9bda677a131c3c16024076f39891d5ba2426a749adb8bebfb"} Jul 29 16:08:28.027053 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:28.026767 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6789f44b6d-8wl5j" event={"ID":"581d7b81-d058-476e-b2a6-f2f4c55624f6","Type":"ContainerDied","Data":"708faf812d904dfd74340249a0b54a49bce59b35cc0777ad4612176de27439a8"} Jul 29 16:08:28.027053 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:28.026774 2563 scope.go:117] "RemoveContainer" containerID="3fa39c2b76ceedf9bda677a131c3c16024076f39891d5ba2426a749adb8bebfb" Jul 29 16:08:28.034650 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:28.034631 2563 scope.go:117] "RemoveContainer" containerID="3fa39c2b76ceedf9bda677a131c3c16024076f39891d5ba2426a749adb8bebfb" Jul 29 16:08:28.034914 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:08:28.034892 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fa39c2b76ceedf9bda677a131c3c16024076f39891d5ba2426a749adb8bebfb\": container with ID starting with 3fa39c2b76ceedf9bda677a131c3c16024076f39891d5ba2426a749adb8bebfb not found: ID does not exist" containerID="3fa39c2b76ceedf9bda677a131c3c16024076f39891d5ba2426a749adb8bebfb" Jul 29 16:08:28.034973 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:28.034925 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fa39c2b76ceedf9bda677a131c3c16024076f39891d5ba2426a749adb8bebfb"} err="failed to get container status \"3fa39c2b76ceedf9bda677a131c3c16024076f39891d5ba2426a749adb8bebfb\": rpc error: code = NotFound desc = could not find container \"3fa39c2b76ceedf9bda677a131c3c16024076f39891d5ba2426a749adb8bebfb\": container with ID starting with 3fa39c2b76ceedf9bda677a131c3c16024076f39891d5ba2426a749adb8bebfb not found: ID does not exist" Jul 29 16:08:28.044115 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:28.044094 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6789f44b6d-8wl5j"] Jul 29 16:08:28.047651 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:28.047631 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6789f44b6d-8wl5j"] Jul 29 16:08:29.541930 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:29.541902 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="581d7b81-d058-476e-b2a6-f2f4c55624f6" path="/var/lib/kubelet/pods/581d7b81-d058-476e-b2a6-f2f4c55624f6/volumes" Jul 29 16:08:46.254913 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:46.254878 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:08:46.274637 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:46.274615 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:08:47.123785 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:47.123761 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:08:59.762377 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:59.762341 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c5968c487-9sbqg"] Jul 29 16:08:59.762952 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:59.762632 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03829d99-4712-4182-8c21-f596670dcd87" containerName="console" Jul 29 16:08:59.762952 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:59.762644 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="03829d99-4712-4182-8c21-f596670dcd87" containerName="console" Jul 29 16:08:59.762952 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:59.762661 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="581d7b81-d058-476e-b2a6-f2f4c55624f6" containerName="console" Jul 29 16:08:59.762952 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:59.762666 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="581d7b81-d058-476e-b2a6-f2f4c55624f6" containerName="console" Jul 29 16:08:59.762952 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:59.762675 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ba2253d-168a-4979-a41e-fe1c923823e2" containerName="console" Jul 29 16:08:59.762952 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:59.762679 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ba2253d-168a-4979-a41e-fe1c923823e2" containerName="console" Jul 29 16:08:59.762952 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:59.762718 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="03829d99-4712-4182-8c21-f596670dcd87" containerName="console" Jul 29 16:08:59.762952 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:59.762727 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ba2253d-168a-4979-a41e-fe1c923823e2" containerName="console" Jul 29 16:08:59.762952 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:59.762732 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="581d7b81-d058-476e-b2a6-f2f4c55624f6" containerName="console" Jul 29 16:08:59.765877 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:59.765857 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c5968c487-9sbqg" Jul 29 16:08:59.778456 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:59.778436 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c5968c487-9sbqg"] Jul 29 16:08:59.934657 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:59.934627 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da16b706-55bc-4379-855b-6abdd6c3c4b4-oauth-serving-cert\") pod \"console-6c5968c487-9sbqg\" (UID: \"da16b706-55bc-4379-855b-6abdd6c3c4b4\") " pod="openshift-console/console-6c5968c487-9sbqg" Jul 29 16:08:59.934827 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:59.934668 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtzrt\" (UniqueName: \"kubernetes.io/projected/da16b706-55bc-4379-855b-6abdd6c3c4b4-kube-api-access-xtzrt\") pod \"console-6c5968c487-9sbqg\" (UID: \"da16b706-55bc-4379-855b-6abdd6c3c4b4\") " pod="openshift-console/console-6c5968c487-9sbqg" Jul 29 16:08:59.934827 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:59.934696 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da16b706-55bc-4379-855b-6abdd6c3c4b4-console-oauth-config\") pod \"console-6c5968c487-9sbqg\" (UID: \"da16b706-55bc-4379-855b-6abdd6c3c4b4\") " pod="openshift-console/console-6c5968c487-9sbqg" Jul 29 16:08:59.934827 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:59.934762 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da16b706-55bc-4379-855b-6abdd6c3c4b4-trusted-ca-bundle\") pod \"console-6c5968c487-9sbqg\" (UID: \"da16b706-55bc-4379-855b-6abdd6c3c4b4\") " pod="openshift-console/console-6c5968c487-9sbqg" Jul 29 16:08:59.934827 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:59.934810 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da16b706-55bc-4379-855b-6abdd6c3c4b4-service-ca\") pod \"console-6c5968c487-9sbqg\" (UID: \"da16b706-55bc-4379-855b-6abdd6c3c4b4\") " pod="openshift-console/console-6c5968c487-9sbqg" Jul 29 16:08:59.934981 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:59.934841 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da16b706-55bc-4379-855b-6abdd6c3c4b4-console-serving-cert\") pod \"console-6c5968c487-9sbqg\" (UID: \"da16b706-55bc-4379-855b-6abdd6c3c4b4\") " pod="openshift-console/console-6c5968c487-9sbqg" Jul 29 16:08:59.934981 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:08:59.934904 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da16b706-55bc-4379-855b-6abdd6c3c4b4-console-config\") pod \"console-6c5968c487-9sbqg\" (UID: \"da16b706-55bc-4379-855b-6abdd6c3c4b4\") " pod="openshift-console/console-6c5968c487-9sbqg" Jul 29 16:09:00.036024 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:00.035971 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da16b706-55bc-4379-855b-6abdd6c3c4b4-console-config\") pod \"console-6c5968c487-9sbqg\" (UID: \"da16b706-55bc-4379-855b-6abdd6c3c4b4\") " pod="openshift-console/console-6c5968c487-9sbqg" Jul 29 16:09:00.036024 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:00.036002 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da16b706-55bc-4379-855b-6abdd6c3c4b4-oauth-serving-cert\") pod \"console-6c5968c487-9sbqg\" (UID: \"da16b706-55bc-4379-855b-6abdd6c3c4b4\") " pod="openshift-console/console-6c5968c487-9sbqg" Jul 29 16:09:00.036024 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:00.036022 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtzrt\" (UniqueName: \"kubernetes.io/projected/da16b706-55bc-4379-855b-6abdd6c3c4b4-kube-api-access-xtzrt\") pod \"console-6c5968c487-9sbqg\" (UID: \"da16b706-55bc-4379-855b-6abdd6c3c4b4\") " pod="openshift-console/console-6c5968c487-9sbqg" Jul 29 16:09:00.036230 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:00.036038 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da16b706-55bc-4379-855b-6abdd6c3c4b4-console-oauth-config\") pod \"console-6c5968c487-9sbqg\" (UID: \"da16b706-55bc-4379-855b-6abdd6c3c4b4\") " pod="openshift-console/console-6c5968c487-9sbqg" Jul 29 16:09:00.036230 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:00.036052 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da16b706-55bc-4379-855b-6abdd6c3c4b4-trusted-ca-bundle\") pod \"console-6c5968c487-9sbqg\" (UID: \"da16b706-55bc-4379-855b-6abdd6c3c4b4\") " pod="openshift-console/console-6c5968c487-9sbqg" Jul 29 16:09:00.036230 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:00.036079 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da16b706-55bc-4379-855b-6abdd6c3c4b4-service-ca\") pod \"console-6c5968c487-9sbqg\" (UID: \"da16b706-55bc-4379-855b-6abdd6c3c4b4\") " pod="openshift-console/console-6c5968c487-9sbqg" Jul 29 16:09:00.036230 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:00.036109 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da16b706-55bc-4379-855b-6abdd6c3c4b4-console-serving-cert\") pod \"console-6c5968c487-9sbqg\" (UID: \"da16b706-55bc-4379-855b-6abdd6c3c4b4\") " pod="openshift-console/console-6c5968c487-9sbqg" Jul 29 16:09:00.036807 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:00.036777 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da16b706-55bc-4379-855b-6abdd6c3c4b4-console-config\") pod \"console-6c5968c487-9sbqg\" (UID: \"da16b706-55bc-4379-855b-6abdd6c3c4b4\") " pod="openshift-console/console-6c5968c487-9sbqg" Jul 29 16:09:00.036913 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:00.036792 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da16b706-55bc-4379-855b-6abdd6c3c4b4-service-ca\") pod \"console-6c5968c487-9sbqg\" (UID: \"da16b706-55bc-4379-855b-6abdd6c3c4b4\") " pod="openshift-console/console-6c5968c487-9sbqg" Jul 29 16:09:00.036999 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:00.036979 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da16b706-55bc-4379-855b-6abdd6c3c4b4-oauth-serving-cert\") pod \"console-6c5968c487-9sbqg\" (UID: \"da16b706-55bc-4379-855b-6abdd6c3c4b4\") " pod="openshift-console/console-6c5968c487-9sbqg" Jul 29 16:09:00.037035 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:00.036984 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da16b706-55bc-4379-855b-6abdd6c3c4b4-trusted-ca-bundle\") pod \"console-6c5968c487-9sbqg\" (UID: \"da16b706-55bc-4379-855b-6abdd6c3c4b4\") " pod="openshift-console/console-6c5968c487-9sbqg" Jul 29 16:09:00.038581 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:00.038558 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da16b706-55bc-4379-855b-6abdd6c3c4b4-console-serving-cert\") pod \"console-6c5968c487-9sbqg\" (UID: \"da16b706-55bc-4379-855b-6abdd6c3c4b4\") " pod="openshift-console/console-6c5968c487-9sbqg" Jul 29 16:09:00.038673 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:00.038657 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da16b706-55bc-4379-855b-6abdd6c3c4b4-console-oauth-config\") pod \"console-6c5968c487-9sbqg\" (UID: \"da16b706-55bc-4379-855b-6abdd6c3c4b4\") " pod="openshift-console/console-6c5968c487-9sbqg" Jul 29 16:09:00.061715 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:00.061693 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtzrt\" (UniqueName: \"kubernetes.io/projected/da16b706-55bc-4379-855b-6abdd6c3c4b4-kube-api-access-xtzrt\") pod \"console-6c5968c487-9sbqg\" (UID: \"da16b706-55bc-4379-855b-6abdd6c3c4b4\") " pod="openshift-console/console-6c5968c487-9sbqg" Jul 29 16:09:00.074595 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:00.074579 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c5968c487-9sbqg" Jul 29 16:09:00.125213 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:00.123761 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 16:09:00.125213 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:00.124173 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerName="alertmanager" containerID="cri-o://0c91fd6198022917ae6f813ffcbc3006a3d4663a0e523bf76626fff76a764065" gracePeriod=120 Jul 29 16:09:00.125213 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:00.124579 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerName="prom-label-proxy" containerID="cri-o://efca421b08d6e8c60eeca0c211097988f80ee5460b7b8e0b28d467cd101cc7a6" gracePeriod=120 Jul 29 16:09:00.125213 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:00.124704 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerName="kube-rbac-proxy-metric" containerID="cri-o://6acf0e92ff2f8e563f66a6dd20864fdfcf011ca3ab15ca1beeed700c4f8bf3bc" gracePeriod=120 Jul 29 16:09:00.125213 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:00.124728 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerName="kube-rbac-proxy-web" containerID="cri-o://a78a967b40b98e36215cb846d4d0fa5709669cac9dcefb02960af5e353a594ac" gracePeriod=120 Jul 29 16:09:00.125213 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:00.124822 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerName="config-reloader" containerID="cri-o://0032ce5da50b285c12b77912901e17654b3107c9b2efc29f4cf1f26bb02f70ba" gracePeriod=120 Jul 29 16:09:00.125213 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:00.124841 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerName="kube-rbac-proxy" containerID="cri-o://39882be35906531f6365bfc9af7fb3f53a68e61ec68a305304a23b3db1d23bac" gracePeriod=120 Jul 29 16:09:00.205513 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:00.205489 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c5968c487-9sbqg"] Jul 29 16:09:00.210011 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:09:00.209981 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda16b706_55bc_4379_855b_6abdd6c3c4b4.slice/crio-7acb94e88ee69c084c6da2f3a7c194e3b93edbd4870dc9cd82651ffa83346581 WatchSource:0}: Error finding container 7acb94e88ee69c084c6da2f3a7c194e3b93edbd4870dc9cd82651ffa83346581: Status 404 returned error can't find the container with id 7acb94e88ee69c084c6da2f3a7c194e3b93edbd4870dc9cd82651ffa83346581 Jul 29 16:09:01.157633 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.157598 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c5968c487-9sbqg" event={"ID":"da16b706-55bc-4379-855b-6abdd6c3c4b4","Type":"ContainerStarted","Data":"851f9f3a2c76935b15ca4f5ecb14e1bbb37ec86b5799eab6306704454b3d6298"} Jul 29 16:09:01.158023 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.157651 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c5968c487-9sbqg" event={"ID":"da16b706-55bc-4379-855b-6abdd6c3c4b4","Type":"ContainerStarted","Data":"7acb94e88ee69c084c6da2f3a7c194e3b93edbd4870dc9cd82651ffa83346581"} Jul 29 16:09:01.161121 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.161097 2563 generic.go:356] "Generic (PLEG): container finished" podID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerID="efca421b08d6e8c60eeca0c211097988f80ee5460b7b8e0b28d467cd101cc7a6" exitCode=0 Jul 29 16:09:01.161121 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.161119 2563 generic.go:356] "Generic (PLEG): container finished" podID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerID="39882be35906531f6365bfc9af7fb3f53a68e61ec68a305304a23b3db1d23bac" exitCode=0 Jul 29 16:09:01.161121 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.161125 2563 generic.go:356] "Generic (PLEG): container finished" podID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerID="0032ce5da50b285c12b77912901e17654b3107c9b2efc29f4cf1f26bb02f70ba" exitCode=0 Jul 29 16:09:01.161304 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.161131 2563 generic.go:356] "Generic (PLEG): container finished" podID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerID="0c91fd6198022917ae6f813ffcbc3006a3d4663a0e523bf76626fff76a764065" exitCode=0 Jul 29 16:09:01.161304 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.161168 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3b7e45-cde4-4a88-b755-547d366cd90e","Type":"ContainerDied","Data":"efca421b08d6e8c60eeca0c211097988f80ee5460b7b8e0b28d467cd101cc7a6"} Jul 29 16:09:01.161304 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.161223 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3b7e45-cde4-4a88-b755-547d366cd90e","Type":"ContainerDied","Data":"39882be35906531f6365bfc9af7fb3f53a68e61ec68a305304a23b3db1d23bac"} Jul 29 16:09:01.161304 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.161250 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3b7e45-cde4-4a88-b755-547d366cd90e","Type":"ContainerDied","Data":"0032ce5da50b285c12b77912901e17654b3107c9b2efc29f4cf1f26bb02f70ba"} Jul 29 16:09:01.161304 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.161272 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3b7e45-cde4-4a88-b755-547d366cd90e","Type":"ContainerDied","Data":"0c91fd6198022917ae6f813ffcbc3006a3d4663a0e523bf76626fff76a764065"} Jul 29 16:09:01.179080 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.179042 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c5968c487-9sbqg" podStartSLOduration=2.179024417 podStartE2EDuration="2.179024417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:08:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:09:01.178099636 +0000 UTC m=+138.195920884" watchObservedRunningTime="2026-07-29 16:09:01.179024417 +0000 UTC m=+138.196845723" Jul 29 16:09:01.386126 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.386103 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:09:01.549082 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.549017 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-cluster-tls-config\") pod \"ca3b7e45-cde4-4a88-b755-547d366cd90e\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " Jul 29 16:09:01.549082 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.549048 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-web-config\") pod \"ca3b7e45-cde4-4a88-b755-547d366cd90e\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " Jul 29 16:09:01.549082 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.549072 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-config-volume\") pod \"ca3b7e45-cde4-4a88-b755-547d366cd90e\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " Jul 29 16:09:01.549301 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.549113 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca3b7e45-cde4-4a88-b755-547d366cd90e-alertmanager-main-db\") pod \"ca3b7e45-cde4-4a88-b755-547d366cd90e\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " Jul 29 16:09:01.549301 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.549136 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-secret-alertmanager-main-tls\") pod \"ca3b7e45-cde4-4a88-b755-547d366cd90e\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " Jul 29 16:09:01.549301 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.549167 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-secret-alertmanager-kube-rbac-proxy\") pod \"ca3b7e45-cde4-4a88-b755-547d366cd90e\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " Jul 29 16:09:01.549301 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.549254 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3b7e45-cde4-4a88-b755-547d366cd90e-alertmanager-trusted-ca-bundle\") pod \"ca3b7e45-cde4-4a88-b755-547d366cd90e\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " Jul 29 16:09:01.549507 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.549316 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca3b7e45-cde4-4a88-b755-547d366cd90e-config-out\") pod \"ca3b7e45-cde4-4a88-b755-547d366cd90e\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " Jul 29 16:09:01.549507 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.549354 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ca3b7e45-cde4-4a88-b755-547d366cd90e\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " Jul 29 16:09:01.549507 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.549388 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca3b7e45-cde4-4a88-b755-547d366cd90e-tls-assets\") pod \"ca3b7e45-cde4-4a88-b755-547d366cd90e\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " Jul 29 16:09:01.549507 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.549462 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-secret-alertmanager-kube-rbac-proxy-web\") pod \"ca3b7e45-cde4-4a88-b755-547d366cd90e\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " Jul 29 16:09:01.549507 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.549497 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5brbd\" (UniqueName: \"kubernetes.io/projected/ca3b7e45-cde4-4a88-b755-547d366cd90e-kube-api-access-5brbd\") pod \"ca3b7e45-cde4-4a88-b755-547d366cd90e\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " Jul 29 16:09:01.549725 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.549526 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca3b7e45-cde4-4a88-b755-547d366cd90e-metrics-client-ca\") pod \"ca3b7e45-cde4-4a88-b755-547d366cd90e\" (UID: \"ca3b7e45-cde4-4a88-b755-547d366cd90e\") " Jul 29 16:09:01.549725 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.549509 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca3b7e45-cde4-4a88-b755-547d366cd90e-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ca3b7e45-cde4-4a88-b755-547d366cd90e" (UID: "ca3b7e45-cde4-4a88-b755-547d366cd90e"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:09:01.549725 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.549683 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca3b7e45-cde4-4a88-b755-547d366cd90e-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ca3b7e45-cde4-4a88-b755-547d366cd90e" (UID: "ca3b7e45-cde4-4a88-b755-547d366cd90e"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:09:01.549920 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.549790 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca3b7e45-cde4-4a88-b755-547d366cd90e-alertmanager-main-db\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:01.549920 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.549810 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3b7e45-cde4-4a88-b755-547d366cd90e-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:01.550552 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.550356 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca3b7e45-cde4-4a88-b755-547d366cd90e-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ca3b7e45-cde4-4a88-b755-547d366cd90e" (UID: "ca3b7e45-cde4-4a88-b755-547d366cd90e"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:09:01.552731 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.552688 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ca3b7e45-cde4-4a88-b755-547d366cd90e" (UID: "ca3b7e45-cde4-4a88-b755-547d366cd90e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:09:01.552933 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.552902 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-config-volume" (OuterVolumeSpecName: "config-volume") pod "ca3b7e45-cde4-4a88-b755-547d366cd90e" (UID: "ca3b7e45-cde4-4a88-b755-547d366cd90e"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:09:01.553095 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.553073 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca3b7e45-cde4-4a88-b755-547d366cd90e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ca3b7e45-cde4-4a88-b755-547d366cd90e" (UID: "ca3b7e45-cde4-4a88-b755-547d366cd90e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:09:01.553222 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.553180 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ca3b7e45-cde4-4a88-b755-547d366cd90e" (UID: "ca3b7e45-cde4-4a88-b755-547d366cd90e"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:09:01.553290 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.553220 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca3b7e45-cde4-4a88-b755-547d366cd90e-kube-api-access-5brbd" (OuterVolumeSpecName: "kube-api-access-5brbd") pod "ca3b7e45-cde4-4a88-b755-547d366cd90e" (UID: "ca3b7e45-cde4-4a88-b755-547d366cd90e"). InnerVolumeSpecName "kube-api-access-5brbd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:09:01.553338 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.553318 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ca3b7e45-cde4-4a88-b755-547d366cd90e" (UID: "ca3b7e45-cde4-4a88-b755-547d366cd90e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:09:01.553923 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.553905 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ca3b7e45-cde4-4a88-b755-547d366cd90e" (UID: "ca3b7e45-cde4-4a88-b755-547d366cd90e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:09:01.554205 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.554176 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca3b7e45-cde4-4a88-b755-547d366cd90e-config-out" (OuterVolumeSpecName: "config-out") pod "ca3b7e45-cde4-4a88-b755-547d366cd90e" (UID: "ca3b7e45-cde4-4a88-b755-547d366cd90e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:09:01.556913 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.556891 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ca3b7e45-cde4-4a88-b755-547d366cd90e" (UID: "ca3b7e45-cde4-4a88-b755-547d366cd90e"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:09:01.562628 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.562606 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-web-config" (OuterVolumeSpecName: "web-config") pod "ca3b7e45-cde4-4a88-b755-547d366cd90e" (UID: "ca3b7e45-cde4-4a88-b755-547d366cd90e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:09:01.650478 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.650456 2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-config-volume\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:01.650625 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.650479 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-secret-alertmanager-main-tls\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:01.650625 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.650494 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:01.650625 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.650507 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca3b7e45-cde4-4a88-b755-547d366cd90e-config-out\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:01.650625 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.650519 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:01.650625 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.650532 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca3b7e45-cde4-4a88-b755-547d366cd90e-tls-assets\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:01.650625 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.650545 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:01.650625 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.650559 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5brbd\" (UniqueName: \"kubernetes.io/projected/ca3b7e45-cde4-4a88-b755-547d366cd90e-kube-api-access-5brbd\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:01.650625 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.650572 2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca3b7e45-cde4-4a88-b755-547d366cd90e-metrics-client-ca\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:01.650625 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.650585 2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-cluster-tls-config\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:01.650625 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:01.650598 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca3b7e45-cde4-4a88-b755-547d366cd90e-web-config\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:02.167788 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.167757 2563 generic.go:356] "Generic (PLEG): container finished" podID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerID="6acf0e92ff2f8e563f66a6dd20864fdfcf011ca3ab15ca1beeed700c4f8bf3bc" exitCode=0 Jul 29 16:09:02.167788 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.167780 2563 generic.go:356] "Generic (PLEG): container finished" podID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerID="a78a967b40b98e36215cb846d4d0fa5709669cac9dcefb02960af5e353a594ac" exitCode=0 Jul 29 16:09:02.168251 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.167841 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3b7e45-cde4-4a88-b755-547d366cd90e","Type":"ContainerDied","Data":"6acf0e92ff2f8e563f66a6dd20864fdfcf011ca3ab15ca1beeed700c4f8bf3bc"} Jul 29 16:09:02.168251 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.167872 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:09:02.168251 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.167920 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3b7e45-cde4-4a88-b755-547d366cd90e","Type":"ContainerDied","Data":"a78a967b40b98e36215cb846d4d0fa5709669cac9dcefb02960af5e353a594ac"} Jul 29 16:09:02.168251 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.167948 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3b7e45-cde4-4a88-b755-547d366cd90e","Type":"ContainerDied","Data":"1ddd04b06bb2b666d1f03f779340a8e64ce61c413a123b4f1696611f19626456"} Jul 29 16:09:02.168251 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.167987 2563 scope.go:117] "RemoveContainer" containerID="efca421b08d6e8c60eeca0c211097988f80ee5460b7b8e0b28d467cd101cc7a6" Jul 29 16:09:02.175250 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.175232 2563 scope.go:117] "RemoveContainer" containerID="6acf0e92ff2f8e563f66a6dd20864fdfcf011ca3ab15ca1beeed700c4f8bf3bc" Jul 29 16:09:02.182440 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.182422 2563 scope.go:117] "RemoveContainer" containerID="39882be35906531f6365bfc9af7fb3f53a68e61ec68a305304a23b3db1d23bac" Jul 29 16:09:02.188803 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.188787 2563 scope.go:117] "RemoveContainer" containerID="a78a967b40b98e36215cb846d4d0fa5709669cac9dcefb02960af5e353a594ac" Jul 29 16:09:02.191401 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.191381 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 16:09:02.195164 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.195146 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 16:09:02.196737 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.196722 2563 scope.go:117] "RemoveContainer" containerID="0032ce5da50b285c12b77912901e17654b3107c9b2efc29f4cf1f26bb02f70ba" Jul 29 16:09:02.203233 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.203214 2563 scope.go:117] "RemoveContainer" containerID="0c91fd6198022917ae6f813ffcbc3006a3d4663a0e523bf76626fff76a764065" Jul 29 16:09:02.209875 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.209862 2563 scope.go:117] "RemoveContainer" containerID="293a5e516e91c4f35dd7f3bb208bfa745940c3877e09aafd908d38ccad0c9bf3" Jul 29 16:09:02.216610 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.216595 2563 scope.go:117] "RemoveContainer" containerID="efca421b08d6e8c60eeca0c211097988f80ee5460b7b8e0b28d467cd101cc7a6" Jul 29 16:09:02.216978 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:09:02.216960 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efca421b08d6e8c60eeca0c211097988f80ee5460b7b8e0b28d467cd101cc7a6\": container with ID starting with efca421b08d6e8c60eeca0c211097988f80ee5460b7b8e0b28d467cd101cc7a6 not found: ID does not exist" containerID="efca421b08d6e8c60eeca0c211097988f80ee5460b7b8e0b28d467cd101cc7a6" Jul 29 16:09:02.217042 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.216985 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efca421b08d6e8c60eeca0c211097988f80ee5460b7b8e0b28d467cd101cc7a6"} err="failed to get container status \"efca421b08d6e8c60eeca0c211097988f80ee5460b7b8e0b28d467cd101cc7a6\": rpc error: code = NotFound desc = could not find container \"efca421b08d6e8c60eeca0c211097988f80ee5460b7b8e0b28d467cd101cc7a6\": container with ID starting with efca421b08d6e8c60eeca0c211097988f80ee5460b7b8e0b28d467cd101cc7a6 not found: ID does not exist" Jul 29 16:09:02.217042 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.217002 2563 scope.go:117] "RemoveContainer" containerID="6acf0e92ff2f8e563f66a6dd20864fdfcf011ca3ab15ca1beeed700c4f8bf3bc" Jul 29 16:09:02.217254 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:09:02.217238 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6acf0e92ff2f8e563f66a6dd20864fdfcf011ca3ab15ca1beeed700c4f8bf3bc\": container with ID starting with 6acf0e92ff2f8e563f66a6dd20864fdfcf011ca3ab15ca1beeed700c4f8bf3bc not found: ID does not exist" containerID="6acf0e92ff2f8e563f66a6dd20864fdfcf011ca3ab15ca1beeed700c4f8bf3bc" Jul 29 16:09:02.217294 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.217259 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6acf0e92ff2f8e563f66a6dd20864fdfcf011ca3ab15ca1beeed700c4f8bf3bc"} err="failed to get container status \"6acf0e92ff2f8e563f66a6dd20864fdfcf011ca3ab15ca1beeed700c4f8bf3bc\": rpc error: code = NotFound desc = could not find container \"6acf0e92ff2f8e563f66a6dd20864fdfcf011ca3ab15ca1beeed700c4f8bf3bc\": container with ID starting with 6acf0e92ff2f8e563f66a6dd20864fdfcf011ca3ab15ca1beeed700c4f8bf3bc not found: ID does not exist" Jul 29 16:09:02.217294 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.217273 2563 scope.go:117] "RemoveContainer" containerID="39882be35906531f6365bfc9af7fb3f53a68e61ec68a305304a23b3db1d23bac" Jul 29 16:09:02.217486 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:09:02.217469 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39882be35906531f6365bfc9af7fb3f53a68e61ec68a305304a23b3db1d23bac\": container with ID starting with 39882be35906531f6365bfc9af7fb3f53a68e61ec68a305304a23b3db1d23bac not found: ID does not exist" containerID="39882be35906531f6365bfc9af7fb3f53a68e61ec68a305304a23b3db1d23bac" Jul 29 16:09:02.217529 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.217490 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39882be35906531f6365bfc9af7fb3f53a68e61ec68a305304a23b3db1d23bac"} err="failed to get container status \"39882be35906531f6365bfc9af7fb3f53a68e61ec68a305304a23b3db1d23bac\": rpc error: code = NotFound desc = could not find container \"39882be35906531f6365bfc9af7fb3f53a68e61ec68a305304a23b3db1d23bac\": container with ID starting with 39882be35906531f6365bfc9af7fb3f53a68e61ec68a305304a23b3db1d23bac not found: ID does not exist" Jul 29 16:09:02.217529 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.217505 2563 scope.go:117] "RemoveContainer" containerID="a78a967b40b98e36215cb846d4d0fa5709669cac9dcefb02960af5e353a594ac" Jul 29 16:09:02.217720 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:09:02.217704 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a78a967b40b98e36215cb846d4d0fa5709669cac9dcefb02960af5e353a594ac\": container with ID starting with a78a967b40b98e36215cb846d4d0fa5709669cac9dcefb02960af5e353a594ac not found: ID does not exist" containerID="a78a967b40b98e36215cb846d4d0fa5709669cac9dcefb02960af5e353a594ac" Jul 29 16:09:02.217857 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.217724 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a78a967b40b98e36215cb846d4d0fa5709669cac9dcefb02960af5e353a594ac"} err="failed to get container status \"a78a967b40b98e36215cb846d4d0fa5709669cac9dcefb02960af5e353a594ac\": rpc error: code = NotFound desc = could not find container \"a78a967b40b98e36215cb846d4d0fa5709669cac9dcefb02960af5e353a594ac\": container with ID starting with a78a967b40b98e36215cb846d4d0fa5709669cac9dcefb02960af5e353a594ac not found: ID does not exist" Jul 29 16:09:02.217857 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.217739 2563 scope.go:117] "RemoveContainer" containerID="0032ce5da50b285c12b77912901e17654b3107c9b2efc29f4cf1f26bb02f70ba" Jul 29 16:09:02.218025 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:09:02.218010 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0032ce5da50b285c12b77912901e17654b3107c9b2efc29f4cf1f26bb02f70ba\": container with ID starting with 0032ce5da50b285c12b77912901e17654b3107c9b2efc29f4cf1f26bb02f70ba not found: ID does not exist" containerID="0032ce5da50b285c12b77912901e17654b3107c9b2efc29f4cf1f26bb02f70ba" Jul 29 16:09:02.218063 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.218028 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0032ce5da50b285c12b77912901e17654b3107c9b2efc29f4cf1f26bb02f70ba"} err="failed to get container status \"0032ce5da50b285c12b77912901e17654b3107c9b2efc29f4cf1f26bb02f70ba\": rpc error: code = NotFound desc = could not find container \"0032ce5da50b285c12b77912901e17654b3107c9b2efc29f4cf1f26bb02f70ba\": container with ID starting with 0032ce5da50b285c12b77912901e17654b3107c9b2efc29f4cf1f26bb02f70ba not found: ID does not exist" Jul 29 16:09:02.218063 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.218040 2563 scope.go:117] "RemoveContainer" containerID="0c91fd6198022917ae6f813ffcbc3006a3d4663a0e523bf76626fff76a764065" Jul 29 16:09:02.218229 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:09:02.218212 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c91fd6198022917ae6f813ffcbc3006a3d4663a0e523bf76626fff76a764065\": container with ID starting with 0c91fd6198022917ae6f813ffcbc3006a3d4663a0e523bf76626fff76a764065 not found: ID does not exist" containerID="0c91fd6198022917ae6f813ffcbc3006a3d4663a0e523bf76626fff76a764065" Jul 29 16:09:02.218286 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.218237 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c91fd6198022917ae6f813ffcbc3006a3d4663a0e523bf76626fff76a764065"} err="failed to get container status \"0c91fd6198022917ae6f813ffcbc3006a3d4663a0e523bf76626fff76a764065\": rpc error: code = NotFound desc = could not find container \"0c91fd6198022917ae6f813ffcbc3006a3d4663a0e523bf76626fff76a764065\": container with ID starting with 0c91fd6198022917ae6f813ffcbc3006a3d4663a0e523bf76626fff76a764065 not found: ID does not exist" Jul 29 16:09:02.218286 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.218259 2563 scope.go:117] "RemoveContainer" containerID="293a5e516e91c4f35dd7f3bb208bfa745940c3877e09aafd908d38ccad0c9bf3" Jul 29 16:09:02.218473 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:09:02.218457 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"293a5e516e91c4f35dd7f3bb208bfa745940c3877e09aafd908d38ccad0c9bf3\": container with ID starting with 293a5e516e91c4f35dd7f3bb208bfa745940c3877e09aafd908d38ccad0c9bf3 not found: ID does not exist" containerID="293a5e516e91c4f35dd7f3bb208bfa745940c3877e09aafd908d38ccad0c9bf3" Jul 29 16:09:02.218511 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.218477 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"293a5e516e91c4f35dd7f3bb208bfa745940c3877e09aafd908d38ccad0c9bf3"} err="failed to get container status \"293a5e516e91c4f35dd7f3bb208bfa745940c3877e09aafd908d38ccad0c9bf3\": rpc error: code = NotFound desc = could not find container \"293a5e516e91c4f35dd7f3bb208bfa745940c3877e09aafd908d38ccad0c9bf3\": container with ID starting with 293a5e516e91c4f35dd7f3bb208bfa745940c3877e09aafd908d38ccad0c9bf3 not found: ID does not exist" Jul 29 16:09:02.218511 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.218492 2563 scope.go:117] "RemoveContainer" containerID="efca421b08d6e8c60eeca0c211097988f80ee5460b7b8e0b28d467cd101cc7a6" Jul 29 16:09:02.218719 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.218700 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efca421b08d6e8c60eeca0c211097988f80ee5460b7b8e0b28d467cd101cc7a6"} err="failed to get container status \"efca421b08d6e8c60eeca0c211097988f80ee5460b7b8e0b28d467cd101cc7a6\": rpc error: code = NotFound desc = could not find container \"efca421b08d6e8c60eeca0c211097988f80ee5460b7b8e0b28d467cd101cc7a6\": container with ID starting with efca421b08d6e8c60eeca0c211097988f80ee5460b7b8e0b28d467cd101cc7a6 not found: ID does not exist" Jul 29 16:09:02.218789 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.218721 2563 scope.go:117] "RemoveContainer" containerID="6acf0e92ff2f8e563f66a6dd20864fdfcf011ca3ab15ca1beeed700c4f8bf3bc" Jul 29 16:09:02.218942 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.218924 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6acf0e92ff2f8e563f66a6dd20864fdfcf011ca3ab15ca1beeed700c4f8bf3bc"} err="failed to get container status \"6acf0e92ff2f8e563f66a6dd20864fdfcf011ca3ab15ca1beeed700c4f8bf3bc\": rpc error: code = NotFound desc = could not find container \"6acf0e92ff2f8e563f66a6dd20864fdfcf011ca3ab15ca1beeed700c4f8bf3bc\": container with ID starting with 6acf0e92ff2f8e563f66a6dd20864fdfcf011ca3ab15ca1beeed700c4f8bf3bc not found: ID does not exist" Jul 29 16:09:02.219012 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.218944 2563 scope.go:117] "RemoveContainer" containerID="39882be35906531f6365bfc9af7fb3f53a68e61ec68a305304a23b3db1d23bac" Jul 29 16:09:02.219173 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.219153 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39882be35906531f6365bfc9af7fb3f53a68e61ec68a305304a23b3db1d23bac"} err="failed to get container status \"39882be35906531f6365bfc9af7fb3f53a68e61ec68a305304a23b3db1d23bac\": rpc error: code = NotFound desc = could not find container \"39882be35906531f6365bfc9af7fb3f53a68e61ec68a305304a23b3db1d23bac\": container with ID starting with 39882be35906531f6365bfc9af7fb3f53a68e61ec68a305304a23b3db1d23bac not found: ID does not exist" Jul 29 16:09:02.219173 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.219172 2563 scope.go:117] "RemoveContainer" containerID="a78a967b40b98e36215cb846d4d0fa5709669cac9dcefb02960af5e353a594ac" Jul 29 16:09:02.219364 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.219347 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a78a967b40b98e36215cb846d4d0fa5709669cac9dcefb02960af5e353a594ac"} err="failed to get container status \"a78a967b40b98e36215cb846d4d0fa5709669cac9dcefb02960af5e353a594ac\": rpc error: code = NotFound desc = could not find container \"a78a967b40b98e36215cb846d4d0fa5709669cac9dcefb02960af5e353a594ac\": container with ID starting with a78a967b40b98e36215cb846d4d0fa5709669cac9dcefb02960af5e353a594ac not found: ID does not exist" Jul 29 16:09:02.219407 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.219365 2563 scope.go:117] "RemoveContainer" containerID="0032ce5da50b285c12b77912901e17654b3107c9b2efc29f4cf1f26bb02f70ba" Jul 29 16:09:02.219545 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.219530 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0032ce5da50b285c12b77912901e17654b3107c9b2efc29f4cf1f26bb02f70ba"} err="failed to get container status \"0032ce5da50b285c12b77912901e17654b3107c9b2efc29f4cf1f26bb02f70ba\": rpc error: code = NotFound desc = could not find container \"0032ce5da50b285c12b77912901e17654b3107c9b2efc29f4cf1f26bb02f70ba\": container with ID starting with 0032ce5da50b285c12b77912901e17654b3107c9b2efc29f4cf1f26bb02f70ba not found: ID does not exist" Jul 29 16:09:02.219588 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.219545 2563 scope.go:117] "RemoveContainer" containerID="0c91fd6198022917ae6f813ffcbc3006a3d4663a0e523bf76626fff76a764065" Jul 29 16:09:02.219722 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.219706 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c91fd6198022917ae6f813ffcbc3006a3d4663a0e523bf76626fff76a764065"} err="failed to get container status \"0c91fd6198022917ae6f813ffcbc3006a3d4663a0e523bf76626fff76a764065\": rpc error: code = NotFound desc = could not find container \"0c91fd6198022917ae6f813ffcbc3006a3d4663a0e523bf76626fff76a764065\": container with ID starting with 0c91fd6198022917ae6f813ffcbc3006a3d4663a0e523bf76626fff76a764065 not found: ID does not exist" Jul 29 16:09:02.219786 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.219722 2563 scope.go:117] "RemoveContainer" containerID="293a5e516e91c4f35dd7f3bb208bfa745940c3877e09aafd908d38ccad0c9bf3" Jul 29 16:09:02.219936 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:02.219919 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"293a5e516e91c4f35dd7f3bb208bfa745940c3877e09aafd908d38ccad0c9bf3"} err="failed to get container status \"293a5e516e91c4f35dd7f3bb208bfa745940c3877e09aafd908d38ccad0c9bf3\": rpc error: code = NotFound desc = could not find container \"293a5e516e91c4f35dd7f3bb208bfa745940c3877e09aafd908d38ccad0c9bf3\": container with ID starting with 293a5e516e91c4f35dd7f3bb208bfa745940c3877e09aafd908d38ccad0c9bf3 not found: ID does not exist" Jul 29 16:09:03.541331 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:03.541303 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca3b7e45-cde4-4a88-b755-547d366cd90e" path="/var/lib/kubelet/pods/ca3b7e45-cde4-4a88-b755-547d366cd90e/volumes" Jul 29 16:09:04.290198 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.290166 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 16:09:04.290949 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.290917 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerName="prometheus" containerID="cri-o://4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181" gracePeriod=600 Jul 29 16:09:04.291308 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.291278 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerName="kube-rbac-proxy" containerID="cri-o://100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339" gracePeriod=600 Jul 29 16:09:04.291504 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.291480 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerName="thanos-sidecar" containerID="cri-o://d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5" gracePeriod=600 Jul 29 16:09:04.291786 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.291480 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerName="kube-rbac-proxy-thanos" containerID="cri-o://efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8" gracePeriod=600 Jul 29 16:09:04.292285 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.291509 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerName="config-reloader" containerID="cri-o://ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007" gracePeriod=600 Jul 29 16:09:04.292459 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.291532 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerName="kube-rbac-proxy-web" containerID="cri-o://445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035" gracePeriod=600 Jul 29 16:09:04.526548 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.526521 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:04.675659 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.675585 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wc7j8\" (UniqueName: \"kubernetes.io/projected/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-kube-api-access-wc7j8\") pod \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " Jul 29 16:09:04.675659 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.675620 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-thanos-prometheus-http-client-file\") pod \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " Jul 29 16:09:04.675659 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.675643 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-configmap-serving-certs-ca-bundle\") pod \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " Jul 29 16:09:04.675659 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.675661 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-prometheus-k8s-tls\") pod \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " Jul 29 16:09:04.676287 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.675695 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-prometheus-k8s-db\") pod \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " Jul 29 16:09:04.676287 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.675717 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-grpc-tls\") pod \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " Jul 29 16:09:04.676287 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.675795 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-web-config\") pod \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " Jul 29 16:09:04.676287 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.675825 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-kube-rbac-proxy\") pod \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " Jul 29 16:09:04.676287 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.675843 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-config\") pod \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " Jul 29 16:09:04.676287 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.675869 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-tls-assets\") pod \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " Jul 29 16:09:04.676287 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.675907 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " Jul 29 16:09:04.676287 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.675946 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-prometheus-trusted-ca-bundle\") pod \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " Jul 29 16:09:04.676287 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.675967 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-metrics-client-certs\") pod \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " Jul 29 16:09:04.676287 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.675986 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-prometheus-k8s-rulefiles-0\") pod \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " Jul 29 16:09:04.676287 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.676004 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-configmap-kubelet-serving-ca-bundle\") pod \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " Jul 29 16:09:04.676287 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.676025 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-config-out\") pod \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " Jul 29 16:09:04.676287 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.676047 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-prometheus-k8s-rulefiles-1\") pod \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " Jul 29 16:09:04.676287 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.676065 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " Jul 29 16:09:04.676287 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.676077 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "cb8d4722-19e1-4303-a0f1-df5a7c778fc4" (UID: "cb8d4722-19e1-4303-a0f1-df5a7c778fc4"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:09:04.676287 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.676112 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-prometheus-k8s-rulefiles-2\") pod \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " Jul 29 16:09:04.676287 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.676138 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-configmap-metrics-client-ca\") pod \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\" (UID: \"cb8d4722-19e1-4303-a0f1-df5a7c778fc4\") " Jul 29 16:09:04.677112 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.676536 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:04.677112 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.676903 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "cb8d4722-19e1-4303-a0f1-df5a7c778fc4" (UID: "cb8d4722-19e1-4303-a0f1-df5a7c778fc4"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:09:04.677609 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.677542 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "cb8d4722-19e1-4303-a0f1-df5a7c778fc4" (UID: "cb8d4722-19e1-4303-a0f1-df5a7c778fc4"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:09:04.678399 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.678364 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "cb8d4722-19e1-4303-a0f1-df5a7c778fc4" (UID: "cb8d4722-19e1-4303-a0f1-df5a7c778fc4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:09:04.678699 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.678635 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "cb8d4722-19e1-4303-a0f1-df5a7c778fc4" (UID: "cb8d4722-19e1-4303-a0f1-df5a7c778fc4"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:09:04.679384 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.679148 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "cb8d4722-19e1-4303-a0f1-df5a7c778fc4" (UID: "cb8d4722-19e1-4303-a0f1-df5a7c778fc4"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:09:04.679384 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.679228 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "cb8d4722-19e1-4303-a0f1-df5a7c778fc4" (UID: "cb8d4722-19e1-4303-a0f1-df5a7c778fc4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:09:04.679384 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.679363 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-kube-api-access-wc7j8" (OuterVolumeSpecName: "kube-api-access-wc7j8") pod "cb8d4722-19e1-4303-a0f1-df5a7c778fc4" (UID: "cb8d4722-19e1-4303-a0f1-df5a7c778fc4"). InnerVolumeSpecName "kube-api-access-wc7j8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:09:04.679818 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.679388 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "cb8d4722-19e1-4303-a0f1-df5a7c778fc4" (UID: "cb8d4722-19e1-4303-a0f1-df5a7c778fc4"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:09:04.679818 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.679416 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "cb8d4722-19e1-4303-a0f1-df5a7c778fc4" (UID: "cb8d4722-19e1-4303-a0f1-df5a7c778fc4"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:09:04.679818 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.679610 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "cb8d4722-19e1-4303-a0f1-df5a7c778fc4" (UID: "cb8d4722-19e1-4303-a0f1-df5a7c778fc4"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:09:04.679818 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.679630 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "cb8d4722-19e1-4303-a0f1-df5a7c778fc4" (UID: "cb8d4722-19e1-4303-a0f1-df5a7c778fc4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:09:04.680292 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.680257 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "cb8d4722-19e1-4303-a0f1-df5a7c778fc4" (UID: "cb8d4722-19e1-4303-a0f1-df5a7c778fc4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:09:04.680572 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.680545 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "cb8d4722-19e1-4303-a0f1-df5a7c778fc4" (UID: "cb8d4722-19e1-4303-a0f1-df5a7c778fc4"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:09:04.680646 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.680624 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "cb8d4722-19e1-4303-a0f1-df5a7c778fc4" (UID: "cb8d4722-19e1-4303-a0f1-df5a7c778fc4"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:09:04.681520 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.681489 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "cb8d4722-19e1-4303-a0f1-df5a7c778fc4" (UID: "cb8d4722-19e1-4303-a0f1-df5a7c778fc4"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:09:04.681981 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.681962 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "cb8d4722-19e1-4303-a0f1-df5a7c778fc4" (UID: "cb8d4722-19e1-4303-a0f1-df5a7c778fc4"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:09:04.682111 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.682093 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-config" (OuterVolumeSpecName: "config") pod "cb8d4722-19e1-4303-a0f1-df5a7c778fc4" (UID: "cb8d4722-19e1-4303-a0f1-df5a7c778fc4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:09:04.682277 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.682263 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-config-out" (OuterVolumeSpecName: "config-out") pod "cb8d4722-19e1-4303-a0f1-df5a7c778fc4" (UID: "cb8d4722-19e1-4303-a0f1-df5a7c778fc4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:09:04.688523 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.688503 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-web-config" (OuterVolumeSpecName: "web-config") pod "cb8d4722-19e1-4303-a0f1-df5a7c778fc4" (UID: "cb8d4722-19e1-4303-a0f1-df5a7c778fc4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:09:04.777366 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.777336 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-prometheus-k8s-db\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:04.777366 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.777364 2563 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-grpc-tls\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:04.777366 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.777373 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-web-config\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:04.777510 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.777381 2563 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-kube-rbac-proxy\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:04.777510 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.777390 2563 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-config\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:04.777510 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.777398 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-tls-assets\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:04.777510 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.777407 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:04.777510 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.777414 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:04.777510 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.777423 2563 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-metrics-client-certs\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:04.777510 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.777431 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:04.777510 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.777440 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:04.777510 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.777447 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-config-out\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:04.777510 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.777455 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:04.777510 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.777463 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:04.777510 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.777471 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:04.777510 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.777478 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-configmap-metrics-client-ca\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:04.777510 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.777486 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wc7j8\" (UniqueName: \"kubernetes.io/projected/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-kube-api-access-wc7j8\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:04.777510 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.777493 2563 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:04.777510 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:04.777501 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cb8d4722-19e1-4303-a0f1-df5a7c778fc4-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:05.184425 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.184393 2563 generic.go:356] "Generic (PLEG): container finished" podID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerID="efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8" exitCode=0 Jul 29 16:09:05.184425 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.184417 2563 generic.go:356] "Generic (PLEG): container finished" podID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerID="100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339" exitCode=0 Jul 29 16:09:05.184425 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.184426 2563 generic.go:356] "Generic (PLEG): container finished" podID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerID="445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035" exitCode=0 Jul 29 16:09:05.184425 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.184433 2563 generic.go:356] "Generic (PLEG): container finished" podID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerID="d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5" exitCode=0 Jul 29 16:09:05.184846 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.184441 2563 generic.go:356] "Generic (PLEG): container finished" podID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerID="ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007" exitCode=0 Jul 29 16:09:05.184846 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.184448 2563 generic.go:356] "Generic (PLEG): container finished" podID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerID="4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181" exitCode=0 Jul 29 16:09:05.184846 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.184469 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.184846 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.184472 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cb8d4722-19e1-4303-a0f1-df5a7c778fc4","Type":"ContainerDied","Data":"efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8"} Jul 29 16:09:05.184846 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.184541 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cb8d4722-19e1-4303-a0f1-df5a7c778fc4","Type":"ContainerDied","Data":"100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339"} Jul 29 16:09:05.184846 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.184568 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cb8d4722-19e1-4303-a0f1-df5a7c778fc4","Type":"ContainerDied","Data":"445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035"} Jul 29 16:09:05.184846 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.184592 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cb8d4722-19e1-4303-a0f1-df5a7c778fc4","Type":"ContainerDied","Data":"d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5"} Jul 29 16:09:05.184846 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.184614 2563 scope.go:117] "RemoveContainer" containerID="efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8" Jul 29 16:09:05.184846 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.184617 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cb8d4722-19e1-4303-a0f1-df5a7c778fc4","Type":"ContainerDied","Data":"ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007"} Jul 29 16:09:05.184846 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.184717 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cb8d4722-19e1-4303-a0f1-df5a7c778fc4","Type":"ContainerDied","Data":"4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181"} Jul 29 16:09:05.184846 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.184769 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cb8d4722-19e1-4303-a0f1-df5a7c778fc4","Type":"ContainerDied","Data":"9e84a4d35755dcc06330c8cd9d50220a19ddb159e91aaa7bc61502f431022cd3"} Jul 29 16:09:05.192444 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.192428 2563 scope.go:117] "RemoveContainer" containerID="100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339" Jul 29 16:09:05.199376 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.199356 2563 scope.go:117] "RemoveContainer" containerID="445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035" Jul 29 16:09:05.205563 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.205548 2563 scope.go:117] "RemoveContainer" containerID="d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5" Jul 29 16:09:05.208923 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.208900 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 16:09:05.212270 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.212248 2563 scope.go:117] "RemoveContainer" containerID="ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007" Jul 29 16:09:05.216591 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.216573 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 16:09:05.219025 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.219007 2563 scope.go:117] "RemoveContainer" containerID="4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181" Jul 29 16:09:05.225493 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.225480 2563 scope.go:117] "RemoveContainer" containerID="75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba" Jul 29 16:09:05.231783 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.231762 2563 scope.go:117] "RemoveContainer" containerID="efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8" Jul 29 16:09:05.232089 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:09:05.232059 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8\": container with ID starting with efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8 not found: ID does not exist" containerID="efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8" Jul 29 16:09:05.232165 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.232089 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8"} err="failed to get container status \"efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8\": rpc error: code = NotFound desc = could not find container \"efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8\": container with ID starting with efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8 not found: ID does not exist" Jul 29 16:09:05.232165 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.232111 2563 scope.go:117] "RemoveContainer" containerID="100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339" Jul 29 16:09:05.232375 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:09:05.232357 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339\": container with ID starting with 100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339 not found: ID does not exist" containerID="100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339" Jul 29 16:09:05.232444 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.232386 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339"} err="failed to get container status \"100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339\": rpc error: code = NotFound desc = could not find container \"100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339\": container with ID starting with 100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339 not found: ID does not exist" Jul 29 16:09:05.232444 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.232408 2563 scope.go:117] "RemoveContainer" containerID="445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035" Jul 29 16:09:05.232653 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:09:05.232639 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035\": container with ID starting with 445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035 not found: ID does not exist" containerID="445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035" Jul 29 16:09:05.232717 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.232660 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035"} err="failed to get container status \"445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035\": rpc error: code = NotFound desc = could not find container \"445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035\": container with ID starting with 445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035 not found: ID does not exist" Jul 29 16:09:05.232717 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.232680 2563 scope.go:117] "RemoveContainer" containerID="d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5" Jul 29 16:09:05.232942 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:09:05.232927 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5\": container with ID starting with d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5 not found: ID does not exist" containerID="d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5" Jul 29 16:09:05.232977 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.232947 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5"} err="failed to get container status \"d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5\": rpc error: code = NotFound desc = could not find container \"d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5\": container with ID starting with d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5 not found: ID does not exist" Jul 29 16:09:05.232977 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.232960 2563 scope.go:117] "RemoveContainer" containerID="ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007" Jul 29 16:09:05.233182 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:09:05.233162 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007\": container with ID starting with ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007 not found: ID does not exist" containerID="ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007" Jul 29 16:09:05.233261 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.233186 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007"} err="failed to get container status \"ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007\": rpc error: code = NotFound desc = could not find container \"ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007\": container with ID starting with ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007 not found: ID does not exist" Jul 29 16:09:05.233261 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.233201 2563 scope.go:117] "RemoveContainer" containerID="4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181" Jul 29 16:09:05.233390 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:09:05.233373 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181\": container with ID starting with 4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181 not found: ID does not exist" containerID="4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181" Jul 29 16:09:05.233426 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.233396 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181"} err="failed to get container status \"4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181\": rpc error: code = NotFound desc = could not find container \"4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181\": container with ID starting with 4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181 not found: ID does not exist" Jul 29 16:09:05.233426 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.233412 2563 scope.go:117] "RemoveContainer" containerID="75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba" Jul 29 16:09:05.233600 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:09:05.233586 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba\": container with ID starting with 75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba not found: ID does not exist" containerID="75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba" Jul 29 16:09:05.233639 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.233603 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba"} err="failed to get container status \"75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba\": rpc error: code = NotFound desc = could not find container \"75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba\": container with ID starting with 75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba not found: ID does not exist" Jul 29 16:09:05.233639 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.233615 2563 scope.go:117] "RemoveContainer" containerID="efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8" Jul 29 16:09:05.233870 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.233853 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8"} err="failed to get container status \"efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8\": rpc error: code = NotFound desc = could not find container \"efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8\": container with ID starting with efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8 not found: ID does not exist" Jul 29 16:09:05.233925 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.233871 2563 scope.go:117] "RemoveContainer" containerID="100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339" Jul 29 16:09:05.234060 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.234046 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339"} err="failed to get container status \"100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339\": rpc error: code = NotFound desc = could not find container \"100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339\": container with ID starting with 100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339 not found: ID does not exist" Jul 29 16:09:05.234060 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.234060 2563 scope.go:117] "RemoveContainer" containerID="445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035" Jul 29 16:09:05.234259 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.234244 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035"} err="failed to get container status \"445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035\": rpc error: code = NotFound desc = could not find container \"445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035\": container with ID starting with 445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035 not found: ID does not exist" Jul 29 16:09:05.234259 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.234258 2563 scope.go:117] "RemoveContainer" containerID="d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5" Jul 29 16:09:05.234436 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.234420 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5"} err="failed to get container status \"d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5\": rpc error: code = NotFound desc = could not find container \"d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5\": container with ID starting with d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5 not found: ID does not exist" Jul 29 16:09:05.234481 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.234437 2563 scope.go:117] "RemoveContainer" containerID="ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007" Jul 29 16:09:05.234617 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.234603 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007"} err="failed to get container status \"ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007\": rpc error: code = NotFound desc = could not find container \"ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007\": container with ID starting with ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007 not found: ID does not exist" Jul 29 16:09:05.234660 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.234617 2563 scope.go:117] "RemoveContainer" containerID="4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181" Jul 29 16:09:05.234817 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.234803 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181"} err="failed to get container status \"4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181\": rpc error: code = NotFound desc = could not find container \"4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181\": container with ID starting with 4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181 not found: ID does not exist" Jul 29 16:09:05.234817 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.234817 2563 scope.go:117] "RemoveContainer" containerID="75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba" Jul 29 16:09:05.235010 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.234994 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba"} err="failed to get container status \"75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba\": rpc error: code = NotFound desc = could not find container \"75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba\": container with ID starting with 75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba not found: ID does not exist" Jul 29 16:09:05.235059 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.235010 2563 scope.go:117] "RemoveContainer" containerID="efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8" Jul 29 16:09:05.235175 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.235160 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8"} err="failed to get container status \"efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8\": rpc error: code = NotFound desc = could not find container \"efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8\": container with ID starting with efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8 not found: ID does not exist" Jul 29 16:09:05.235220 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.235174 2563 scope.go:117] "RemoveContainer" containerID="100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339" Jul 29 16:09:05.235368 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.235353 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339"} err="failed to get container status \"100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339\": rpc error: code = NotFound desc = could not find container \"100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339\": container with ID starting with 100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339 not found: ID does not exist" Jul 29 16:09:05.235415 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.235369 2563 scope.go:117] "RemoveContainer" containerID="445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035" Jul 29 16:09:05.235564 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.235548 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035"} err="failed to get container status \"445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035\": rpc error: code = NotFound desc = could not find container \"445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035\": container with ID starting with 445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035 not found: ID does not exist" Jul 29 16:09:05.235607 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.235566 2563 scope.go:117] "RemoveContainer" containerID="d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5" Jul 29 16:09:05.235791 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.235776 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5"} err="failed to get container status \"d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5\": rpc error: code = NotFound desc = could not find container \"d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5\": container with ID starting with d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5 not found: ID does not exist" Jul 29 16:09:05.235791 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.235791 2563 scope.go:117] "RemoveContainer" containerID="ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007" Jul 29 16:09:05.236006 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.235991 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007"} err="failed to get container status \"ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007\": rpc error: code = NotFound desc = could not find container \"ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007\": container with ID starting with ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007 not found: ID does not exist" Jul 29 16:09:05.236006 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.236005 2563 scope.go:117] "RemoveContainer" containerID="4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181" Jul 29 16:09:05.236181 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.236165 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181"} err="failed to get container status \"4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181\": rpc error: code = NotFound desc = could not find container \"4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181\": container with ID starting with 4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181 not found: ID does not exist" Jul 29 16:09:05.236222 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.236182 2563 scope.go:117] "RemoveContainer" containerID="75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba" Jul 29 16:09:05.236359 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.236344 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba"} err="failed to get container status \"75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba\": rpc error: code = NotFound desc = could not find container \"75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba\": container with ID starting with 75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba not found: ID does not exist" Jul 29 16:09:05.236399 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.236359 2563 scope.go:117] "RemoveContainer" containerID="efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8" Jul 29 16:09:05.236533 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.236518 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8"} err="failed to get container status \"efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8\": rpc error: code = NotFound desc = could not find container \"efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8\": container with ID starting with efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8 not found: ID does not exist" Jul 29 16:09:05.236568 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.236533 2563 scope.go:117] "RemoveContainer" containerID="100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339" Jul 29 16:09:05.236699 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.236684 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339"} err="failed to get container status \"100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339\": rpc error: code = NotFound desc = could not find container \"100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339\": container with ID starting with 100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339 not found: ID does not exist" Jul 29 16:09:05.236737 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.236698 2563 scope.go:117] "RemoveContainer" containerID="445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035" Jul 29 16:09:05.236891 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.236873 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035"} err="failed to get container status \"445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035\": rpc error: code = NotFound desc = could not find container \"445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035\": container with ID starting with 445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035 not found: ID does not exist" Jul 29 16:09:05.236931 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.236892 2563 scope.go:117] "RemoveContainer" containerID="d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5" Jul 29 16:09:05.237092 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.237077 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5"} err="failed to get container status \"d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5\": rpc error: code = NotFound desc = could not find container \"d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5\": container with ID starting with d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5 not found: ID does not exist" Jul 29 16:09:05.237141 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.237092 2563 scope.go:117] "RemoveContainer" containerID="ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007" Jul 29 16:09:05.237256 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.237240 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007"} err="failed to get container status \"ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007\": rpc error: code = NotFound desc = could not find container \"ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007\": container with ID starting with ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007 not found: ID does not exist" Jul 29 16:09:05.237294 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.237256 2563 scope.go:117] "RemoveContainer" containerID="4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181" Jul 29 16:09:05.237422 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.237409 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181"} err="failed to get container status \"4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181\": rpc error: code = NotFound desc = could not find container \"4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181\": container with ID starting with 4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181 not found: ID does not exist" Jul 29 16:09:05.237463 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.237422 2563 scope.go:117] "RemoveContainer" containerID="75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba" Jul 29 16:09:05.237610 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.237595 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba"} err="failed to get container status \"75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba\": rpc error: code = NotFound desc = could not find container \"75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba\": container with ID starting with 75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba not found: ID does not exist" Jul 29 16:09:05.237652 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.237611 2563 scope.go:117] "RemoveContainer" containerID="efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8" Jul 29 16:09:05.237850 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.237834 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8"} err="failed to get container status \"efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8\": rpc error: code = NotFound desc = could not find container \"efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8\": container with ID starting with efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8 not found: ID does not exist" Jul 29 16:09:05.237850 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.237850 2563 scope.go:117] "RemoveContainer" containerID="100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339" Jul 29 16:09:05.238107 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.238086 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339"} err="failed to get container status \"100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339\": rpc error: code = NotFound desc = could not find container \"100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339\": container with ID starting with 100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339 not found: ID does not exist" Jul 29 16:09:05.238175 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.238107 2563 scope.go:117] "RemoveContainer" containerID="445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035" Jul 29 16:09:05.238351 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.238329 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035"} err="failed to get container status \"445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035\": rpc error: code = NotFound desc = could not find container \"445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035\": container with ID starting with 445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035 not found: ID does not exist" Jul 29 16:09:05.238351 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.238353 2563 scope.go:117] "RemoveContainer" containerID="d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5" Jul 29 16:09:05.238649 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.238626 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5"} err="failed to get container status \"d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5\": rpc error: code = NotFound desc = could not find container \"d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5\": container with ID starting with d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5 not found: ID does not exist" Jul 29 16:09:05.238735 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.238653 2563 scope.go:117] "RemoveContainer" containerID="ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007" Jul 29 16:09:05.238938 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.238910 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007"} err="failed to get container status \"ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007\": rpc error: code = NotFound desc = could not find container \"ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007\": container with ID starting with ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007 not found: ID does not exist" Jul 29 16:09:05.239023 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.238939 2563 scope.go:117] "RemoveContainer" containerID="4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181" Jul 29 16:09:05.239195 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.239176 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181"} err="failed to get container status \"4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181\": rpc error: code = NotFound desc = could not find container \"4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181\": container with ID starting with 4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181 not found: ID does not exist" Jul 29 16:09:05.239243 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.239196 2563 scope.go:117] "RemoveContainer" containerID="75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba" Jul 29 16:09:05.239404 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.239383 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba"} err="failed to get container status \"75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba\": rpc error: code = NotFound desc = could not find container \"75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba\": container with ID starting with 75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba not found: ID does not exist" Jul 29 16:09:05.239404 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.239402 2563 scope.go:117] "RemoveContainer" containerID="efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8" Jul 29 16:09:05.239640 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.239620 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8"} err="failed to get container status \"efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8\": rpc error: code = NotFound desc = could not find container \"efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8\": container with ID starting with efabb8ca249e57c67166878d6af911c70faec8e19709654cb09799ac46b979e8 not found: ID does not exist" Jul 29 16:09:05.239690 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.239640 2563 scope.go:117] "RemoveContainer" containerID="100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339" Jul 29 16:09:05.239909 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.239888 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339"} err="failed to get container status \"100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339\": rpc error: code = NotFound desc = could not find container \"100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339\": container with ID starting with 100f65d831aff680799dc25b89cfbf50c99a97cb65d6b2092c4821034fa06339 not found: ID does not exist" Jul 29 16:09:05.239985 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.239918 2563 scope.go:117] "RemoveContainer" containerID="445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035" Jul 29 16:09:05.240135 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.240118 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035"} err="failed to get container status \"445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035\": rpc error: code = NotFound desc = could not find container \"445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035\": container with ID starting with 445e1262d140898325bb672ec3475bcbe10059e325abcf2b93058d6f58929035 not found: ID does not exist" Jul 29 16:09:05.240181 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.240136 2563 scope.go:117] "RemoveContainer" containerID="d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5" Jul 29 16:09:05.240349 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.240331 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5"} err="failed to get container status \"d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5\": rpc error: code = NotFound desc = could not find container \"d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5\": container with ID starting with d172c0d93b8e4d8379394bd624bc7aba511521512a62fc1ed7c10703f0d063e5 not found: ID does not exist" Jul 29 16:09:05.240349 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.240348 2563 scope.go:117] "RemoveContainer" containerID="ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007" Jul 29 16:09:05.240560 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.240541 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007"} err="failed to get container status \"ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007\": rpc error: code = NotFound desc = could not find container \"ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007\": container with ID starting with ea16e1570bca8006343ed89058666e93b2523bf97ba0bb48dca6902bfa620007 not found: ID does not exist" Jul 29 16:09:05.240560 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.240559 2563 scope.go:117] "RemoveContainer" containerID="4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181" Jul 29 16:09:05.240768 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.240733 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181"} err="failed to get container status \"4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181\": rpc error: code = NotFound desc = could not find container \"4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181\": container with ID starting with 4150c6ed5d87ac30816b668f3dc4d6aa0be3f35d6ec24eb06d63a543dbbd4181 not found: ID does not exist" Jul 29 16:09:05.240819 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.240767 2563 scope.go:117] "RemoveContainer" containerID="75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba" Jul 29 16:09:05.240964 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.240949 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba"} err="failed to get container status \"75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba\": rpc error: code = NotFound desc = could not find container \"75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba\": container with ID starting with 75268288777b3c2afb31caa9fe04bab781576d8cd4e86b80f2343a0f7561adba not found: ID does not exist" Jul 29 16:09:05.248946 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.248928 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 16:09:05.249154 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249143 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerName="init-config-reloader" Jul 29 16:09:05.249200 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249155 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerName="init-config-reloader" Jul 29 16:09:05.249200 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249165 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerName="thanos-sidecar" Jul 29 16:09:05.249200 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249170 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerName="thanos-sidecar" Jul 29 16:09:05.249200 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249177 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerName="kube-rbac-proxy" Jul 29 16:09:05.249200 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249182 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerName="kube-rbac-proxy" Jul 29 16:09:05.249200 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249190 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerName="init-config-reloader" Jul 29 16:09:05.249200 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249195 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerName="init-config-reloader" Jul 29 16:09:05.249200 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249202 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerName="kube-rbac-proxy-web" Jul 29 16:09:05.249458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249208 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerName="kube-rbac-proxy-web" Jul 29 16:09:05.249458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249213 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerName="config-reloader" Jul 29 16:09:05.249458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249218 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerName="config-reloader" Jul 29 16:09:05.249458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249223 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerName="kube-rbac-proxy" Jul 29 16:09:05.249458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249229 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerName="kube-rbac-proxy" Jul 29 16:09:05.249458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249235 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerName="kube-rbac-proxy-thanos" Jul 29 16:09:05.249458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249240 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerName="kube-rbac-proxy-thanos" Jul 29 16:09:05.249458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249250 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerName="kube-rbac-proxy-metric" Jul 29 16:09:05.249458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249255 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerName="kube-rbac-proxy-metric" Jul 29 16:09:05.249458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249262 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerName="kube-rbac-proxy-web" Jul 29 16:09:05.249458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249266 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerName="kube-rbac-proxy-web" Jul 29 16:09:05.249458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249273 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerName="alertmanager" Jul 29 16:09:05.249458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249278 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerName="alertmanager" Jul 29 16:09:05.249458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249283 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerName="config-reloader" Jul 29 16:09:05.249458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249287 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerName="config-reloader" Jul 29 16:09:05.249458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249293 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerName="prometheus" Jul 29 16:09:05.249458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249298 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerName="prometheus" Jul 29 16:09:05.249458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249303 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerName="prom-label-proxy" Jul 29 16:09:05.249458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249308 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerName="prom-label-proxy" Jul 29 16:09:05.249458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249343 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerName="kube-rbac-proxy" Jul 29 16:09:05.249458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249350 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerName="kube-rbac-proxy" Jul 29 16:09:05.249458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249355 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerName="config-reloader" Jul 29 16:09:05.249458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249360 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerName="kube-rbac-proxy-metric" Jul 29 16:09:05.249458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249365 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerName="prometheus" Jul 29 16:09:05.249458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249370 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerName="prom-label-proxy" Jul 29 16:09:05.249458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249375 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerName="kube-rbac-proxy-web" Jul 29 16:09:05.249458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249380 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerName="thanos-sidecar" Jul 29 16:09:05.249458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249384 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerName="alertmanager" Jul 29 16:09:05.249458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249388 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerName="kube-rbac-proxy-thanos" Jul 29 16:09:05.249458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249393 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca3b7e45-cde4-4a88-b755-547d366cd90e" containerName="kube-rbac-proxy-web" Jul 29 16:09:05.249458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.249397 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" containerName="config-reloader" Jul 29 16:09:05.254728 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.254712 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.257823 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.257804 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 29 16:09:05.257930 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.257883 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 29 16:09:05.258008 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.257988 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 29 16:09:05.258248 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.258233 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 29 16:09:05.258318 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.258265 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 29 16:09:05.258318 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.258272 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 29 16:09:05.258524 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.258497 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 29 16:09:05.258524 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.258506 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-l4z7r\"" Jul 29 16:09:05.258636 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.258506 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 29 16:09:05.258790 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.258774 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 29 16:09:05.259003 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.258987 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 29 16:09:05.259062 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.258990 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 29 16:09:05.259062 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.258989 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-43dubno5hgja9\"" Jul 29 16:09:05.259062 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.259025 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 29 16:09:05.259265 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.259252 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 29 16:09:05.261862 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.261843 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 29 16:09:05.265841 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.265826 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 29 16:09:05.270292 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.270276 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 16:09:05.380959 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.380934 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5d03b7ef-36c5-4e29-82df-c50203a40ecc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.381069 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.380962 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d03b7ef-36c5-4e29-82df-c50203a40ecc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.381069 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.380981 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d03b7ef-36c5-4e29-82df-c50203a40ecc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.381069 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.381000 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzcgh\" (UniqueName: \"kubernetes.io/projected/5d03b7ef-36c5-4e29-82df-c50203a40ecc-kube-api-access-wzcgh\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.381069 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.381026 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5d03b7ef-36c5-4e29-82df-c50203a40ecc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.381069 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.381051 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d03b7ef-36c5-4e29-82df-c50203a40ecc-config\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.381296 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.381071 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5d03b7ef-36c5-4e29-82df-c50203a40ecc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.381296 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.381093 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d03b7ef-36c5-4e29-82df-c50203a40ecc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.381296 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.381156 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d03b7ef-36c5-4e29-82df-c50203a40ecc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.381296 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.381195 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d03b7ef-36c5-4e29-82df-c50203a40ecc-web-config\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.381296 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.381231 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d03b7ef-36c5-4e29-82df-c50203a40ecc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.381296 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.381282 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5d03b7ef-36c5-4e29-82df-c50203a40ecc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.381549 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.381304 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d03b7ef-36c5-4e29-82df-c50203a40ecc-config-out\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.381549 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.381320 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d03b7ef-36c5-4e29-82df-c50203a40ecc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.381549 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.381339 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d03b7ef-36c5-4e29-82df-c50203a40ecc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.381549 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.381368 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5d03b7ef-36c5-4e29-82df-c50203a40ecc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.381549 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.381401 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5d03b7ef-36c5-4e29-82df-c50203a40ecc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.381549 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.381425 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5d03b7ef-36c5-4e29-82df-c50203a40ecc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.381549 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.381449 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d03b7ef-36c5-4e29-82df-c50203a40ecc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.381549 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.381475 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5d03b7ef-36c5-4e29-82df-c50203a40ecc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.482505 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.482428 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d03b7ef-36c5-4e29-82df-c50203a40ecc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.482505 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.482474 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5d03b7ef-36c5-4e29-82df-c50203a40ecc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.482505 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.482495 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d03b7ef-36c5-4e29-82df-c50203a40ecc-config-out\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.482505 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.482510 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d03b7ef-36c5-4e29-82df-c50203a40ecc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.482800 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.482545 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d03b7ef-36c5-4e29-82df-c50203a40ecc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.482800 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.482567 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5d03b7ef-36c5-4e29-82df-c50203a40ecc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.482800 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.482641 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5d03b7ef-36c5-4e29-82df-c50203a40ecc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.482800 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.482668 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5d03b7ef-36c5-4e29-82df-c50203a40ecc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.483236 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.483010 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5d03b7ef-36c5-4e29-82df-c50203a40ecc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.483236 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.483130 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d03b7ef-36c5-4e29-82df-c50203a40ecc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.483236 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.483164 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5d03b7ef-36c5-4e29-82df-c50203a40ecc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.483236 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.483201 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5d03b7ef-36c5-4e29-82df-c50203a40ecc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.483485 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.483302 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d03b7ef-36c5-4e29-82df-c50203a40ecc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.483485 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.483425 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d03b7ef-36c5-4e29-82df-c50203a40ecc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.483485 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.483455 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d03b7ef-36c5-4e29-82df-c50203a40ecc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.483485 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.483478 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzcgh\" (UniqueName: \"kubernetes.io/projected/5d03b7ef-36c5-4e29-82df-c50203a40ecc-kube-api-access-wzcgh\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.483687 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.483490 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d03b7ef-36c5-4e29-82df-c50203a40ecc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.483687 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.483505 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5d03b7ef-36c5-4e29-82df-c50203a40ecc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.483687 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.483566 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d03b7ef-36c5-4e29-82df-c50203a40ecc-config\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.483687 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.483606 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5d03b7ef-36c5-4e29-82df-c50203a40ecc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.483687 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.483635 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d03b7ef-36c5-4e29-82df-c50203a40ecc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.483687 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.483671 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d03b7ef-36c5-4e29-82df-c50203a40ecc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.484025 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.483696 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d03b7ef-36c5-4e29-82df-c50203a40ecc-web-config\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.484085 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.484052 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5d03b7ef-36c5-4e29-82df-c50203a40ecc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.484139 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.484078 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d03b7ef-36c5-4e29-82df-c50203a40ecc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.485729 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.485505 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d03b7ef-36c5-4e29-82df-c50203a40ecc-config-out\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.485729 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.485569 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d03b7ef-36c5-4e29-82df-c50203a40ecc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.485729 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.485619 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d03b7ef-36c5-4e29-82df-c50203a40ecc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.486174 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.485963 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5d03b7ef-36c5-4e29-82df-c50203a40ecc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.486413 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.486389 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d03b7ef-36c5-4e29-82df-c50203a40ecc-web-config\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.486652 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.486452 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5d03b7ef-36c5-4e29-82df-c50203a40ecc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.486832 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.486809 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5d03b7ef-36c5-4e29-82df-c50203a40ecc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.486990 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.486968 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5d03b7ef-36c5-4e29-82df-c50203a40ecc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.487120 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.487103 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5d03b7ef-36c5-4e29-82df-c50203a40ecc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.487957 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.487866 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d03b7ef-36c5-4e29-82df-c50203a40ecc-config\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.488812 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.488776 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d03b7ef-36c5-4e29-82df-c50203a40ecc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.488812 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.488793 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d03b7ef-36c5-4e29-82df-c50203a40ecc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.489443 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.489424 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d03b7ef-36c5-4e29-82df-c50203a40ecc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.489550 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.489534 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5d03b7ef-36c5-4e29-82df-c50203a40ecc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.494304 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.494289 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzcgh\" (UniqueName: \"kubernetes.io/projected/5d03b7ef-36c5-4e29-82df-c50203a40ecc-kube-api-access-wzcgh\") pod \"prometheus-k8s-0\" (UID: \"5d03b7ef-36c5-4e29-82df-c50203a40ecc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.541911 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.541891 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb8d4722-19e1-4303-a0f1-df5a7c778fc4" path="/var/lib/kubelet/pods/cb8d4722-19e1-4303-a0f1-df5a7c778fc4/volumes" Jul 29 16:09:05.564284 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.564268 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:05.700273 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:05.700251 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 16:09:05.702577 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:09:05.702538 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d03b7ef_36c5_4e29_82df_c50203a40ecc.slice/crio-7c15cfbecf157135bb054e46e330fbcc32094343115266d8efe3873f8a872a6c WatchSource:0}: Error finding container 7c15cfbecf157135bb054e46e330fbcc32094343115266d8efe3873f8a872a6c: Status 404 returned error can't find the container with id 7c15cfbecf157135bb054e46e330fbcc32094343115266d8efe3873f8a872a6c Jul 29 16:09:06.189909 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:06.189874 2563 generic.go:356] "Generic (PLEG): container finished" podID="5d03b7ef-36c5-4e29-82df-c50203a40ecc" containerID="e17b6e9a1a7cb1d5bdb841d438e8a70d6cf23a774c459189946a94fc786a7b28" exitCode=0 Jul 29 16:09:06.190065 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:06.189957 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d03b7ef-36c5-4e29-82df-c50203a40ecc","Type":"ContainerDied","Data":"e17b6e9a1a7cb1d5bdb841d438e8a70d6cf23a774c459189946a94fc786a7b28"} Jul 29 16:09:06.190129 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:06.190069 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d03b7ef-36c5-4e29-82df-c50203a40ecc","Type":"ContainerStarted","Data":"7c15cfbecf157135bb054e46e330fbcc32094343115266d8efe3873f8a872a6c"} Jul 29 16:09:07.197850 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:07.197818 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d03b7ef-36c5-4e29-82df-c50203a40ecc","Type":"ContainerStarted","Data":"62eead891d8f5efd7010a1ef9c7fa2913978ca6ede6770c2158619a5829b1d67"} Jul 29 16:09:07.198261 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:07.197888 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d03b7ef-36c5-4e29-82df-c50203a40ecc","Type":"ContainerStarted","Data":"1458afce9f93a03977ebcfefea13650a8fa1fa457abf35c0c06e3bf90559ead8"} Jul 29 16:09:07.198261 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:07.197916 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d03b7ef-36c5-4e29-82df-c50203a40ecc","Type":"ContainerStarted","Data":"befd97dedf82c8ded82cdd374c84340bc226901084ea556363d1641192ba5099"} Jul 29 16:09:07.198261 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:07.197941 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d03b7ef-36c5-4e29-82df-c50203a40ecc","Type":"ContainerStarted","Data":"a387119d805358a89613313fde96bba9b17c230e70c43e521eb21a66d086dbb1"} Jul 29 16:09:07.198261 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:07.197965 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d03b7ef-36c5-4e29-82df-c50203a40ecc","Type":"ContainerStarted","Data":"e99ad7744b5b82e672c8a0e07352141a8d0076de5d5a21842fa5085b02214a24"} Jul 29 16:09:07.198261 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:07.197993 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d03b7ef-36c5-4e29-82df-c50203a40ecc","Type":"ContainerStarted","Data":"1ccee8b5a5ee6b2bb325c265c5a6ffe2d77cdb40d70e4caf56478aa62f34dc68"} Jul 29 16:09:07.226004 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:07.225957 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.206725681 podStartE2EDuration="2.225938667s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.212986ms" isStatefulPod=false podCreationTimestamp="2026-07-29 16:09:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:09:07.224462975 +0000 UTC m=+144.242284307" watchObservedRunningTime="2026-07-29 16:09:07.225938667 +0000 UTC m=+144.243759916" Jul 29 16:09:10.074889 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:10.074861 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c5968c487-9sbqg" Jul 29 16:09:10.074889 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:10.074907 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c5968c487-9sbqg" Jul 29 16:09:10.079519 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:10.079491 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c5968c487-9sbqg" Jul 29 16:09:10.213659 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:10.213634 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c5968c487-9sbqg" Jul 29 16:09:10.272269 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:10.272241 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b7dbbb86-nfcn4"] Jul 29 16:09:10.564724 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:10.564694 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:09:35.291268 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:35.291171 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b7dbbb86-nfcn4" podUID="2ab82134-438e-4fa2-8bcf-f0027f2505b3" containerName="console" containerID="cri-o://ab7a56a6cb1aa930362e846ef17ce957ffc4eac87ccf641bb3e94663b2596053" gracePeriod=15 Jul 29 16:09:35.520458 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:35.520432 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b7dbbb86-nfcn4" Jul 29 16:09:35.598471 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:35.598408 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lr9hw\" (UniqueName: \"kubernetes.io/projected/2ab82134-438e-4fa2-8bcf-f0027f2505b3-kube-api-access-lr9hw\") pod \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\" (UID: \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\") " Jul 29 16:09:35.598471 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:35.598465 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ab82134-438e-4fa2-8bcf-f0027f2505b3-console-serving-cert\") pod \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\" (UID: \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\") " Jul 29 16:09:35.598651 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:35.598484 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ab82134-438e-4fa2-8bcf-f0027f2505b3-console-oauth-config\") pod \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\" (UID: \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\") " Jul 29 16:09:35.598651 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:35.598600 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab82134-438e-4fa2-8bcf-f0027f2505b3-trusted-ca-bundle\") pod \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\" (UID: \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\") " Jul 29 16:09:35.598790 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:35.598656 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ab82134-438e-4fa2-8bcf-f0027f2505b3-console-config\") pod \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\" (UID: \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\") " Jul 29 16:09:35.598790 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:35.598695 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ab82134-438e-4fa2-8bcf-f0027f2505b3-service-ca\") pod \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\" (UID: \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\") " Jul 29 16:09:35.598790 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:35.598766 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ab82134-438e-4fa2-8bcf-f0027f2505b3-oauth-serving-cert\") pod \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\" (UID: \"2ab82134-438e-4fa2-8bcf-f0027f2505b3\") " Jul 29 16:09:35.599031 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:35.599004 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ab82134-438e-4fa2-8bcf-f0027f2505b3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2ab82134-438e-4fa2-8bcf-f0027f2505b3" (UID: "2ab82134-438e-4fa2-8bcf-f0027f2505b3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:09:35.599107 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:35.599068 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ab82134-438e-4fa2-8bcf-f0027f2505b3-console-config" (OuterVolumeSpecName: "console-config") pod "2ab82134-438e-4fa2-8bcf-f0027f2505b3" (UID: "2ab82134-438e-4fa2-8bcf-f0027f2505b3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:09:35.599217 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:35.599118 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ab82134-438e-4fa2-8bcf-f0027f2505b3-service-ca" (OuterVolumeSpecName: "service-ca") pod "2ab82134-438e-4fa2-8bcf-f0027f2505b3" (UID: "2ab82134-438e-4fa2-8bcf-f0027f2505b3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:09:35.599448 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:35.599426 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ab82134-438e-4fa2-8bcf-f0027f2505b3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2ab82134-438e-4fa2-8bcf-f0027f2505b3" (UID: "2ab82134-438e-4fa2-8bcf-f0027f2505b3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:09:35.600783 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:35.600735 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ab82134-438e-4fa2-8bcf-f0027f2505b3-kube-api-access-lr9hw" (OuterVolumeSpecName: "kube-api-access-lr9hw") pod "2ab82134-438e-4fa2-8bcf-f0027f2505b3" (UID: "2ab82134-438e-4fa2-8bcf-f0027f2505b3"). InnerVolumeSpecName "kube-api-access-lr9hw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:09:35.600783 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:35.600735 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ab82134-438e-4fa2-8bcf-f0027f2505b3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2ab82134-438e-4fa2-8bcf-f0027f2505b3" (UID: "2ab82134-438e-4fa2-8bcf-f0027f2505b3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:09:35.600904 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:35.600842 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ab82134-438e-4fa2-8bcf-f0027f2505b3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2ab82134-438e-4fa2-8bcf-f0027f2505b3" (UID: "2ab82134-438e-4fa2-8bcf-f0027f2505b3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:09:35.699804 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:35.699778 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab82134-438e-4fa2-8bcf-f0027f2505b3-trusted-ca-bundle\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:35.699804 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:35.699797 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ab82134-438e-4fa2-8bcf-f0027f2505b3-console-config\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:35.699804 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:35.699806 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ab82134-438e-4fa2-8bcf-f0027f2505b3-service-ca\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:35.699953 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:35.699813 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ab82134-438e-4fa2-8bcf-f0027f2505b3-oauth-serving-cert\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:35.699953 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:35.699823 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lr9hw\" (UniqueName: \"kubernetes.io/projected/2ab82134-438e-4fa2-8bcf-f0027f2505b3-kube-api-access-lr9hw\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:35.699953 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:35.699831 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ab82134-438e-4fa2-8bcf-f0027f2505b3-console-serving-cert\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:35.699953 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:35.699840 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ab82134-438e-4fa2-8bcf-f0027f2505b3-console-oauth-config\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 29 16:09:36.306251 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:36.306217 2563 generic.go:356] "Generic (PLEG): container finished" podID="2ab82134-438e-4fa2-8bcf-f0027f2505b3" containerID="ab7a56a6cb1aa930362e846ef17ce957ffc4eac87ccf641bb3e94663b2596053" exitCode=0 Jul 29 16:09:36.306726 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:36.306259 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b7dbbb86-nfcn4" Jul 29 16:09:36.306726 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:36.306282 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b7dbbb86-nfcn4" event={"ID":"2ab82134-438e-4fa2-8bcf-f0027f2505b3","Type":"ContainerDied","Data":"ab7a56a6cb1aa930362e846ef17ce957ffc4eac87ccf641bb3e94663b2596053"} Jul 29 16:09:36.306726 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:36.306322 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b7dbbb86-nfcn4" event={"ID":"2ab82134-438e-4fa2-8bcf-f0027f2505b3","Type":"ContainerDied","Data":"2fc567425080d4f3727f1b18509b0114af6e855e762826eb4b1c255091afe7c4"} Jul 29 16:09:36.306726 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:36.306340 2563 scope.go:117] "RemoveContainer" containerID="ab7a56a6cb1aa930362e846ef17ce957ffc4eac87ccf641bb3e94663b2596053" Jul 29 16:09:36.314628 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:36.314612 2563 scope.go:117] "RemoveContainer" containerID="ab7a56a6cb1aa930362e846ef17ce957ffc4eac87ccf641bb3e94663b2596053" Jul 29 16:09:36.314952 ip-10-0-129-212 kubenswrapper[2563]: E0729 16:09:36.314931 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab7a56a6cb1aa930362e846ef17ce957ffc4eac87ccf641bb3e94663b2596053\": container with ID starting with ab7a56a6cb1aa930362e846ef17ce957ffc4eac87ccf641bb3e94663b2596053 not found: ID does not exist" containerID="ab7a56a6cb1aa930362e846ef17ce957ffc4eac87ccf641bb3e94663b2596053" Jul 29 16:09:36.315003 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:36.314961 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab7a56a6cb1aa930362e846ef17ce957ffc4eac87ccf641bb3e94663b2596053"} err="failed to get container status \"ab7a56a6cb1aa930362e846ef17ce957ffc4eac87ccf641bb3e94663b2596053\": rpc error: code = NotFound desc = could not find container \"ab7a56a6cb1aa930362e846ef17ce957ffc4eac87ccf641bb3e94663b2596053\": container with ID starting with ab7a56a6cb1aa930362e846ef17ce957ffc4eac87ccf641bb3e94663b2596053 not found: ID does not exist" Jul 29 16:09:36.329368 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:36.329347 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b7dbbb86-nfcn4"] Jul 29 16:09:36.334001 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:36.333981 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b7dbbb86-nfcn4"] Jul 29 16:09:37.541234 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:09:37.541206 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ab82134-438e-4fa2-8bcf-f0027f2505b3" path="/var/lib/kubelet/pods/2ab82134-438e-4fa2-8bcf-f0027f2505b3/volumes" Jul 29 16:10:05.564698 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:05.564671 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:10:05.579698 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:05.579677 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:10:06.421587 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:06.421562 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 16:10:34.483019 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:34.482987 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ttc2b_3f75274e-f78e-4656-ad34-0e149d4dff5b/global-pull-secret-syncer/0.log" Jul 29 16:10:34.483599 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:34.483574 2563 ???:1] "http: TLS handshake error from 10.0.129.212:54988: EOF" Jul 29 16:10:34.592448 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:34.592418 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-b84c6_4c0bfb07-ebbd-42da-a385-becaf4056a28/konnectivity-agent/0.log" Jul 29 16:10:34.640912 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:34.640889 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-212.ec2.internal_0895cdd09b066c024f59b1f6d999c0ab/haproxy/0.log" Jul 29 16:10:38.515405 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:38.515370 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-nrqlx_9f5658cd-d6c9-46d9-8e24-6cc5190d9b20/kube-state-metrics/0.log" Jul 29 16:10:38.545541 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:38.545512 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-nrqlx_9f5658cd-d6c9-46d9-8e24-6cc5190d9b20/kube-rbac-proxy-main/0.log" Jul 29 16:10:38.572898 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:38.572881 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-nrqlx_9f5658cd-d6c9-46d9-8e24-6cc5190d9b20/kube-rbac-proxy-self/0.log" Jul 29 16:10:38.633353 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:38.633332 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-fvztz_c6b7df92-327e-4274-b0c1-0e057ffb8e13/monitoring-plugin/0.log" Jul 29 16:10:38.864529 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:38.864433 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w9r4f_b33515c5-677c-478f-9547-b9521f9e44e7/node-exporter/0.log" Jul 29 16:10:38.894547 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:38.894521 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w9r4f_b33515c5-677c-478f-9547-b9521f9e44e7/kube-rbac-proxy/0.log" Jul 29 16:10:38.918763 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:38.918725 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w9r4f_b33515c5-677c-478f-9547-b9521f9e44e7/init-textfile/0.log" Jul 29 16:10:39.032068 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:39.032034 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5d03b7ef-36c5-4e29-82df-c50203a40ecc/prometheus/0.log" Jul 29 16:10:39.059933 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:39.059905 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5d03b7ef-36c5-4e29-82df-c50203a40ecc/config-reloader/0.log" Jul 29 16:10:39.083910 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:39.083880 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5d03b7ef-36c5-4e29-82df-c50203a40ecc/thanos-sidecar/0.log" Jul 29 16:10:39.107563 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:39.107540 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5d03b7ef-36c5-4e29-82df-c50203a40ecc/kube-rbac-proxy-web/0.log" Jul 29 16:10:39.134175 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:39.134081 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5d03b7ef-36c5-4e29-82df-c50203a40ecc/kube-rbac-proxy/0.log" Jul 29 16:10:39.158394 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:39.158360 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5d03b7ef-36c5-4e29-82df-c50203a40ecc/kube-rbac-proxy-thanos/0.log" Jul 29 16:10:39.182545 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:39.182524 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5d03b7ef-36c5-4e29-82df-c50203a40ecc/init-config-reloader/0.log" Jul 29 16:10:41.729153 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:41.729126 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6c5968c487-9sbqg_da16b706-55bc-4379-855b-6abdd6c3c4b4/console/0.log" Jul 29 16:10:42.643170 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:42.643142 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tqr8p/perf-node-gather-daemonset-8ctxb"] Jul 29 16:10:42.643416 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:42.643404 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ab82134-438e-4fa2-8bcf-f0027f2505b3" containerName="console" Jul 29 16:10:42.643459 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:42.643418 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ab82134-438e-4fa2-8bcf-f0027f2505b3" containerName="console" Jul 29 16:10:42.643494 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:42.643458 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ab82134-438e-4fa2-8bcf-f0027f2505b3" containerName="console" Jul 29 16:10:42.646171 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:42.646153 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tqr8p/perf-node-gather-daemonset-8ctxb" Jul 29 16:10:42.648639 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:42.648614 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tqr8p\"/\"openshift-service-ca.crt\"" Jul 29 16:10:42.649590 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:42.649574 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tqr8p\"/\"default-dockercfg-szvxb\"" Jul 29 16:10:42.649673 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:42.649582 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tqr8p\"/\"kube-root-ca.crt\"" Jul 29 16:10:42.653770 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:42.653731 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tqr8p/perf-node-gather-daemonset-8ctxb"] Jul 29 16:10:42.744329 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:42.744294 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96gl5\" (UniqueName: \"kubernetes.io/projected/089fde03-fee6-429e-a22c-463826def02e-kube-api-access-96gl5\") pod \"perf-node-gather-daemonset-8ctxb\" (UID: \"089fde03-fee6-429e-a22c-463826def02e\") " pod="openshift-must-gather-tqr8p/perf-node-gather-daemonset-8ctxb" Jul 29 16:10:42.744329 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:42.744335 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/089fde03-fee6-429e-a22c-463826def02e-podres\") pod \"perf-node-gather-daemonset-8ctxb\" (UID: \"089fde03-fee6-429e-a22c-463826def02e\") " pod="openshift-must-gather-tqr8p/perf-node-gather-daemonset-8ctxb" Jul 29 16:10:42.744735 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:42.744368 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/089fde03-fee6-429e-a22c-463826def02e-proc\") pod \"perf-node-gather-daemonset-8ctxb\" (UID: \"089fde03-fee6-429e-a22c-463826def02e\") " pod="openshift-must-gather-tqr8p/perf-node-gather-daemonset-8ctxb" Jul 29 16:10:42.744735 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:42.744443 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/089fde03-fee6-429e-a22c-463826def02e-lib-modules\") pod \"perf-node-gather-daemonset-8ctxb\" (UID: \"089fde03-fee6-429e-a22c-463826def02e\") " pod="openshift-must-gather-tqr8p/perf-node-gather-daemonset-8ctxb" Jul 29 16:10:42.744735 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:42.744488 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/089fde03-fee6-429e-a22c-463826def02e-sys\") pod \"perf-node-gather-daemonset-8ctxb\" (UID: \"089fde03-fee6-429e-a22c-463826def02e\") " pod="openshift-must-gather-tqr8p/perf-node-gather-daemonset-8ctxb" Jul 29 16:10:42.845148 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:42.845113 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/089fde03-fee6-429e-a22c-463826def02e-sys\") pod \"perf-node-gather-daemonset-8ctxb\" (UID: \"089fde03-fee6-429e-a22c-463826def02e\") " pod="openshift-must-gather-tqr8p/perf-node-gather-daemonset-8ctxb" Jul 29 16:10:42.845313 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:42.845167 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96gl5\" (UniqueName: \"kubernetes.io/projected/089fde03-fee6-429e-a22c-463826def02e-kube-api-access-96gl5\") pod \"perf-node-gather-daemonset-8ctxb\" (UID: \"089fde03-fee6-429e-a22c-463826def02e\") " pod="openshift-must-gather-tqr8p/perf-node-gather-daemonset-8ctxb" Jul 29 16:10:42.845313 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:42.845191 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/089fde03-fee6-429e-a22c-463826def02e-podres\") pod \"perf-node-gather-daemonset-8ctxb\" (UID: \"089fde03-fee6-429e-a22c-463826def02e\") " pod="openshift-must-gather-tqr8p/perf-node-gather-daemonset-8ctxb" Jul 29 16:10:42.845313 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:42.845216 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/089fde03-fee6-429e-a22c-463826def02e-proc\") pod \"perf-node-gather-daemonset-8ctxb\" (UID: \"089fde03-fee6-429e-a22c-463826def02e\") " pod="openshift-must-gather-tqr8p/perf-node-gather-daemonset-8ctxb" Jul 29 16:10:42.845313 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:42.845237 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/089fde03-fee6-429e-a22c-463826def02e-sys\") pod \"perf-node-gather-daemonset-8ctxb\" (UID: \"089fde03-fee6-429e-a22c-463826def02e\") " pod="openshift-must-gather-tqr8p/perf-node-gather-daemonset-8ctxb" Jul 29 16:10:42.845313 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:42.845241 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/089fde03-fee6-429e-a22c-463826def02e-lib-modules\") pod \"perf-node-gather-daemonset-8ctxb\" (UID: \"089fde03-fee6-429e-a22c-463826def02e\") " pod="openshift-must-gather-tqr8p/perf-node-gather-daemonset-8ctxb" Jul 29 16:10:42.845523 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:42.845332 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/089fde03-fee6-429e-a22c-463826def02e-podres\") pod \"perf-node-gather-daemonset-8ctxb\" (UID: \"089fde03-fee6-429e-a22c-463826def02e\") " pod="openshift-must-gather-tqr8p/perf-node-gather-daemonset-8ctxb" Jul 29 16:10:42.845523 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:42.845339 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/089fde03-fee6-429e-a22c-463826def02e-lib-modules\") pod \"perf-node-gather-daemonset-8ctxb\" (UID: \"089fde03-fee6-429e-a22c-463826def02e\") " pod="openshift-must-gather-tqr8p/perf-node-gather-daemonset-8ctxb" Jul 29 16:10:42.845523 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:42.845348 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/089fde03-fee6-429e-a22c-463826def02e-proc\") pod \"perf-node-gather-daemonset-8ctxb\" (UID: \"089fde03-fee6-429e-a22c-463826def02e\") " pod="openshift-must-gather-tqr8p/perf-node-gather-daemonset-8ctxb" Jul 29 16:10:42.855671 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:42.855643 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96gl5\" (UniqueName: \"kubernetes.io/projected/089fde03-fee6-429e-a22c-463826def02e-kube-api-access-96gl5\") pod \"perf-node-gather-daemonset-8ctxb\" (UID: \"089fde03-fee6-429e-a22c-463826def02e\") " pod="openshift-must-gather-tqr8p/perf-node-gather-daemonset-8ctxb" Jul 29 16:10:42.955797 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:42.955765 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tqr8p/perf-node-gather-daemonset-8ctxb" Jul 29 16:10:43.079314 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:43.079283 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tqr8p/perf-node-gather-daemonset-8ctxb"] Jul 29 16:10:43.082904 ip-10-0-129-212 kubenswrapper[2563]: W0729 16:10:43.082866 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod089fde03_fee6_429e_a22c_463826def02e.slice/crio-8dacfd38d782140d54ea5846a6e103591dac56839cc43a81a75ae40040996d81 WatchSource:0}: Error finding container 8dacfd38d782140d54ea5846a6e103591dac56839cc43a81a75ae40040996d81: Status 404 returned error can't find the container with id 8dacfd38d782140d54ea5846a6e103591dac56839cc43a81a75ae40040996d81 Jul 29 16:10:43.085598 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:43.085577 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9ztrz_b9a69276-083b-4878-a79c-3fce6807d2a6/dns/0.log" Jul 29 16:10:43.108359 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:43.108343 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9ztrz_b9a69276-083b-4878-a79c-3fce6807d2a6/kube-rbac-proxy/0.log" Jul 29 16:10:43.205631 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:43.205608 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kvkdw_b9a3fc6f-b673-4770-a62a-7044ea9d3e72/dns-node-resolver/0.log" Jul 29 16:10:43.534036 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:43.534000 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tqr8p/perf-node-gather-daemonset-8ctxb" event={"ID":"089fde03-fee6-429e-a22c-463826def02e","Type":"ContainerStarted","Data":"e273687fc5f092a15cdbe0eb4b7cc14682321c41f8cda52e2bc35f2535c17491"} Jul 29 16:10:43.534245 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:43.534085 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tqr8p/perf-node-gather-daemonset-8ctxb" event={"ID":"089fde03-fee6-429e-a22c-463826def02e","Type":"ContainerStarted","Data":"8dacfd38d782140d54ea5846a6e103591dac56839cc43a81a75ae40040996d81"} Jul 29 16:10:43.534245 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:43.534136 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tqr8p/perf-node-gather-daemonset-8ctxb" Jul 29 16:10:43.550624 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:43.550548 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tqr8p/perf-node-gather-daemonset-8ctxb" podStartSLOduration=1.550533146 podStartE2EDuration="1.550533146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:10:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:10:43.549348269 +0000 UTC m=+240.567169516" watchObservedRunningTime="2026-07-29 16:10:43.550533146 +0000 UTC m=+240.568354394" Jul 29 16:10:43.649032 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:43.649006 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h2bbk_76f8dffe-ddd3-416f-a108-9c49f4e33812/node-ca/0.log" Jul 29 16:10:44.641875 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:44.641842 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2pj7r_02eb49b6-5f4d-4ecb-b1fd-d679167d5cdf/serve-healthcheck-canary/0.log" Jul 29 16:10:45.057198 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:45.057169 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5wpts_b0b08927-6c7c-4d93-91e2-e023adda7f88/kube-rbac-proxy/0.log" Jul 29 16:10:45.076135 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:45.076102 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5wpts_b0b08927-6c7c-4d93-91e2-e023adda7f88/exporter/0.log" Jul 29 16:10:45.096755 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:45.096732 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5wpts_b0b08927-6c7c-4d93-91e2-e023adda7f88/extractor/0.log" Jul 29 16:10:49.547122 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:49.547095 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tqr8p/perf-node-gather-daemonset-8ctxb" Jul 29 16:10:50.670116 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:50.670089 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rw5kn_7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e/kube-multus-additional-cni-plugins/0.log" Jul 29 16:10:50.723603 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:50.723575 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rw5kn_7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e/egress-router-binary-copy/0.log" Jul 29 16:10:50.771815 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:50.771786 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rw5kn_7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e/cni-plugins/0.log" Jul 29 16:10:50.812732 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:50.812703 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rw5kn_7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e/bond-cni-plugin/0.log" Jul 29 16:10:50.849788 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:50.849740 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rw5kn_7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e/routeoverride-cni/0.log" Jul 29 16:10:50.888809 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:50.888786 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rw5kn_7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e/whereabouts-cni-bincopy/0.log" Jul 29 16:10:50.933939 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:50.933914 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rw5kn_7b92bd00-f9d7-4285-b1ea-163dc3e5ef4e/whereabouts-cni/0.log" Jul 29 16:10:51.030988 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:51.030960 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ndx86_188d7124-3dec-4f1c-96bc-2f334a0d4367/kube-multus/0.log" Jul 29 16:10:51.276309 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:51.276283 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z978p_8df6793f-3b49-4b29-ae90-d18f79c16891/network-metrics-daemon/0.log" Jul 29 16:10:51.317932 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:51.317905 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z978p_8df6793f-3b49-4b29-ae90-d18f79c16891/kube-rbac-proxy/0.log" Jul 29 16:10:52.603608 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:52.603583 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqzt9_31819202-a49a-4346-b291-656fc68edcd8/ovn-controller/0.log" Jul 29 16:10:52.622103 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:52.622080 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqzt9_31819202-a49a-4346-b291-656fc68edcd8/ovn-acl-logging/0.log" Jul 29 16:10:52.642320 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:52.642298 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqzt9_31819202-a49a-4346-b291-656fc68edcd8/kube-rbac-proxy-node/0.log" Jul 29 16:10:52.661949 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:52.661930 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqzt9_31819202-a49a-4346-b291-656fc68edcd8/kube-rbac-proxy-ovn-metrics/0.log" Jul 29 16:10:52.681116 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:52.681093 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqzt9_31819202-a49a-4346-b291-656fc68edcd8/northd/0.log" Jul 29 16:10:52.699784 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:52.699735 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqzt9_31819202-a49a-4346-b291-656fc68edcd8/nbdb/0.log" Jul 29 16:10:52.722066 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:52.722041 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqzt9_31819202-a49a-4346-b291-656fc68edcd8/sbdb/0.log" Jul 29 16:10:52.756907 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:52.756876 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqzt9_31819202-a49a-4346-b291-656fc68edcd8/ovnkube-controller/0.log" Jul 29 16:10:53.754307 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:53.754277 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-pxg62_066859ca-e247-4082-b6f9-d758329a31e5/network-check-target-container/0.log" Jul 29 16:10:54.651645 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:54.651621 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-xtclz_c5d99ada-6f3f-478c-8265-6b3fd3868f67/iptables-alerter/0.log" Jul 29 16:10:55.256508 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:55.256481 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-k2t27_2f886ffd-1453-4088-9cb3-4e5c4c0f13c6/tuned/0.log" Jul 29 16:10:58.563873 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:58.563848 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-qxrzk_4b898523-6b95-417d-9d35-abf57ef9668d/csi-driver/0.log" Jul 29 16:10:58.586029 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:58.586003 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-qxrzk_4b898523-6b95-417d-9d35-abf57ef9668d/csi-node-driver-registrar/0.log" Jul 29 16:10:58.608337 ip-10-0-129-212 kubenswrapper[2563]: I0729 16:10:58.608317 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-qxrzk_4b898523-6b95-417d-9d35-abf57ef9668d/csi-liveness-probe/0.log"