Jul 05 07:46:23.092594 ip-10-0-142-31 systemd[1]: Starting Kubernetes Kubelet... Jul 05 07:46:23.568672 ip-10-0-142-31 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 05 07:46:23.568672 ip-10-0-142-31 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 05 07:46:23.568672 ip-10-0-142-31 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 05 07:46:23.568672 ip-10-0-142-31 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 05 07:46:23.568672 ip-10-0-142-31 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 05 07:46:23.568672 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.516220 2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 05 07:46:23.568672 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522365 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 07:46:23.568672 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522375 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 07:46:23.568672 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522379 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 07:46:23.568672 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522382 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 07:46:23.568672 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522385 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 07:46:23.568672 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522388 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 07:46:23.568672 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522390 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 07:46:23.568672 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522393 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 07:46:23.572136 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522396 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 07:46:23.572136 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522398 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 07:46:23.572136 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522403 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 07:46:23.572136 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522408 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 07:46:23.572136 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522410 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 07:46:23.572136 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522413 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 07:46:23.572136 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522417 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 07:46:23.572136 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522419 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 07:46:23.572136 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522423 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 07:46:23.572136 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522426 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 07:46:23.572136 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522429 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 05 07:46:23.572136 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522432 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 07:46:23.572136 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522436 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 07:46:23.572136 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522439 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 07:46:23.572136 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522443 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 07:46:23.572136 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522447 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 07:46:23.572136 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522450 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 07:46:23.572136 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522453 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 07:46:23.572136 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522458 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 07:46:23.585482 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522460 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 07:46:23.585482 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522463 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 07:46:23.585482 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522466 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 07:46:23.585482 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522469 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 07:46:23.585482 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522472 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 07:46:23.585482 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522475 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 07:46:23.585482 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522477 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 07:46:23.585482 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522480 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 07:46:23.585482 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522483 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 07:46:23.585482 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522485 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 07:46:23.585482 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522488 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 07:46:23.585482 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522491 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 07:46:23.585482 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522493 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 07:46:23.585482 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522496 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 07:46:23.585482 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522498 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 07:46:23.585482 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522501 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 07:46:23.585482 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522503 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 07:46:23.585482 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522506 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 07:46:23.585482 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522508 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 07:46:23.585482 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522511 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 07:46:23.586950 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522514 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 07:46:23.586950 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522516 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 07:46:23.586950 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522519 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 07:46:23.586950 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522521 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 07:46:23.586950 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522524 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 07:46:23.586950 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522527 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 07:46:23.586950 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522532 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 07:46:23.586950 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522534 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 07:46:23.586950 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522537 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 07:46:23.586950 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522539 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 07:46:23.586950 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522542 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 07:46:23.586950 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522544 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 07:46:23.586950 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522547 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 07:46:23.586950 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522549 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 07:46:23.586950 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522552 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 07:46:23.586950 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522555 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 07:46:23.586950 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522557 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 07:46:23.586950 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522560 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 07:46:23.586950 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522562 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 07:46:23.604889 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522565 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 07:46:23.604889 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522567 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 07:46:23.604889 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522570 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 07:46:23.604889 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522572 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 07:46:23.604889 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522575 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 07:46:23.604889 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522578 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 07:46:23.604889 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522581 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 07:46:23.604889 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522583 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 07:46:23.604889 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522586 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 07:46:23.604889 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522588 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 07:46:23.604889 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522590 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 07:46:23.604889 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522593 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 07:46:23.604889 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522595 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 07:46:23.604889 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522598 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 07:46:23.604889 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522600 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 07:46:23.604889 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522603 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 07:46:23.604889 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522606 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 07:46:23.604889 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522608 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 07:46:23.604889 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522611 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 07:46:23.596082 ip-10-0-142-31 systemd[1]: Started Kubernetes Kubelet. Jul 05 07:46:23.621441 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522615 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 07:46:23.621441 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522618 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 07:46:23.621441 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522620 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 07:46:23.621441 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522623 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 07:46:23.621441 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522626 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 07:46:23.621441 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522629 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 07:46:23.621441 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522631 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 07:46:23.621441 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522634 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 07:46:23.621441 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522637 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 07:46:23.621441 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522639 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 07:46:23.621441 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522642 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 07:46:23.621441 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522644 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 07:46:23.621441 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522646 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 07:46:23.621441 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.522649 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 07:46:23.621441 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523305 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 07:46:23.621441 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523310 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 07:46:23.621441 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523314 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 07:46:23.621441 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523316 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 07:46:23.621441 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523335 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 07:46:23.621441 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523339 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 07:46:23.638268 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523342 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 07:46:23.638268 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523345 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 07:46:23.638268 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523347 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 07:46:23.638268 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523350 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 07:46:23.638268 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523352 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 07:46:23.638268 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523355 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 07:46:23.638268 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523358 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 07:46:23.638268 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523360 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 07:46:23.638268 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523363 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 07:46:23.638268 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523365 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 07:46:23.638268 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523368 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 07:46:23.638268 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523371 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 07:46:23.638268 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523375 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 07:46:23.638268 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523377 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 07:46:23.638268 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523380 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 07:46:23.638268 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523383 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 07:46:23.638268 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523387 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 07:46:23.638268 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523391 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 07:46:23.638268 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523394 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 07:46:23.638268 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523397 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 07:46:23.838673 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523400 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 07:46:23.838673 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523402 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 07:46:23.838673 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523407 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 07:46:23.838673 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523410 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 07:46:23.838673 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523413 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 07:46:23.838673 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523416 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 07:46:23.838673 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523419 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 07:46:23.838673 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523421 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 07:46:23.838673 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523424 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 07:46:23.838673 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523426 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 07:46:23.838673 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523429 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 07:46:23.838673 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523431 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 07:46:23.838673 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523436 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 07:46:23.838673 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523439 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 07:46:23.838673 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523441 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 07:46:23.838673 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523444 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 07:46:23.838673 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523452 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 07:46:23.838673 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523455 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 07:46:23.838673 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523458 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 07:46:23.855981 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523461 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 07:46:23.855981 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523464 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 07:46:23.855981 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523466 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 07:46:23.855981 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523469 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 07:46:23.855981 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523471 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 07:46:23.855981 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523475 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 07:46:23.855981 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523478 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 07:46:23.855981 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523480 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 07:46:23.855981 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523483 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 07:46:23.855981 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523486 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 07:46:23.855981 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523489 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 07:46:23.855981 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523491 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 07:46:23.855981 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523494 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 07:46:23.855981 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523496 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 07:46:23.855981 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523499 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 07:46:23.855981 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523501 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 07:46:23.855981 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523504 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 07:46:23.855981 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523506 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 07:46:23.855981 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523509 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 07:46:23.855981 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523511 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 07:46:23.868078 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523514 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 07:46:23.868078 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523516 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 07:46:23.868078 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523519 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 07:46:23.868078 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523522 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 07:46:23.868078 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523525 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 07:46:23.868078 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523538 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 07:46:23.868078 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523542 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 07:46:23.868078 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523544 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 07:46:23.868078 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523548 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 07:46:23.868078 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523552 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 07:46:23.868078 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523555 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 07:46:23.868078 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523558 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 07:46:23.868078 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523560 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 07:46:23.868078 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523563 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 07:46:23.868078 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523565 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 07:46:23.868078 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523567 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 07:46:23.868078 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523570 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 07:46:23.868078 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523574 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 07:46:23.868078 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523576 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 07:46:23.868911 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523579 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 05 07:46:23.868911 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523581 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 07:46:23.868911 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523584 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 07:46:23.868911 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523586 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 07:46:23.868911 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523589 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 07:46:23.868911 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523591 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 07:46:23.868911 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523594 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 07:46:23.868911 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523596 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 07:46:23.868911 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523599 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 07:46:23.868911 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523601 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 07:46:23.868911 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523604 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 07:46:23.868911 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523606 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 07:46:23.868911 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523609 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 07:46:23.868911 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523611 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 07:46:23.868911 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523614 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 07:46:23.868911 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523962 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 07:46:23.868911 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523967 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 07:46:23.868911 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523970 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 07:46:23.868911 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523974 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 07:46:23.868911 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523977 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 07:46:23.869530 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523980 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 07:46:23.869530 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523982 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 07:46:23.869530 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523985 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 07:46:23.869530 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523988 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 07:46:23.869530 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523990 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 07:46:23.869530 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523993 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 07:46:23.869530 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523995 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 07:46:23.869530 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.523998 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 07:46:23.869530 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524001 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 07:46:23.869530 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524005 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 07:46:23.869530 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524009 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 07:46:23.869530 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524012 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 07:46:23.869530 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524014 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 07:46:23.869530 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524017 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 07:46:23.869530 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524020 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 07:46:23.869530 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524022 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 07:46:23.869530 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524025 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 07:46:23.869530 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524027 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 07:46:23.869530 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524030 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 07:46:23.869530 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524033 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 07:46:23.870156 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524035 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 07:46:23.870156 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524038 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 07:46:23.870156 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524041 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 07:46:23.870156 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524043 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 07:46:23.870156 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524046 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 07:46:23.870156 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524048 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 07:46:23.870156 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524051 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 07:46:23.870156 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524053 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 07:46:23.870156 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524056 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 07:46:23.870156 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524058 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 07:46:23.870156 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524063 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 07:46:23.870156 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524066 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 07:46:23.870156 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524069 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 07:46:23.870156 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524071 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 07:46:23.870156 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524074 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 07:46:23.870156 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524076 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 07:46:23.870156 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524079 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 07:46:23.870156 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524081 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 07:46:23.870156 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524084 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 07:46:23.870156 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524086 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 07:46:23.870749 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524089 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 07:46:23.870749 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524091 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 07:46:23.870749 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524095 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 07:46:23.870749 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524097 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 07:46:23.870749 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524100 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 07:46:23.870749 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524102 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 07:46:23.870749 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524105 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 07:46:23.870749 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524107 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 07:46:23.870749 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524110 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 07:46:23.870749 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524112 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 07:46:23.870749 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524115 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 07:46:23.870749 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524117 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 07:46:23.870749 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524120 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 07:46:23.870749 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524123 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 07:46:23.870749 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524125 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 07:46:23.870749 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524127 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 07:46:23.870749 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524130 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 07:46:23.870749 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524133 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 07:46:23.870749 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524135 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 07:46:23.870749 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524137 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 07:46:23.871391 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524140 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 07:46:23.871391 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524144 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 07:46:23.871391 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524148 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 07:46:23.871391 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524151 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 07:46:23.871391 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524154 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 07:46:23.871391 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524157 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 07:46:23.871391 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524160 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 07:46:23.871391 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524162 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 07:46:23.871391 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524165 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 07:46:23.871391 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524169 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 07:46:23.871391 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524173 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 07:46:23.871391 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524176 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 07:46:23.871391 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524179 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 07:46:23.871391 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524182 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 07:46:23.871391 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524186 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 07:46:23.871391 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524189 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 07:46:23.871391 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524192 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 07:46:23.871391 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524194 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 07:46:23.871936 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524197 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 07:46:23.871936 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524200 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 07:46:23.871936 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524202 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 07:46:23.871936 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524204 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 07:46:23.871936 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524207 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 07:46:23.871936 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524209 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 05 07:46:23.871936 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524212 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 07:46:23.871936 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524214 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 07:46:23.871936 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524217 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 07:46:23.871936 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524219 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 07:46:23.871936 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524222 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 07:46:23.871936 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524224 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 07:46:23.871936 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524227 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 07:46:23.871936 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524229 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 07:46:23.871936 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524231 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 07:46:23.871936 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524234 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 07:46:23.871936 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524300 2566 flags.go:64] FLAG: --address="0.0.0.0" Jul 05 07:46:23.871936 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524307 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 05 07:46:23.871936 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524312 2566 flags.go:64] FLAG: --anonymous-auth="true" Jul 05 07:46:23.871936 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524316 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 05 07:46:23.871936 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524334 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 05 07:46:23.872599 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524340 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 05 07:46:23.872599 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524345 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 05 07:46:23.872599 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524350 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 05 07:46:23.872599 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524353 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 05 07:46:23.872599 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524356 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 05 07:46:23.872599 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524359 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 05 07:46:23.872599 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524362 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 05 07:46:23.872599 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524367 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 05 07:46:23.872599 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524370 2566 flags.go:64] FLAG: --cgroup-root="" Jul 05 07:46:23.872599 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524373 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 05 07:46:23.872599 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524376 2566 flags.go:64] FLAG: --client-ca-file="" Jul 05 07:46:23.872599 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524378 2566 flags.go:64] FLAG: --cloud-provider="external" Jul 05 07:46:23.872599 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524381 2566 flags.go:64] FLAG: --cluster-dns="[]" Jul 05 07:46:23.872599 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524385 2566 flags.go:64] FLAG: --cluster-domain="" Jul 05 07:46:23.872599 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524388 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 05 07:46:23.872599 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524391 2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 05 07:46:23.872599 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524394 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 05 07:46:23.872599 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524397 2566 flags.go:64] FLAG: --container-log-max-files="5" Jul 05 07:46:23.872599 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524401 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 05 07:46:23.872599 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524403 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 05 07:46:23.872599 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524406 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 05 07:46:23.872599 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524409 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 05 07:46:23.872599 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524412 2566 flags.go:64] FLAG: --contention-profiling="false" Jul 05 07:46:23.872599 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524415 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 05 07:46:23.873264 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524418 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 05 07:46:23.873264 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524421 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 05 07:46:23.873264 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524424 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 05 07:46:23.873264 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524429 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 05 07:46:23.873264 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524432 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 05 07:46:23.873264 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524435 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 05 07:46:23.873264 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524437 2566 flags.go:64] FLAG: --enable-load-reader="false" Jul 05 07:46:23.873264 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524440 2566 flags.go:64] FLAG: --enable-server="true" Jul 05 07:46:23.873264 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524444 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 05 07:46:23.873264 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524448 2566 flags.go:64] FLAG: --event-burst="100" Jul 05 07:46:23.873264 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524451 2566 flags.go:64] FLAG: --event-qps="50" Jul 05 07:46:23.873264 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524454 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 05 07:46:23.873264 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524456 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 05 07:46:23.873264 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524459 2566 flags.go:64] FLAG: --eviction-hard="" Jul 05 07:46:23.873264 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524463 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 05 07:46:23.873264 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524467 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 05 07:46:23.873264 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524470 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 05 07:46:23.873264 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524473 2566 flags.go:64] FLAG: --eviction-soft="" Jul 05 07:46:23.873264 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524476 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 05 07:46:23.873264 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524478 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 05 07:46:23.873264 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524481 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 05 07:46:23.873264 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524484 2566 flags.go:64] FLAG: --experimental-mounter-path="" Jul 05 07:46:23.873264 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524487 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 05 07:46:23.873264 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524490 2566 flags.go:64] FLAG: --fail-swap-on="true" Jul 05 07:46:23.873264 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524493 2566 flags.go:64] FLAG: --feature-gates="" Jul 05 07:46:23.874053 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524496 2566 flags.go:64] FLAG: --file-check-frequency="20s" Jul 05 07:46:23.874053 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524499 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 05 07:46:23.874053 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524502 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 05 07:46:23.874053 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524505 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 05 07:46:23.874053 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524508 2566 flags.go:64] FLAG: --healthz-port="10248" Jul 05 07:46:23.874053 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524510 2566 flags.go:64] FLAG: --help="false" Jul 05 07:46:23.874053 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524513 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-142-31.ec2.internal" Jul 05 07:46:23.874053 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524516 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 05 07:46:23.874053 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524519 2566 flags.go:64] FLAG: --http-check-frequency="20s" Jul 05 07:46:23.874053 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524522 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 05 07:46:23.874053 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524526 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 05 07:46:23.874053 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524529 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 05 07:46:23.874053 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524532 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 05 07:46:23.874053 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524534 2566 flags.go:64] FLAG: --image-service-endpoint="" Jul 05 07:46:23.874053 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524537 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 05 07:46:23.874053 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524540 2566 flags.go:64] FLAG: --kube-api-burst="100" Jul 05 07:46:23.874053 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524543 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 05 07:46:23.874053 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524546 2566 flags.go:64] FLAG: --kube-api-qps="50" Jul 05 07:46:23.874053 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524549 2566 flags.go:64] FLAG: --kube-reserved="" Jul 05 07:46:23.874053 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524551 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 05 07:46:23.874053 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524554 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 05 07:46:23.874053 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524557 2566 flags.go:64] FLAG: --kubelet-cgroups="" Jul 05 07:46:23.874053 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524561 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 05 07:46:23.874053 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524564 2566 flags.go:64] FLAG: --lock-file="" Jul 05 07:46:23.874702 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524567 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 05 07:46:23.874702 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524569 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 05 07:46:23.874702 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524572 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 05 07:46:23.874702 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524577 2566 flags.go:64] FLAG: --log-json-split-stream="false" Jul 05 07:46:23.874702 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524580 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 05 07:46:23.874702 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524583 2566 flags.go:64] FLAG: --log-text-split-stream="false" Jul 05 07:46:23.874702 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524585 2566 flags.go:64] FLAG: --logging-format="text" Jul 05 07:46:23.874702 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524588 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 05 07:46:23.874702 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524591 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 05 07:46:23.874702 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524594 2566 flags.go:64] FLAG: --manifest-url="" Jul 05 07:46:23.874702 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524597 2566 flags.go:64] FLAG: --manifest-url-header="" Jul 05 07:46:23.874702 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524601 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 05 07:46:23.874702 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524603 2566 flags.go:64] FLAG: --max-open-files="1000000" Jul 05 07:46:23.874702 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524607 2566 flags.go:64] FLAG: --max-pods="110" Jul 05 07:46:23.874702 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524610 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 05 07:46:23.874702 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524613 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 05 07:46:23.874702 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524616 2566 flags.go:64] FLAG: --memory-manager-policy="None" Jul 05 07:46:23.874702 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524619 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 05 07:46:23.874702 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524623 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 05 07:46:23.874702 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524626 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 05 07:46:23.874702 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524628 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 05 07:46:23.874702 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524638 2566 flags.go:64] FLAG: --node-status-max-images="50" Jul 05 07:46:23.874702 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524641 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 05 07:46:23.874702 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524643 2566 flags.go:64] FLAG: --oom-score-adj="-999" Jul 05 07:46:23.874702 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524646 2566 flags.go:64] FLAG: --pod-cidr="" Jul 05 07:46:23.875442 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524650 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 05 07:46:23.875442 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524655 2566 flags.go:64] FLAG: --pod-manifest-path="" Jul 05 07:46:23.875442 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524658 2566 flags.go:64] FLAG: --pod-max-pids="-1" Jul 05 07:46:23.875442 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524661 2566 flags.go:64] FLAG: --pods-per-core="0" Jul 05 07:46:23.875442 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524663 2566 flags.go:64] FLAG: --port="10250" Jul 05 07:46:23.875442 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524666 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 05 07:46:23.875442 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524670 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0defa8ec823d7ebde" Jul 05 07:46:23.875442 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524673 2566 flags.go:64] FLAG: --qos-reserved="" Jul 05 07:46:23.875442 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524676 2566 flags.go:64] FLAG: --read-only-port="10255" Jul 05 07:46:23.875442 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524679 2566 flags.go:64] FLAG: --register-node="true" Jul 05 07:46:23.875442 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524682 2566 flags.go:64] FLAG: --register-with-taints="" Jul 05 07:46:23.875442 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524685 2566 flags.go:64] FLAG: --registry-burst="10" Jul 05 07:46:23.875442 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524688 2566 flags.go:64] FLAG: --registry-qps="5" Jul 05 07:46:23.875442 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524690 2566 flags.go:64] FLAG: --reserved-cpus="" Jul 05 07:46:23.875442 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524693 2566 flags.go:64] FLAG: --reserved-memory="" Jul 05 07:46:23.875442 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524696 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 05 07:46:23.875442 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524699 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 05 07:46:23.875442 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524703 2566 flags.go:64] FLAG: --rotate-certificates="false" Jul 05 07:46:23.875442 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524705 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 05 07:46:23.875442 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524708 2566 flags.go:64] FLAG: --runonce="false" Jul 05 07:46:23.875442 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524711 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 05 07:46:23.875442 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524714 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 05 07:46:23.875442 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524717 2566 flags.go:64] FLAG: --seccomp-default="false" Jul 05 07:46:23.875442 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524719 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 05 07:46:23.875442 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524722 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 05 07:46:23.876219 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524726 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 05 07:46:23.876219 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524729 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 05 07:46:23.876219 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524732 2566 flags.go:64] FLAG: --storage-driver-password="root" Jul 05 07:46:23.876219 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524734 2566 flags.go:64] FLAG: --storage-driver-secure="false" Jul 05 07:46:23.876219 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524737 2566 flags.go:64] FLAG: --storage-driver-table="stats" Jul 05 07:46:23.876219 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524740 2566 flags.go:64] FLAG: --storage-driver-user="root" Jul 05 07:46:23.876219 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524743 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 05 07:46:23.876219 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524745 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 05 07:46:23.876219 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524754 2566 flags.go:64] FLAG: --system-cgroups="" Jul 05 07:46:23.876219 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524757 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 05 07:46:23.876219 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524762 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 05 07:46:23.876219 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524765 2566 flags.go:64] FLAG: --tls-cert-file="" Jul 05 07:46:23.876219 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524768 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 05 07:46:23.876219 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524775 2566 flags.go:64] FLAG: --tls-min-version="" Jul 05 07:46:23.876219 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524778 2566 flags.go:64] FLAG: --tls-private-key-file="" Jul 05 07:46:23.876219 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524781 2566 flags.go:64] FLAG: --topology-manager-policy="none" Jul 05 07:46:23.876219 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524784 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 05 07:46:23.876219 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524786 2566 flags.go:64] FLAG: --topology-manager-scope="container" Jul 05 07:46:23.876219 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524789 2566 flags.go:64] FLAG: --v="2" Jul 05 07:46:23.876219 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524797 2566 flags.go:64] FLAG: --version="false" Jul 05 07:46:23.876219 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524801 2566 flags.go:64] FLAG: --vmodule="" Jul 05 07:46:23.876219 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524805 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 05 07:46:23.876219 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.524808 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 05 07:46:23.876219 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524912 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 07:46:23.876219 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524915 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 07:46:23.877067 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524918 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 07:46:23.877067 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524921 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 07:46:23.877067 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524924 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 07:46:23.877067 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524927 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 07:46:23.877067 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524930 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 07:46:23.877067 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524933 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 07:46:23.877067 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524935 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 07:46:23.877067 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524941 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 07:46:23.877067 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524945 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 07:46:23.877067 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524947 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 07:46:23.877067 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524950 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 07:46:23.877067 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524953 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 07:46:23.877067 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524956 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 07:46:23.877067 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524959 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 07:46:23.877067 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524962 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 07:46:23.877067 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524964 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 07:46:23.877067 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524968 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 07:46:23.877067 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524971 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 07:46:23.877067 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524974 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 07:46:23.877698 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524976 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 07:46:23.877698 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524980 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 07:46:23.877698 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524983 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 07:46:23.877698 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524985 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 07:46:23.877698 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524988 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 07:46:23.877698 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524991 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 07:46:23.877698 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524993 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 07:46:23.877698 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.524997 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 07:46:23.877698 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525001 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 07:46:23.877698 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525004 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 07:46:23.877698 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525007 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 07:46:23.877698 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525009 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 07:46:23.877698 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525012 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 07:46:23.877698 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525015 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 07:46:23.877698 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525017 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 07:46:23.877698 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525020 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 07:46:23.877698 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525023 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 07:46:23.877698 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525026 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 07:46:23.877698 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525028 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 07:46:23.878314 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525031 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 07:46:23.878314 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525034 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 07:46:23.878314 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525037 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 07:46:23.878314 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525040 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 05 07:46:23.878314 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525042 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 07:46:23.878314 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525044 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 07:46:23.878314 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525047 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 07:46:23.878314 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525050 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 07:46:23.878314 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525052 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 07:46:23.878314 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525054 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 07:46:23.878314 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525057 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 07:46:23.878314 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525060 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 07:46:23.878314 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525063 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 07:46:23.878314 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525065 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 07:46:23.878314 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525069 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 07:46:23.878314 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525072 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 07:46:23.878314 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525074 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 07:46:23.878314 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525077 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 07:46:23.878314 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525080 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 07:46:23.878314 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525082 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 07:46:23.878931 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525085 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 07:46:23.878931 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525088 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 07:46:23.878931 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525090 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 07:46:23.878931 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525093 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 07:46:23.878931 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525095 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 07:46:23.878931 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525098 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 07:46:23.878931 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525100 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 07:46:23.878931 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525103 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 07:46:23.878931 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525106 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 07:46:23.878931 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525108 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 07:46:23.878931 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525112 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 07:46:23.878931 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525115 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 07:46:23.878931 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525118 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 07:46:23.878931 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525122 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 07:46:23.878931 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525124 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 07:46:23.878931 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525127 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 07:46:23.878931 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525129 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 07:46:23.878931 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525132 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 07:46:23.878931 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525134 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 07:46:23.879560 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525137 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 07:46:23.879560 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525139 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 07:46:23.879560 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525142 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 07:46:23.879560 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525144 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 07:46:23.879560 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525147 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 07:46:23.879560 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525150 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 07:46:23.879560 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525152 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 07:46:23.879560 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525156 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 07:46:23.879560 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525158 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 07:46:23.879560 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525161 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 07:46:23.879560 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525163 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 07:46:23.879560 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525166 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 07:46:23.879560 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525168 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 07:46:23.879560 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525171 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 07:46:23.879560 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525174 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 07:46:23.879560 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525176 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 07:46:23.879560 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525179 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 07:46:23.879560 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525181 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 07:46:23.879560 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525184 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 07:46:23.879560 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.525186 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 07:46:23.880175 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.525917 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 05 07:46:23.880175 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.532406 2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 05 07:46:23.880175 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.532423 2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 05 07:46:23.880175 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.532441 2566 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 05 07:46:23.880175 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.532449 2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 05 07:46:23.880175 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532501 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 07:46:23.880175 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532507 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 07:46:23.880175 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532510 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 07:46:23.880175 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532514 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 07:46:23.880175 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532517 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 07:46:23.880175 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532520 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 07:46:23.880175 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532523 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 07:46:23.880175 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532526 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 07:46:23.880175 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532530 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 07:46:23.880801 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532535 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 07:46:23.880801 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532538 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 07:46:23.880801 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532540 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 07:46:23.880801 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532543 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 07:46:23.880801 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532546 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 07:46:23.880801 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532549 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 07:46:23.880801 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532551 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 07:46:23.880801 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532554 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 07:46:23.880801 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532556 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 07:46:23.880801 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532559 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 07:46:23.880801 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532561 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 07:46:23.880801 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532564 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 07:46:23.880801 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532566 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 07:46:23.880801 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532569 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 07:46:23.880801 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532571 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 07:46:23.880801 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532574 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 07:46:23.880801 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532576 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 07:46:23.880801 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532579 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 07:46:23.880801 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532582 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 07:46:23.971192 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532585 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 07:46:23.971192 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532588 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 07:46:23.971192 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532590 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 07:46:23.971192 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532593 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 07:46:23.971192 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532596 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 07:46:23.971192 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532599 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 07:46:23.971192 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532601 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 07:46:23.971192 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532605 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 07:46:23.971192 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532609 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 07:46:23.971192 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532612 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 07:46:23.971192 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532615 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 07:46:23.971192 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532618 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 07:46:23.971192 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532621 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 07:46:23.971192 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532624 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 07:46:23.971192 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532626 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 07:46:23.971192 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532629 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 07:46:23.971192 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532632 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 07:46:23.971192 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532635 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 07:46:23.971192 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532638 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 07:46:23.971823 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532640 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 07:46:23.971823 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532644 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 07:46:23.971823 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532647 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 07:46:23.971823 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532650 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 07:46:23.971823 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532652 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 07:46:23.971823 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532655 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 07:46:23.971823 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532658 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 07:46:23.971823 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532661 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 07:46:23.971823 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532663 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 07:46:23.971823 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532666 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 07:46:23.971823 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532669 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 07:46:23.971823 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532671 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 07:46:23.971823 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532674 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 07:46:23.971823 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532677 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 07:46:23.971823 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532679 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 07:46:23.971823 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532682 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 07:46:23.971823 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532687 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 07:46:23.971823 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532690 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 07:46:23.971823 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532694 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 07:46:23.971823 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532697 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 07:46:23.978170 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532700 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 07:46:23.978170 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532703 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 07:46:23.978170 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532705 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 07:46:23.978170 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532708 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 07:46:23.978170 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532710 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 07:46:23.978170 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532713 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 07:46:23.978170 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532715 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 07:46:23.978170 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532718 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 07:46:23.978170 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532720 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 07:46:23.978170 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532723 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 07:46:23.978170 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532726 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 07:46:23.978170 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532728 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 07:46:23.978170 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532731 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 05 07:46:23.978170 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532735 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 07:46:23.978170 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532738 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 07:46:23.978170 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532741 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 07:46:23.978170 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532743 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 07:46:23.978170 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532746 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 07:46:23.978170 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532748 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 07:46:23.978837 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532751 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 07:46:23.978837 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532753 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 07:46:23.978837 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532756 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 07:46:23.978837 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532759 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 07:46:23.978837 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532761 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 07:46:23.978837 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532764 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 07:46:23.978837 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532766 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 07:46:23.978837 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532769 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 07:46:23.978837 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532771 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 07:46:23.978837 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532775 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 07:46:23.978837 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532778 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 07:46:23.978837 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532782 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 07:46:23.978837 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532784 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 07:46:23.978837 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.532789 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 05 07:46:23.978837 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532893 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 07:46:23.979264 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532898 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 07:46:23.979264 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532901 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 07:46:23.979264 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532904 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 07:46:23.979264 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532906 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 07:46:23.979264 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532909 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 07:46:23.979264 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532912 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 07:46:23.979264 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532914 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 07:46:23.979264 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532918 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 07:46:23.979264 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532921 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 07:46:23.979264 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532924 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 07:46:23.979264 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532927 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 07:46:23.979264 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532930 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 07:46:23.979264 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532933 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 07:46:23.979264 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532935 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 07:46:23.979264 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532938 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 07:46:23.979264 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532941 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 07:46:23.979264 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532944 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 07:46:23.979264 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532947 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 07:46:23.979264 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532949 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 07:46:23.979903 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532952 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 07:46:23.979903 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532955 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 07:46:23.979903 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532959 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 07:46:23.979903 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532963 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 07:46:23.979903 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532966 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 07:46:23.979903 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532969 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 07:46:23.979903 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532971 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 07:46:23.979903 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532974 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 07:46:23.979903 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532979 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 07:46:23.979903 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532985 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 05 07:46:23.979903 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532988 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 07:46:23.979903 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532990 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 07:46:23.979903 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532993 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 07:46:23.979903 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532996 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 07:46:23.979903 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.532998 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 07:46:23.979903 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533001 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 07:46:23.979903 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533003 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 07:46:23.979903 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533006 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 07:46:23.979903 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533008 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 07:46:23.979903 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533011 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 07:46:23.980546 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533013 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 07:46:23.980546 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533016 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 07:46:23.980546 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533018 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 07:46:23.980546 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533021 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 07:46:23.980546 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533023 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 07:46:23.980546 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533026 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 07:46:23.980546 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533028 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 07:46:23.980546 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533031 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 07:46:23.980546 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533033 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 07:46:23.980546 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533036 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 07:46:23.980546 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533038 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 07:46:23.980546 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533041 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 07:46:23.980546 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533044 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 07:46:23.980546 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533046 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 07:46:23.980546 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533049 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 07:46:23.980546 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533051 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 07:46:23.980546 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533054 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 07:46:23.980546 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533056 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 07:46:23.980546 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533060 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 07:46:23.981180 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533063 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 07:46:23.981180 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533067 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 07:46:23.981180 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533071 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 07:46:23.981180 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533074 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 07:46:23.981180 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533077 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 07:46:23.981180 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533079 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 07:46:23.981180 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533082 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 07:46:23.981180 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533085 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 07:46:23.981180 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533087 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 07:46:23.981180 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533090 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 07:46:23.981180 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533092 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 07:46:23.981180 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533094 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 07:46:23.981180 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533097 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 07:46:23.981180 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533100 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 07:46:23.981180 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533103 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 07:46:23.981180 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533105 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 07:46:23.981180 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533108 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 07:46:23.981180 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533111 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 07:46:23.981180 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533113 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 07:46:23.981180 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533116 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 07:46:23.981809 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533118 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 07:46:23.981809 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533121 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 07:46:23.981809 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533123 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 07:46:23.981809 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533126 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 07:46:23.981809 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533128 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 07:46:23.981809 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533131 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 07:46:23.981809 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533133 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 07:46:23.981809 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533136 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 07:46:23.981809 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533138 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 07:46:23.981809 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533140 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 07:46:23.981809 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533143 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 07:46:23.981809 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533145 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 07:46:23.981809 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533148 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 07:46:23.981809 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533151 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 07:46:23.981809 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533155 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 07:46:23.981809 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533159 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 07:46:23.981809 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533161 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 07:46:23.981809 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533164 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 07:46:23.981809 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533166 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 07:46:23.981809 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:23.533169 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 07:46:23.982430 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.533173 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 05 07:46:23.982430 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.533262 2566 server.go:962] "Client rotation is on, will bootstrap in background" Jul 05 07:46:23.982430 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.536105 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 05 07:46:23.982430 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.537635 2566 server.go:1019] "Starting client certificate rotation" Jul 05 07:46:23.982430 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.537731 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 05 07:46:23.982430 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.537833 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 05 07:46:23.982430 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.542283 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 05 07:46:23.982430 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.543427 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 05 07:46:23.982430 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.553922 2566 log.go:25] "Validated CRI v1 runtime API" Jul 05 07:46:23.982430 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.556136 2566 log.go:25] "Validated CRI v1 image API" Jul 05 07:46:23.982430 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.559084 2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 05 07:46:23.982430 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.561552 2566 fs.go:135] Filesystem UUIDs: map[3da172b5-1cc5-4d44-883a-0f099e649240:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d2e7a264-7736-44e1-b34f-8b39eea4ea79:/dev/nvme0n1p3] Jul 05 07:46:23.982867 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.561566 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 05 07:46:23.983056 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.565503 2566 manager.go:216] Machine: {Timestamp:2026-07-05 07:46:23.565035806 +0000 UTC m=+0.352580104 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103530 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d96a381f85f8eda0449d87a4e062f SystemUUID:ec2d96a3-81f8-5f8e-da04-49d87a4e062f BootID:c1c81ed6-d921-4e71-8564-5a93e120c34a Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3d:c4:0b:d4:33 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3d:c4:0b:d4:33 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:1a:7e:c2:75:bb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 05 07:46:23.983056 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.565600 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 05 07:46:23.983056 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.565664 2566 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 05 07:46:23.983056 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.568571 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 05 07:46:23.983056 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.569120 2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 05 07:46:23.983056 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.569144 2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-31.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 05 07:46:23.983056 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.570649 2566 topology_manager.go:138] "Creating topology manager with none policy" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.570660 2566 container_manager_linux.go:309] "Creating device plugin manager" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.570668 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.571409 2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.573046 2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.576504 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.576642 2566 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.576677 2566 kubelet.go:486] "Attempting to sync node with API server" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.576690 2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.576712 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.576724 2566 kubelet.go:398] "Adding apiserver pod source" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.576735 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.577076 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.577091 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.581224 2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.585369 2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.585410 2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.586771 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b4fwx" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.590684 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.590699 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.590705 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.590711 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.590719 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.590725 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.590732 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.590737 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.590743 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.590749 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.590769 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.590774 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.590795 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.590800 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.593004 2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-31.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:23.593128 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-31.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:23.593268 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.593405 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b4fwx" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.595331 2566 server.go:1268] "Started kubelet" Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.595403 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.595408 2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 05 07:46:23.983300 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.595723 2566 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.597099 2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.597370 2566 server.go:310] "Adding debug handlers to kubelet server" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:23.601674 2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.604409 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.604411 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:23.604531 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-31.ec2.internal\" not found" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.605079 2566 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.605092 2566 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.605252 2566 reconstruct.go:97] "Volume reconstruction finished" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.605260 2566 reconciler.go:29] "Reconciler: start to sync state" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.605347 2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.607762 2566 factory.go:55] Registering systemd factory Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.607775 2566 factory.go:223] Registration of the systemd container factory successfully Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.607967 2566 factory.go:153] Registering CRI-O factory Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.607978 2566 factory.go:223] Registration of the crio container factory successfully Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.608014 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.608038 2566 factory.go:103] Registering Raw factory Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.608048 2566 manager.go:1196] Started watching for new ooms in manager Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.608128 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.608399 2566 manager.go:349] Starting recovery of all containers Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:23.610162 2566 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-31.ec2.internal\" not found" node="ip-10-0-142-31.ec2.internal" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.618142 2566 manager.go:354] Recovery completed Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.622404 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.624226 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-31.ec2.internal" event="NodeHasSufficientMemory" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.624251 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-31.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.624263 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-31.ec2.internal" event="NodeHasSufficientPID" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.624822 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.624827 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.624831 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.624846 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.625569 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-31.ec2.internal" event="NodeHasSufficientMemory" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.625600 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-31.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.625614 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-31.ec2.internal" event="NodeHasSufficientPID" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.625970 2566 policy_none.go:49] "None policy: Start" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.625983 2566 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.625992 2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.626967 2566 policy_none.go:47] "Start" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:23.705596 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-31.ec2.internal\" not found" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.708529 2566 manager.go:337] "Starting Device Plugin manager" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:23.708560 2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.708586 2566 server.go:87] "Starting device plugin registration server" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.708810 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 05 07:46:23.984452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.708821 2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.708913 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.708993 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.709002 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:23.709428 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:23.709476 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-31.ec2.internal\" not found" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.750421 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.751596 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.751628 2566 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.751647 2566 kubelet.go:2448] "Starting kubelet main sync loop" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:23.751677 2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.753499 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.809391 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.810117 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-31.ec2.internal" event="NodeHasSufficientMemory" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.810141 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-31.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.810150 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-31.ec2.internal" event="NodeHasSufficientPID" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.810170 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-31.ec2.internal" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.818643 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-31.ec2.internal" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:23.818662 2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-31.ec2.internal\": node \"ip-10-0-142-31.ec2.internal\" not found" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:23.834794 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-31.ec2.internal\" not found" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.852723 2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-31.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-31.ec2.internal"] Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.852869 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.853588 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-31.ec2.internal" event="NodeHasSufficientMemory" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.853614 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-31.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.853623 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-31.ec2.internal" event="NodeHasSufficientPID" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.854817 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.854924 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-31.ec2.internal" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.854948 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.855456 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-31.ec2.internal" event="NodeHasSufficientMemory" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.855473 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-31.ec2.internal" event="NodeHasSufficientMemory" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.855481 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-31.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.855492 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-31.ec2.internal" event="NodeHasSufficientPID" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.855493 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-31.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.855633 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-31.ec2.internal" event="NodeHasSufficientPID" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.858960 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-31.ec2.internal" Jul 05 07:46:23.985732 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.858980 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 07:46:23.986803 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.861137 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-31.ec2.internal" event="NodeHasSufficientMemory" Jul 05 07:46:23.986803 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.861400 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-31.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 07:46:23.986803 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.861416 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-31.ec2.internal" event="NodeHasSufficientPID" Jul 05 07:46:23.986803 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:23.883847 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-31.ec2.internal\" not found" node="ip-10-0-142-31.ec2.internal" Jul 05 07:46:23.986803 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:23.889816 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-31.ec2.internal\" not found" node="ip-10-0-142-31.ec2.internal" Jul 05 07:46:23.986803 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.907025 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b889babd03ac98faf589183734c44eef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-31.ec2.internal\" (UID: \"b889babd03ac98faf589183734c44eef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-31.ec2.internal" Jul 05 07:46:23.986803 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.907051 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b889babd03ac98faf589183734c44eef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-31.ec2.internal\" (UID: \"b889babd03ac98faf589183734c44eef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-31.ec2.internal" Jul 05 07:46:23.986803 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:23.907069 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4da58462e79ad0d87f76c33f35ac75ff-config\") pod \"kube-apiserver-proxy-ip-10-0-142-31.ec2.internal\" (UID: \"4da58462e79ad0d87f76c33f35ac75ff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-31.ec2.internal" Jul 05 07:46:23.986803 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:23.935695 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-31.ec2.internal\" not found" Jul 05 07:46:24.065615 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:24.007923 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4da58462e79ad0d87f76c33f35ac75ff-config\") pod \"kube-apiserver-proxy-ip-10-0-142-31.ec2.internal\" (UID: \"4da58462e79ad0d87f76c33f35ac75ff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-31.ec2.internal" Jul 05 07:46:24.065615 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:24.007946 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b889babd03ac98faf589183734c44eef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-31.ec2.internal\" (UID: \"b889babd03ac98faf589183734c44eef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-31.ec2.internal" Jul 05 07:46:24.065615 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:24.007961 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b889babd03ac98faf589183734c44eef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-31.ec2.internal\" (UID: \"b889babd03ac98faf589183734c44eef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-31.ec2.internal" Jul 05 07:46:24.065615 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:24.007999 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b889babd03ac98faf589183734c44eef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-31.ec2.internal\" (UID: \"b889babd03ac98faf589183734c44eef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-31.ec2.internal" Jul 05 07:46:24.065615 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:24.008024 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4da58462e79ad0d87f76c33f35ac75ff-config\") pod \"kube-apiserver-proxy-ip-10-0-142-31.ec2.internal\" (UID: \"4da58462e79ad0d87f76c33f35ac75ff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-31.ec2.internal" Jul 05 07:46:24.065615 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:24.008029 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b889babd03ac98faf589183734c44eef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-31.ec2.internal\" (UID: \"b889babd03ac98faf589183734c44eef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-31.ec2.internal" Jul 05 07:46:24.065615 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:24.035939 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-31.ec2.internal\" not found" Jul 05 07:46:24.169619 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:24.136634 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-31.ec2.internal\" not found" Jul 05 07:46:24.253860 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:24.186710 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-31.ec2.internal" Jul 05 07:46:24.253860 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:24.193261 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-31.ec2.internal" Jul 05 07:46:24.253860 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:24.237221 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-31.ec2.internal\" not found" Jul 05 07:46:24.368643 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:24.337646 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-31.ec2.internal\" not found" Jul 05 07:46:24.491589 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:24.413004 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 07:46:25.964329 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.873439 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-31.ec2.internal" Jul 05 07:46:25.964329 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.891053 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 05 07:46:25.964329 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.892685 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-31.ec2.internal" Jul 05 07:46:25.964329 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.905077 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 05 07:46:25.964329 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.906141 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 05 07:46:25.964329 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.906228 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 05 07:46:25.964329 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.906268 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 05 07:46:25.964329 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.906279 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 05 07:46:25.964329 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.945068 2566 apiserver.go:52] "Watching apiserver" Jul 05 07:46:25.967449 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.966868 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-04 07:41:24 +0000 UTC" deadline="2028-03-27 17:46:43.975812344 +0000 UTC" Jul 05 07:46:25.967449 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.966900 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15154h0m18.008914598s" Jul 05 07:46:25.969765 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.969209 2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 05 07:46:25.969765 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.969623 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc6pw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-31.ec2.internal","openshift-multus/multus-additional-cni-plugins-9dnrn","openshift-multus/multus-zgccj","openshift-network-diagnostics/network-check-target-2wssl","kube-system/global-pull-secret-syncer-qmlxc","openshift-cluster-node-tuning-operator/tuned-thrp6","openshift-dns/node-resolver-q7zq5","openshift-image-registry/node-ca-z2h2b","openshift-multus/network-metrics-daemon-mt69q","openshift-network-operator/iptables-alerter-wnrk5","openshift-ovn-kubernetes/ovnkube-node-hzvp7","kube-system/konnectivity-agent-6s2tr","kube-system/kube-apiserver-proxy-ip-10-0-142-31.ec2.internal"] Jul 05 07:46:26.042913 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.971734 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc6pw" Jul 05 07:46:26.042913 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.972650 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 05 07:46:26.042913 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.972887 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9dnrn" Jul 05 07:46:26.042913 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.974275 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 05 07:46:26.042913 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.974283 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6qchq\"" Jul 05 07:46:26.042913 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.974320 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.042913 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.974445 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 05 07:46:26.042913 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.974490 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 05 07:46:26.042913 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.975526 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mv9vt\"" Jul 05 07:46:26.042913 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.975544 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 05 07:46:26.042913 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.975597 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 05 07:46:26.042913 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.975609 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 05 07:46:26.042913 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.975597 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 05 07:46:26.042913 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.975717 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:46:26.042913 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:25.975779 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wssl" podUID="8a151452-12d5-4a93-bffb-e93ee92e8e14" Jul 05 07:46:26.042913 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.975832 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 05 07:46:26.042913 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.976585 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:26.042913 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:25.976674 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qmlxc" podUID="9eda60f4-0409-4ba2-882a-0fc06614194b" Jul 05 07:46:26.042913 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.976789 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9mphc\"" Jul 05 07:46:26.042913 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.976813 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 05 07:46:26.042913 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.979818 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6mf6\" (UniqueName: \"kubernetes.io/projected/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-kube-api-access-x6mf6\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.042913 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.979840 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2eb183c3-5aec-4b47-827c-5cd3d1185bdf-socket-dir\") pod \"aws-ebs-csi-driver-node-kc6pw\" (UID: \"2eb183c3-5aec-4b47-827c-5cd3d1185bdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc6pw" Jul 05 07:46:26.042913 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.979857 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2eb183c3-5aec-4b47-827c-5cd3d1185bdf-device-dir\") pod \"aws-ebs-csi-driver-node-kc6pw\" (UID: \"2eb183c3-5aec-4b47-827c-5cd3d1185bdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc6pw" Jul 05 07:46:26.044151 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.979870 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2eb183c3-5aec-4b47-827c-5cd3d1185bdf-sys-fs\") pod \"aws-ebs-csi-driver-node-kc6pw\" (UID: \"2eb183c3-5aec-4b47-827c-5cd3d1185bdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc6pw" Jul 05 07:46:26.044151 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.979887 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9bcc734-1c69-432f-bcb6-f2e88175856c-cni-binary-copy\") pod \"multus-additional-cni-plugins-9dnrn\" (UID: \"b9bcc734-1c69-432f-bcb6-f2e88175856c\") " pod="openshift-multus/multus-additional-cni-plugins-9dnrn" Jul 05 07:46:26.044151 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.979910 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpw6m\" (UniqueName: \"kubernetes.io/projected/b9bcc734-1c69-432f-bcb6-f2e88175856c-kube-api-access-wpw6m\") pod \"multus-additional-cni-plugins-9dnrn\" (UID: \"b9bcc734-1c69-432f-bcb6-f2e88175856c\") " pod="openshift-multus/multus-additional-cni-plugins-9dnrn" Jul 05 07:46:26.044151 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.979933 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-host-var-lib-kubelet\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.044151 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.979954 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9bcc734-1c69-432f-bcb6-f2e88175856c-system-cni-dir\") pod \"multus-additional-cni-plugins-9dnrn\" (UID: \"b9bcc734-1c69-432f-bcb6-f2e88175856c\") " pod="openshift-multus/multus-additional-cni-plugins-9dnrn" Jul 05 07:46:26.044151 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.979973 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-host-var-lib-cni-bin\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.044151 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.979987 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2eb183c3-5aec-4b47-827c-5cd3d1185bdf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kc6pw\" (UID: \"2eb183c3-5aec-4b47-827c-5cd3d1185bdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc6pw" Jul 05 07:46:26.044151 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.980002 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9bcc734-1c69-432f-bcb6-f2e88175856c-os-release\") pod \"multus-additional-cni-plugins-9dnrn\" (UID: \"b9bcc734-1c69-432f-bcb6-f2e88175856c\") " pod="openshift-multus/multus-additional-cni-plugins-9dnrn" Jul 05 07:46:26.044151 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.980020 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-os-release\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.044151 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.980033 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-hostroot\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.044151 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.980049 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-host-run-multus-certs\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.044151 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.980064 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-host-run-k8s-cni-cncf-io\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.044151 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.980092 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2eb183c3-5aec-4b47-827c-5cd3d1185bdf-registration-dir\") pod \"aws-ebs-csi-driver-node-kc6pw\" (UID: \"2eb183c3-5aec-4b47-827c-5cd3d1185bdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc6pw" Jul 05 07:46:26.045527 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.980117 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x52v9\" (UniqueName: \"kubernetes.io/projected/2eb183c3-5aec-4b47-827c-5cd3d1185bdf-kube-api-access-x52v9\") pod \"aws-ebs-csi-driver-node-kc6pw\" (UID: \"2eb183c3-5aec-4b47-827c-5cd3d1185bdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc6pw" Jul 05 07:46:26.045527 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.980146 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9bcc734-1c69-432f-bcb6-f2e88175856c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9dnrn\" (UID: \"b9bcc734-1c69-432f-bcb6-f2e88175856c\") " pod="openshift-multus/multus-additional-cni-plugins-9dnrn" Jul 05 07:46:26.045527 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.980166 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9bcc734-1c69-432f-bcb6-f2e88175856c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9dnrn\" (UID: \"b9bcc734-1c69-432f-bcb6-f2e88175856c\") " pod="openshift-multus/multus-additional-cni-plugins-9dnrn" Jul 05 07:46:26.045527 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.980182 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-cnibin\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.045527 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.980195 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-multus-conf-dir\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.045527 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.980218 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-multus-daemon-config\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.045527 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.980238 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9bcc734-1c69-432f-bcb6-f2e88175856c-cnibin\") pod \"multus-additional-cni-plugins-9dnrn\" (UID: \"b9bcc734-1c69-432f-bcb6-f2e88175856c\") " pod="openshift-multus/multus-additional-cni-plugins-9dnrn" Jul 05 07:46:26.045527 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.980259 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9bcc734-1c69-432f-bcb6-f2e88175856c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9dnrn\" (UID: \"b9bcc734-1c69-432f-bcb6-f2e88175856c\") " pod="openshift-multus/multus-additional-cni-plugins-9dnrn" Jul 05 07:46:26.045527 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.980277 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-system-cni-dir\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.045527 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.980292 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-cni-binary-copy\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.045527 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.980317 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-host-var-lib-cni-multus\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.045527 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.980350 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2eb183c3-5aec-4b47-827c-5cd3d1185bdf-etc-selinux\") pod \"aws-ebs-csi-driver-node-kc6pw\" (UID: \"2eb183c3-5aec-4b47-827c-5cd3d1185bdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc6pw" Jul 05 07:46:26.045527 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.980372 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-multus-cni-dir\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.046189 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.980391 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-multus-socket-dir-parent\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.046189 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.980406 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-etc-kubernetes\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.046189 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.980421 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-host-run-netns\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.046189 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.982753 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 05 07:46:26.046189 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.985942 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.046189 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.987191 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q7zq5" Jul 05 07:46:26.046189 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.988402 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 05 07:46:26.046189 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.988432 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 05 07:46:26.046189 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.988437 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nqvxz\"" Jul 05 07:46:26.046189 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.988611 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z2h2b" Jul 05 07:46:26.046189 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.989755 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 05 07:46:26.046189 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.989847 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 05 07:46:26.046189 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.989909 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:46:26.046189 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:25.989968 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mt69q" podUID="2b6430fa-c37c-4cc9-81ab-3feb7300273e" Jul 05 07:46:26.046189 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.990059 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-94jl5\"" Jul 05 07:46:26.046189 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.990893 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jp5kh\"" Jul 05 07:46:26.046189 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.991099 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 05 07:46:26.046189 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.991110 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wnrk5" Jul 05 07:46:26.046189 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.991126 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 05 07:46:26.046189 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.991714 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 05 07:46:26.046189 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:25.998924 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.046189 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.028202 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6s2tr" Jul 05 07:46:26.046189 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.028503 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-f4dvb\"" Jul 05 07:46:26.046189 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.028558 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lqgrl" Jul 05 07:46:26.046189 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.028577 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lqgrl" Jul 05 07:46:26.046189 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.028602 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 05 07:46:26.046189 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.028808 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 05 07:46:26.047577 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.029598 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 05 07:46:26.047577 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.030071 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 05 07:46:26.047577 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.031293 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 05 07:46:26.047577 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.031671 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 05 07:46:26.047577 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.032671 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 05 07:46:26.047577 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.033323 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vkb8t\"" Jul 05 07:46:26.047577 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.033778 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 05 07:46:26.047577 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.033793 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 05 07:46:26.047577 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.033826 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 05 07:46:26.047577 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.033826 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bq4qx\"" Jul 05 07:46:26.047577 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.042172 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 05 07:46:26.140426 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.073981 2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 05 07:46:26.140426 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.080737 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-etc-kubernetes\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.140426 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.080759 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs\") pod \"network-metrics-daemon-mt69q\" (UID: \"2b6430fa-c37c-4cc9-81ab-3feb7300273e\") " pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:46:26.140426 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.080775 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rd76\" (UniqueName: \"kubernetes.io/projected/2b6430fa-c37c-4cc9-81ab-3feb7300273e-kube-api-access-7rd76\") pod \"network-metrics-daemon-mt69q\" (UID: \"2b6430fa-c37c-4cc9-81ab-3feb7300273e\") " pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:46:26.140426 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.080796 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-run-openvswitch\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.140426 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.080822 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9bcc734-1c69-432f-bcb6-f2e88175856c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9dnrn\" (UID: \"b9bcc734-1c69-432f-bcb6-f2e88175856c\") " pod="openshift-multus/multus-additional-cni-plugins-9dnrn" Jul 05 07:46:26.140426 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.080839 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-multus-conf-dir\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.140426 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.080876 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-multus-daemon-config\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.140426 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.080906 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-multus-conf-dir\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.140426 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.080941 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-var-lib-kubelet\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.140426 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.080971 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/917e3b12-6478-4463-a3e1-b63829bf2c84-iptables-alerter-script\") pod \"iptables-alerter-wnrk5\" (UID: \"917e3b12-6478-4463-a3e1-b63829bf2c84\") " pod="openshift-network-operator/iptables-alerter-wnrk5" Jul 05 07:46:26.140426 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.080995 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/917e3b12-6478-4463-a3e1-b63829bf2c84-host-slash\") pod \"iptables-alerter-wnrk5\" (UID: \"917e3b12-6478-4463-a3e1-b63829bf2c84\") " pod="openshift-network-operator/iptables-alerter-wnrk5" Jul 05 07:46:26.140426 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081005 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9bcc734-1c69-432f-bcb6-f2e88175856c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9dnrn\" (UID: \"b9bcc734-1c69-432f-bcb6-f2e88175856c\") " pod="openshift-multus/multus-additional-cni-plugins-9dnrn" Jul 05 07:46:26.140426 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081034 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdf48\" (UniqueName: \"kubernetes.io/projected/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-kube-api-access-wdf48\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.141864 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081061 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9bcc734-1c69-432f-bcb6-f2e88175856c-cnibin\") pod \"multus-additional-cni-plugins-9dnrn\" (UID: \"b9bcc734-1c69-432f-bcb6-f2e88175856c\") " pod="openshift-multus/multus-additional-cni-plugins-9dnrn" Jul 05 07:46:26.141864 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081077 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9bcc734-1c69-432f-bcb6-f2e88175856c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9dnrn\" (UID: \"b9bcc734-1c69-432f-bcb6-f2e88175856c\") " pod="openshift-multus/multus-additional-cni-plugins-9dnrn" Jul 05 07:46:26.141864 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081092 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-system-cni-dir\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.141864 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081178 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-host-var-lib-cni-multus\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.141864 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081206 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-run-ovn\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.141864 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081213 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-system-cni-dir\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.141864 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081218 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9bcc734-1c69-432f-bcb6-f2e88175856c-cnibin\") pod \"multus-additional-cni-plugins-9dnrn\" (UID: \"b9bcc734-1c69-432f-bcb6-f2e88175856c\") " pod="openshift-multus/multus-additional-cni-plugins-9dnrn" Jul 05 07:46:26.141864 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081229 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0a695ef6-9710-4847-bde7-ae627055ffab-serviceca\") pod \"node-ca-z2h2b\" (UID: \"0a695ef6-9710-4847-bde7-ae627055ffab\") " pod="openshift-image-registry/node-ca-z2h2b" Jul 05 07:46:26.141864 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081266 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-host-var-lib-cni-multus\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.141864 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081274 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2eb183c3-5aec-4b47-827c-5cd3d1185bdf-etc-selinux\") pod \"aws-ebs-csi-driver-node-kc6pw\" (UID: \"2eb183c3-5aec-4b47-827c-5cd3d1185bdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc6pw" Jul 05 07:46:26.141864 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081316 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-multus-cni-dir\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.141864 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081350 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-lib-modules\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.141864 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081378 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-host\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.141864 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081404 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-tmp\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.142419 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081427 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-env-overrides\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.142419 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081449 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2eb183c3-5aec-4b47-827c-5cd3d1185bdf-etc-selinux\") pod \"aws-ebs-csi-driver-node-kc6pw\" (UID: \"2eb183c3-5aec-4b47-827c-5cd3d1185bdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc6pw" Jul 05 07:46:26.142419 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081453 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-host-run-netns\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.142419 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081476 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-etc-sysctl-d\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.142419 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081492 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a50d8e5b-1a7b-4028-846e-73a293b0e9e2-hosts-file\") pod \"node-resolver-q7zq5\" (UID: \"a50d8e5b-1a7b-4028-846e-73a293b0e9e2\") " pod="openshift-dns/node-resolver-q7zq5" Jul 05 07:46:26.142419 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081509 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-multus-cni-dir\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.142419 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081515 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87z7b\" (UniqueName: \"kubernetes.io/projected/917e3b12-6478-4463-a3e1-b63829bf2c84-kube-api-access-87z7b\") pod \"iptables-alerter-wnrk5\" (UID: \"917e3b12-6478-4463-a3e1-b63829bf2c84\") " pod="openshift-network-operator/iptables-alerter-wnrk5" Jul 05 07:46:26.142419 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081552 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-node-log\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.142419 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081557 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-host-run-netns\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.142419 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081575 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-multus-daemon-config\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.142419 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081587 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13a9ecf4-ffb1-4611-99bc-e629936bab5d-agent-certs\") pod \"konnectivity-agent-6s2tr\" (UID: \"13a9ecf4-ffb1-4611-99bc-e629936bab5d\") " pod="kube-system/konnectivity-agent-6s2tr" Jul 05 07:46:26.142419 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081611 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13a9ecf4-ffb1-4611-99bc-e629936bab5d-konnectivity-ca\") pod \"konnectivity-agent-6s2tr\" (UID: \"13a9ecf4-ffb1-4611-99bc-e629936bab5d\") " pod="kube-system/konnectivity-agent-6s2tr" Jul 05 07:46:26.142419 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081632 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2eb183c3-5aec-4b47-827c-5cd3d1185bdf-socket-dir\") pod \"aws-ebs-csi-driver-node-kc6pw\" (UID: \"2eb183c3-5aec-4b47-827c-5cd3d1185bdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc6pw" Jul 05 07:46:26.142419 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081635 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9bcc734-1c69-432f-bcb6-f2e88175856c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9dnrn\" (UID: \"b9bcc734-1c69-432f-bcb6-f2e88175856c\") " pod="openshift-multus/multus-additional-cni-plugins-9dnrn" Jul 05 07:46:26.143067 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081654 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2eb183c3-5aec-4b47-827c-5cd3d1185bdf-sys-fs\") pod \"aws-ebs-csi-driver-node-kc6pw\" (UID: \"2eb183c3-5aec-4b47-827c-5cd3d1185bdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc6pw" Jul 05 07:46:26.143067 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081670 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9bcc734-1c69-432f-bcb6-f2e88175856c-cni-binary-copy\") pod \"multus-additional-cni-plugins-9dnrn\" (UID: \"b9bcc734-1c69-432f-bcb6-f2e88175856c\") " pod="openshift-multus/multus-additional-cni-plugins-9dnrn" Jul 05 07:46:26.143067 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081722 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2eb183c3-5aec-4b47-827c-5cd3d1185bdf-sys-fs\") pod \"aws-ebs-csi-driver-node-kc6pw\" (UID: \"2eb183c3-5aec-4b47-827c-5cd3d1185bdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc6pw" Jul 05 07:46:26.143067 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081734 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpw6m\" (UniqueName: \"kubernetes.io/projected/b9bcc734-1c69-432f-bcb6-f2e88175856c-kube-api-access-wpw6m\") pod \"multus-additional-cni-plugins-9dnrn\" (UID: \"b9bcc734-1c69-432f-bcb6-f2e88175856c\") " pod="openshift-multus/multus-additional-cni-plugins-9dnrn" Jul 05 07:46:26.143067 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081763 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2eb183c3-5aec-4b47-827c-5cd3d1185bdf-socket-dir\") pod \"aws-ebs-csi-driver-node-kc6pw\" (UID: \"2eb183c3-5aec-4b47-827c-5cd3d1185bdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc6pw" Jul 05 07:46:26.143067 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081764 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-etc-sysconfig\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.143067 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081793 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57nd9\" (UniqueName: \"kubernetes.io/projected/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-kube-api-access-57nd9\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.143067 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081823 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9bcc734-1c69-432f-bcb6-f2e88175856c-system-cni-dir\") pod \"multus-additional-cni-plugins-9dnrn\" (UID: \"b9bcc734-1c69-432f-bcb6-f2e88175856c\") " pod="openshift-multus/multus-additional-cni-plugins-9dnrn" Jul 05 07:46:26.143067 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081878 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-etc-sysctl-conf\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.143067 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081882 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9bcc734-1c69-432f-bcb6-f2e88175856c-system-cni-dir\") pod \"multus-additional-cni-plugins-9dnrn\" (UID: \"b9bcc734-1c69-432f-bcb6-f2e88175856c\") " pod="openshift-multus/multus-additional-cni-plugins-9dnrn" Jul 05 07:46:26.143067 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081903 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-etc-tuned\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.143067 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081935 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-host-var-lib-cni-bin\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.143067 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081960 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-etc-modprobe-d\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.143067 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.081981 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-run\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.143562 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082002 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-systemd-units\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.143562 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082031 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-host-var-lib-cni-bin\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.143562 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082039 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2eb183c3-5aec-4b47-827c-5cd3d1185bdf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kc6pw\" (UID: \"2eb183c3-5aec-4b47-827c-5cd3d1185bdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc6pw" Jul 05 07:46:26.143562 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082072 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9bcc734-1c69-432f-bcb6-f2e88175856c-os-release\") pod \"multus-additional-cni-plugins-9dnrn\" (UID: \"b9bcc734-1c69-432f-bcb6-f2e88175856c\") " pod="openshift-multus/multus-additional-cni-plugins-9dnrn" Jul 05 07:46:26.143562 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082086 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2eb183c3-5aec-4b47-827c-5cd3d1185bdf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kc6pw\" (UID: \"2eb183c3-5aec-4b47-827c-5cd3d1185bdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc6pw" Jul 05 07:46:26.143562 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082124 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-os-release\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.143562 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082165 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9bcc734-1c69-432f-bcb6-f2e88175856c-cni-binary-copy\") pod \"multus-additional-cni-plugins-9dnrn\" (UID: \"b9bcc734-1c69-432f-bcb6-f2e88175856c\") " pod="openshift-multus/multus-additional-cni-plugins-9dnrn" Jul 05 07:46:26.143562 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082175 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-os-release\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.143562 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082168 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-hostroot\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.143562 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082203 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-hostroot\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.143562 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082210 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9bcc734-1c69-432f-bcb6-f2e88175856c-os-release\") pod \"multus-additional-cni-plugins-9dnrn\" (UID: \"b9bcc734-1c69-432f-bcb6-f2e88175856c\") " pod="openshift-multus/multus-additional-cni-plugins-9dnrn" Jul 05 07:46:26.143562 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082227 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-host-cni-bin\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.143562 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082245 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-host-run-k8s-cni-cncf-io\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.143562 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082267 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2eb183c3-5aec-4b47-827c-5cd3d1185bdf-registration-dir\") pod \"aws-ebs-csi-driver-node-kc6pw\" (UID: \"2eb183c3-5aec-4b47-827c-5cd3d1185bdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc6pw" Jul 05 07:46:26.144328 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082282 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x52v9\" (UniqueName: \"kubernetes.io/projected/2eb183c3-5aec-4b47-827c-5cd3d1185bdf-kube-api-access-x52v9\") pod \"aws-ebs-csi-driver-node-kc6pw\" (UID: \"2eb183c3-5aec-4b47-827c-5cd3d1185bdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc6pw" Jul 05 07:46:26.144328 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082297 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9bcc734-1c69-432f-bcb6-f2e88175856c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9dnrn\" (UID: \"b9bcc734-1c69-432f-bcb6-f2e88175856c\") " pod="openshift-multus/multus-additional-cni-plugins-9dnrn" Jul 05 07:46:26.144328 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082316 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-cnibin\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.144328 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082322 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2eb183c3-5aec-4b47-827c-5cd3d1185bdf-registration-dir\") pod \"aws-ebs-csi-driver-node-kc6pw\" (UID: \"2eb183c3-5aec-4b47-827c-5cd3d1185bdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc6pw" Jul 05 07:46:26.144328 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082339 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-run-systemd\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.144328 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082361 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-etc-openvswitch\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.144328 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082362 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-host-run-k8s-cni-cncf-io\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.144328 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082373 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-cnibin\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.144328 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082391 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc2jr\" (UniqueName: \"kubernetes.io/projected/0a695ef6-9710-4847-bde7-ae627055ffab-kube-api-access-dc2jr\") pod \"node-ca-z2h2b\" (UID: \"0a695ef6-9710-4847-bde7-ae627055ffab\") " pod="openshift-image-registry/node-ca-z2h2b" Jul 05 07:46:26.144328 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082457 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-cni-binary-copy\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.144328 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082503 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gdch\" (UniqueName: \"kubernetes.io/projected/8a151452-12d5-4a93-bffb-e93ee92e8e14-kube-api-access-7gdch\") pod \"network-check-target-2wssl\" (UID: \"8a151452-12d5-4a93-bffb-e93ee92e8e14\") " pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:46:26.144328 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082546 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a50d8e5b-1a7b-4028-846e-73a293b0e9e2-tmp-dir\") pod \"node-resolver-q7zq5\" (UID: \"a50d8e5b-1a7b-4028-846e-73a293b0e9e2\") " pod="openshift-dns/node-resolver-q7zq5" Jul 05 07:46:26.144328 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082566 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-host-kubelet\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.144328 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082582 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-multus-socket-dir-parent\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.144861 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082600 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-etc-kubernetes\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.144861 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082618 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-host-run-ovn-kubernetes\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.144861 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082634 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-ovnkube-config\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.144861 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082645 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-multus-socket-dir-parent\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.144861 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082656 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-etc-kubernetes\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.144861 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082651 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6mf6\" (UniqueName: \"kubernetes.io/projected/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-kube-api-access-x6mf6\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.144861 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082709 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9eda60f4-0409-4ba2-882a-0fc06614194b-kubelet-config\") pod \"global-pull-secret-syncer-qmlxc\" (UID: \"9eda60f4-0409-4ba2-882a-0fc06614194b\") " pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:26.144861 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082744 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9bcc734-1c69-432f-bcb6-f2e88175856c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9dnrn\" (UID: \"b9bcc734-1c69-432f-bcb6-f2e88175856c\") " pod="openshift-multus/multus-additional-cni-plugins-9dnrn" Jul 05 07:46:26.144861 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082778 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-etc-systemd\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.144861 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082809 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-host-cni-netd\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.144861 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082834 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.144861 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082859 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-ovnkube-script-lib\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.144861 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082893 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2eb183c3-5aec-4b47-827c-5cd3d1185bdf-device-dir\") pod \"aws-ebs-csi-driver-node-kc6pw\" (UID: \"2eb183c3-5aec-4b47-827c-5cd3d1185bdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc6pw" Jul 05 07:46:26.144861 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082916 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-cni-binary-copy\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.145302 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082919 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-host-var-lib-kubelet\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.145302 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082940 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2eb183c3-5aec-4b47-827c-5cd3d1185bdf-device-dir\") pod \"aws-ebs-csi-driver-node-kc6pw\" (UID: \"2eb183c3-5aec-4b47-827c-5cd3d1185bdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc6pw" Jul 05 07:46:26.145302 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082966 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-host-var-lib-kubelet\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.145302 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.082980 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-sys\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.145302 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.083008 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-host-slash\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.145302 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.083025 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-var-lib-openvswitch\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.145302 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.083038 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a695ef6-9710-4847-bde7-ae627055ffab-host\") pod \"node-ca-z2h2b\" (UID: \"0a695ef6-9710-4847-bde7-ae627055ffab\") " pod="openshift-image-registry/node-ca-z2h2b" Jul 05 07:46:26.145302 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.083052 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-host-run-netns\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.145302 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.083065 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-log-socket\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.145302 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.083078 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9eda60f4-0409-4ba2-882a-0fc06614194b-dbus\") pod \"global-pull-secret-syncer-qmlxc\" (UID: \"9eda60f4-0409-4ba2-882a-0fc06614194b\") " pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:26.145302 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.083106 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzcxq\" (UniqueName: \"kubernetes.io/projected/a50d8e5b-1a7b-4028-846e-73a293b0e9e2-kube-api-access-zzcxq\") pod \"node-resolver-q7zq5\" (UID: \"a50d8e5b-1a7b-4028-846e-73a293b0e9e2\") " pod="openshift-dns/node-resolver-q7zq5" Jul 05 07:46:26.145302 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.083164 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-ovn-node-metrics-cert\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.145302 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.083191 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-host-run-multus-certs\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.145302 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.083206 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9eda60f4-0409-4ba2-882a-0fc06614194b-original-pull-secret\") pod \"global-pull-secret-syncer-qmlxc\" (UID: \"9eda60f4-0409-4ba2-882a-0fc06614194b\") " pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:26.145788 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.083236 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-host-run-multus-certs\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.145788 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.088518 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 05 07:46:26.145788 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.091666 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpw6m\" (UniqueName: \"kubernetes.io/projected/b9bcc734-1c69-432f-bcb6-f2e88175856c-kube-api-access-wpw6m\") pod \"multus-additional-cni-plugins-9dnrn\" (UID: \"b9bcc734-1c69-432f-bcb6-f2e88175856c\") " pod="openshift-multus/multus-additional-cni-plugins-9dnrn" Jul 05 07:46:26.145788 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.091686 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6mf6\" (UniqueName: \"kubernetes.io/projected/cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece-kube-api-access-x6mf6\") pod \"multus-zgccj\" (UID: \"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece\") " pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.145788 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.091781 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x52v9\" (UniqueName: \"kubernetes.io/projected/2eb183c3-5aec-4b47-827c-5cd3d1185bdf-kube-api-access-x52v9\") pod \"aws-ebs-csi-driver-node-kc6pw\" (UID: \"2eb183c3-5aec-4b47-827c-5cd3d1185bdf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc6pw" Jul 05 07:46:26.145788 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.119459 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zgccj" Jul 05 07:46:26.210532 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:26.150233 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4da58462e79ad0d87f76c33f35ac75ff.slice/crio-2287a717a883a5b8804e4f943a923f04eb0a76ec5f2fe9342894eeedac7f0fb2 WatchSource:0}: Error finding container 2287a717a883a5b8804e4f943a923f04eb0a76ec5f2fe9342894eeedac7f0fb2: Status 404 returned error can't find the container with id 2287a717a883a5b8804e4f943a923f04eb0a76ec5f2fe9342894eeedac7f0fb2 Jul 05 07:46:26.210532 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:26.150493 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb889babd03ac98faf589183734c44eef.slice/crio-7595616a5dc55076f3b55939ceba10e0497513d80588f2dcba09b3e20d9186ef WatchSource:0}: Error finding container 7595616a5dc55076f3b55939ceba10e0497513d80588f2dcba09b3e20d9186ef: Status 404 returned error can't find the container with id 7595616a5dc55076f3b55939ceba10e0497513d80588f2dcba09b3e20d9186ef Jul 05 07:46:26.210532 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:26.150663 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbab082f_f8ce_41bc_8e3b_eee2fe0c1ece.slice/crio-1cd55966095bd7a27411ee2508e7ae50d3a61129fc725c6dbf25a663ef10449f WatchSource:0}: Error finding container 1cd55966095bd7a27411ee2508e7ae50d3a61129fc725c6dbf25a663ef10449f: Status 404 returned error can't find the container with id 1cd55966095bd7a27411ee2508e7ae50d3a61129fc725c6dbf25a663ef10449f Jul 05 07:46:26.210532 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.183699 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a50d8e5b-1a7b-4028-846e-73a293b0e9e2-hosts-file\") pod \"node-resolver-q7zq5\" (UID: \"a50d8e5b-1a7b-4028-846e-73a293b0e9e2\") " pod="openshift-dns/node-resolver-q7zq5" Jul 05 07:46:26.210532 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.183728 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87z7b\" (UniqueName: \"kubernetes.io/projected/917e3b12-6478-4463-a3e1-b63829bf2c84-kube-api-access-87z7b\") pod \"iptables-alerter-wnrk5\" (UID: \"917e3b12-6478-4463-a3e1-b63829bf2c84\") " pod="openshift-network-operator/iptables-alerter-wnrk5" Jul 05 07:46:26.210532 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.183749 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-node-log\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.210532 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.183769 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13a9ecf4-ffb1-4611-99bc-e629936bab5d-agent-certs\") pod \"konnectivity-agent-6s2tr\" (UID: \"13a9ecf4-ffb1-4611-99bc-e629936bab5d\") " pod="kube-system/konnectivity-agent-6s2tr" Jul 05 07:46:26.210532 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.183789 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13a9ecf4-ffb1-4611-99bc-e629936bab5d-konnectivity-ca\") pod \"konnectivity-agent-6s2tr\" (UID: \"13a9ecf4-ffb1-4611-99bc-e629936bab5d\") " pod="kube-system/konnectivity-agent-6s2tr" Jul 05 07:46:26.210532 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.183815 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a50d8e5b-1a7b-4028-846e-73a293b0e9e2-hosts-file\") pod \"node-resolver-q7zq5\" (UID: \"a50d8e5b-1a7b-4028-846e-73a293b0e9e2\") " pod="openshift-dns/node-resolver-q7zq5" Jul 05 07:46:26.210532 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.183826 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-node-log\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.210532 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.183881 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-etc-sysconfig\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.210532 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.183834 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-etc-sysconfig\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.210532 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184119 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57nd9\" (UniqueName: \"kubernetes.io/projected/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-kube-api-access-57nd9\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.211574 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184154 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-etc-sysctl-conf\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.211574 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184173 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-etc-tuned\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.211574 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184192 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-etc-modprobe-d\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.211574 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184209 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-run\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.211574 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184226 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-systemd-units\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.211574 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184245 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-host-cni-bin\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.211574 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184277 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-run-systemd\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.211574 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184296 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-etc-openvswitch\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.211574 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184314 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc2jr\" (UniqueName: \"kubernetes.io/projected/0a695ef6-9710-4847-bde7-ae627055ffab-kube-api-access-dc2jr\") pod \"node-ca-z2h2b\" (UID: \"0a695ef6-9710-4847-bde7-ae627055ffab\") " pod="openshift-image-registry/node-ca-z2h2b" Jul 05 07:46:26.211574 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184346 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gdch\" (UniqueName: \"kubernetes.io/projected/8a151452-12d5-4a93-bffb-e93ee92e8e14-kube-api-access-7gdch\") pod \"network-check-target-2wssl\" (UID: \"8a151452-12d5-4a93-bffb-e93ee92e8e14\") " pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:46:26.211574 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184365 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a50d8e5b-1a7b-4028-846e-73a293b0e9e2-tmp-dir\") pod \"node-resolver-q7zq5\" (UID: \"a50d8e5b-1a7b-4028-846e-73a293b0e9e2\") " pod="openshift-dns/node-resolver-q7zq5" Jul 05 07:46:26.211574 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184386 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-host-kubelet\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.211574 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184407 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-host-run-ovn-kubernetes\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.211574 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184425 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-ovnkube-config\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.211574 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184433 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-host-cni-bin\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.212322 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184437 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13a9ecf4-ffb1-4611-99bc-e629936bab5d-konnectivity-ca\") pod \"konnectivity-agent-6s2tr\" (UID: \"13a9ecf4-ffb1-4611-99bc-e629936bab5d\") " pod="kube-system/konnectivity-agent-6s2tr" Jul 05 07:46:26.212322 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184461 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9eda60f4-0409-4ba2-882a-0fc06614194b-kubelet-config\") pod \"global-pull-secret-syncer-qmlxc\" (UID: \"9eda60f4-0409-4ba2-882a-0fc06614194b\") " pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:26.212322 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184509 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9eda60f4-0409-4ba2-882a-0fc06614194b-kubelet-config\") pod \"global-pull-secret-syncer-qmlxc\" (UID: \"9eda60f4-0409-4ba2-882a-0fc06614194b\") " pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:26.212322 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184539 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-etc-modprobe-d\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.212322 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184549 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-etc-sysctl-conf\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.212322 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184578 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-run\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.212322 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184580 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-etc-systemd\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.212322 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184611 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-systemd-units\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.212322 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184628 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-etc-systemd\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.212322 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184634 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-host-cni-netd\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.212322 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184660 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-host-cni-netd\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.212322 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184663 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.212322 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184690 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-ovnkube-script-lib\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.212322 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184717 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-sys\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.212322 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184740 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-host-slash\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.212855 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184765 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-var-lib-openvswitch\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.212855 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184772 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-etc-openvswitch\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.212855 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184788 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a695ef6-9710-4847-bde7-ae627055ffab-host\") pod \"node-ca-z2h2b\" (UID: \"0a695ef6-9710-4847-bde7-ae627055ffab\") " pod="openshift-image-registry/node-ca-z2h2b" Jul 05 07:46:26.212855 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184811 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-host-run-netns\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.212855 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184836 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-log-socket\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.212855 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184859 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9eda60f4-0409-4ba2-882a-0fc06614194b-dbus\") pod \"global-pull-secret-syncer-qmlxc\" (UID: \"9eda60f4-0409-4ba2-882a-0fc06614194b\") " pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:26.212855 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184892 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzcxq\" (UniqueName: \"kubernetes.io/projected/a50d8e5b-1a7b-4028-846e-73a293b0e9e2-kube-api-access-zzcxq\") pod \"node-resolver-q7zq5\" (UID: \"a50d8e5b-1a7b-4028-846e-73a293b0e9e2\") " pod="openshift-dns/node-resolver-q7zq5" Jul 05 07:46:26.212855 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.184986 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-run-systemd\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.212855 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.185015 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-var-lib-openvswitch\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.212855 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.185050 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.212855 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.185152 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a695ef6-9710-4847-bde7-ae627055ffab-host\") pod \"node-ca-z2h2b\" (UID: \"0a695ef6-9710-4847-bde7-ae627055ffab\") " pod="openshift-image-registry/node-ca-z2h2b" Jul 05 07:46:26.212855 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.185199 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-host-run-netns\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.212855 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.185234 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-log-socket\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.212855 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.185243 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-ovn-node-metrics-cert\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.212855 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.185271 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9eda60f4-0409-4ba2-882a-0fc06614194b-original-pull-secret\") pod \"global-pull-secret-syncer-qmlxc\" (UID: \"9eda60f4-0409-4ba2-882a-0fc06614194b\") " pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:26.213533 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.185287 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9eda60f4-0409-4ba2-882a-0fc06614194b-dbus\") pod \"global-pull-secret-syncer-qmlxc\" (UID: \"9eda60f4-0409-4ba2-882a-0fc06614194b\") " pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:26.213533 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.185292 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-etc-kubernetes\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.213533 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.185316 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs\") pod \"network-metrics-daemon-mt69q\" (UID: \"2b6430fa-c37c-4cc9-81ab-3feb7300273e\") " pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:46:26.213533 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.185342 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rd76\" (UniqueName: \"kubernetes.io/projected/2b6430fa-c37c-4cc9-81ab-3feb7300273e-kube-api-access-7rd76\") pod \"network-metrics-daemon-mt69q\" (UID: \"2b6430fa-c37c-4cc9-81ab-3feb7300273e\") " pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:46:26.213533 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.185348 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-sys\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.213533 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:26.185366 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 07:46:26.213533 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.185365 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-run-openvswitch\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.213533 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.185404 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-etc-kubernetes\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.213533 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.185415 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-var-lib-kubelet\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.213533 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:26.185450 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9eda60f4-0409-4ba2-882a-0fc06614194b-original-pull-secret podName:9eda60f4-0409-4ba2-882a-0fc06614194b nodeName:}" failed. No retries permitted until 2026-07-05 07:46:26.685425417 +0000 UTC m=+2.105158470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9eda60f4-0409-4ba2-882a-0fc06614194b-original-pull-secret") pod "global-pull-secret-syncer-qmlxc" (UID: "9eda60f4-0409-4ba2-882a-0fc06614194b") : object "kube-system"/"original-pull-secret" not registered Jul 05 07:46:26.213533 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.185470 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/917e3b12-6478-4463-a3e1-b63829bf2c84-iptables-alerter-script\") pod \"iptables-alerter-wnrk5\" (UID: \"917e3b12-6478-4463-a3e1-b63829bf2c84\") " pod="openshift-network-operator/iptables-alerter-wnrk5" Jul 05 07:46:26.213533 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:26.185478 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 07:46:26.213533 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.185500 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/917e3b12-6478-4463-a3e1-b63829bf2c84-host-slash\") pod \"iptables-alerter-wnrk5\" (UID: \"917e3b12-6478-4463-a3e1-b63829bf2c84\") " pod="openshift-network-operator/iptables-alerter-wnrk5" Jul 05 07:46:26.213533 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:26.185520 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs podName:2b6430fa-c37c-4cc9-81ab-3feb7300273e nodeName:}" failed. No retries permitted until 2026-07-05 07:46:26.685508427 +0000 UTC m=+2.105241469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs") pod "network-metrics-daemon-mt69q" (UID: "2b6430fa-c37c-4cc9-81ab-3feb7300273e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 07:46:26.214199 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.185537 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/917e3b12-6478-4463-a3e1-b63829bf2c84-host-slash\") pod \"iptables-alerter-wnrk5\" (UID: \"917e3b12-6478-4463-a3e1-b63829bf2c84\") " pod="openshift-network-operator/iptables-alerter-wnrk5" Jul 05 07:46:26.214199 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.185545 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdf48\" (UniqueName: \"kubernetes.io/projected/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-kube-api-access-wdf48\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.214199 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.185572 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-ovnkube-script-lib\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.214199 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.185604 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-run-ovn\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.214199 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.185626 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0a695ef6-9710-4847-bde7-ae627055ffab-serviceca\") pod \"node-ca-z2h2b\" (UID: \"0a695ef6-9710-4847-bde7-ae627055ffab\") " pod="openshift-image-registry/node-ca-z2h2b" Jul 05 07:46:26.214199 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.185792 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-host-kubelet\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.214199 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.186003 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a50d8e5b-1a7b-4028-846e-73a293b0e9e2-tmp-dir\") pod \"node-resolver-q7zq5\" (UID: \"a50d8e5b-1a7b-4028-846e-73a293b0e9e2\") " pod="openshift-dns/node-resolver-q7zq5" Jul 05 07:46:26.214199 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.186082 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-run-ovn\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.214199 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.186159 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-var-lib-kubelet\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.214199 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.186189 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-lib-modules\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.214199 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.186235 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-host\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.214199 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.186256 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-tmp\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.214199 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.186261 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-ovnkube-config\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.214199 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.186277 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-env-overrides\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.214199 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.186315 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-etc-sysctl-d\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.214703 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.186433 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-etc-sysctl-d\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.214703 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.186459 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-lib-modules\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.214703 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.186485 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-host\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.214703 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.186537 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-host-slash\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.214703 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.186657 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-env-overrides\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.214703 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.186654 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13a9ecf4-ffb1-4611-99bc-e629936bab5d-agent-certs\") pod \"konnectivity-agent-6s2tr\" (UID: \"13a9ecf4-ffb1-4611-99bc-e629936bab5d\") " pod="kube-system/konnectivity-agent-6s2tr" Jul 05 07:46:26.214703 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.186743 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-run-openvswitch\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.214703 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.186751 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/917e3b12-6478-4463-a3e1-b63829bf2c84-iptables-alerter-script\") pod \"iptables-alerter-wnrk5\" (UID: \"917e3b12-6478-4463-a3e1-b63829bf2c84\") " pod="openshift-network-operator/iptables-alerter-wnrk5" Jul 05 07:46:26.214703 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.186784 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-host-run-ovn-kubernetes\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.214703 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.186811 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0a695ef6-9710-4847-bde7-ae627055ffab-serviceca\") pod \"node-ca-z2h2b\" (UID: \"0a695ef6-9710-4847-bde7-ae627055ffab\") " pod="openshift-image-registry/node-ca-z2h2b" Jul 05 07:46:26.214703 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.188216 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-ovn-node-metrics-cert\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.214703 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.188355 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-etc-tuned\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.214703 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.188609 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-tmp\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.214703 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.189544 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 07:46:26.214703 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:26.190308 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 07:46:26.214703 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:26.190322 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 07:46:26.215477 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:26.190340 2566 projected.go:196] Error preparing data for projected volume kube-api-access-7gdch for pod openshift-network-diagnostics/network-check-target-2wssl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 07:46:26.215477 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:26.190380 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a151452-12d5-4a93-bffb-e93ee92e8e14-kube-api-access-7gdch podName:8a151452-12d5-4a93-bffb-e93ee92e8e14 nodeName:}" failed. No retries permitted until 2026-07-05 07:46:26.690368522 +0000 UTC m=+2.110101559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7gdch" (UniqueName: "kubernetes.io/projected/8a151452-12d5-4a93-bffb-e93ee92e8e14-kube-api-access-7gdch") pod "network-check-target-2wssl" (UID: "8a151452-12d5-4a93-bffb-e93ee92e8e14") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 07:46:26.215477 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.193494 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87z7b\" (UniqueName: \"kubernetes.io/projected/917e3b12-6478-4463-a3e1-b63829bf2c84-kube-api-access-87z7b\") pod \"iptables-alerter-wnrk5\" (UID: \"917e3b12-6478-4463-a3e1-b63829bf2c84\") " pod="openshift-network-operator/iptables-alerter-wnrk5" Jul 05 07:46:26.215477 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.193917 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc2jr\" (UniqueName: \"kubernetes.io/projected/0a695ef6-9710-4847-bde7-ae627055ffab-kube-api-access-dc2jr\") pod \"node-ca-z2h2b\" (UID: \"0a695ef6-9710-4847-bde7-ae627055ffab\") " pod="openshift-image-registry/node-ca-z2h2b" Jul 05 07:46:26.215477 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.194673 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rd76\" (UniqueName: \"kubernetes.io/projected/2b6430fa-c37c-4cc9-81ab-3feb7300273e-kube-api-access-7rd76\") pod \"network-metrics-daemon-mt69q\" (UID: \"2b6430fa-c37c-4cc9-81ab-3feb7300273e\") " pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:46:26.215477 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.194835 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57nd9\" (UniqueName: \"kubernetes.io/projected/505f6ad2-0909-4ed9-b4d8-eb54ea52d0da-kube-api-access-57nd9\") pod \"tuned-thrp6\" (UID: \"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da\") " pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.215477 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.195026 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdf48\" (UniqueName: \"kubernetes.io/projected/7f4e258c-e3e6-48d8-a144-0a7fcb20bd00-kube-api-access-wdf48\") pod \"ovnkube-node-hzvp7\" (UID: \"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.215477 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.195672 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzcxq\" (UniqueName: \"kubernetes.io/projected/a50d8e5b-1a7b-4028-846e-73a293b0e9e2-kube-api-access-zzcxq\") pod \"node-resolver-q7zq5\" (UID: \"a50d8e5b-1a7b-4028-846e-73a293b0e9e2\") " pod="openshift-dns/node-resolver-q7zq5" Jul 05 07:46:26.215477 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.202022 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:26.215477 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.203612 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6s2tr" Jul 05 07:46:26.337297 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:26.218422 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f4e258c_e3e6_48d8_a144_0a7fcb20bd00.slice/crio-eb3bc04d9abfda8fff817e867f0a113d506ec6fb160cc3f67f7f8e9ca95968d5 WatchSource:0}: Error finding container eb3bc04d9abfda8fff817e867f0a113d506ec6fb160cc3f67f7f8e9ca95968d5: Status 404 returned error can't find the container with id eb3bc04d9abfda8fff817e867f0a113d506ec6fb160cc3f67f7f8e9ca95968d5 Jul 05 07:46:26.337297 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:26.219415 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13a9ecf4_ffb1_4611_99bc_e629936bab5d.slice/crio-c0625c57ab9c036e284a6f160deff0ea031a3e1a47147efe91faa04e4753f051 WatchSource:0}: Error finding container c0625c57ab9c036e284a6f160deff0ea031a3e1a47147efe91faa04e4753f051: Status 404 returned error can't find the container with id c0625c57ab9c036e284a6f160deff0ea031a3e1a47147efe91faa04e4753f051 Jul 05 07:46:26.337297 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.333880 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc6pw" Jul 05 07:46:26.465591 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.360787 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z2h2b" Jul 05 07:46:26.465591 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:26.366862 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a695ef6_9710_4847_bde7_ae627055ffab.slice/crio-42af7faf95f6a9719c2b6ce4637f59ca5d39f48eb4370233ca75c8986516aae8 WatchSource:0}: Error finding container 42af7faf95f6a9719c2b6ce4637f59ca5d39f48eb4370233ca75c8986516aae8: Status 404 returned error can't find the container with id 42af7faf95f6a9719c2b6ce4637f59ca5d39f48eb4370233ca75c8986516aae8 Jul 05 07:46:26.465591 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.378006 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9dnrn" Jul 05 07:46:26.465591 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:26.392014 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9bcc734_1c69_432f_bcb6_f2e88175856c.slice/crio-92a37711db44c03cf85cbf3bf5edb16df4a9e354dcd06afcc661933be5d05c33 WatchSource:0}: Error finding container 92a37711db44c03cf85cbf3bf5edb16df4a9e354dcd06afcc661933be5d05c33: Status 404 returned error can't find the container with id 92a37711db44c03cf85cbf3bf5edb16df4a9e354dcd06afcc661933be5d05c33 Jul 05 07:46:26.465591 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.420974 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 07:46:26.474009 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.473759 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q7zq5" Jul 05 07:46:26.475555 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.474856 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-thrp6" Jul 05 07:46:26.584393 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:26.481009 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda50d8e5b_1a7b_4028_846e_73a293b0e9e2.slice/crio-411bc32f71d0eb985b5d41de77eadaef9f8b35b10d0b8e10e4250a63ff5b181a WatchSource:0}: Error finding container 411bc32f71d0eb985b5d41de77eadaef9f8b35b10d0b8e10e4250a63ff5b181a: Status 404 returned error can't find the container with id 411bc32f71d0eb985b5d41de77eadaef9f8b35b10d0b8e10e4250a63ff5b181a Jul 05 07:46:26.584393 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:46:26.485475 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod505f6ad2_0909_4ed9_b4d8_eb54ea52d0da.slice/crio-af3c7f0bad2995abc994afc4133a75695805ecca4a4da8b97441e7c1e462b3ca WatchSource:0}: Error finding container af3c7f0bad2995abc994afc4133a75695805ecca4a4da8b97441e7c1e462b3ca: Status 404 returned error can't find the container with id af3c7f0bad2995abc994afc4133a75695805ecca4a4da8b97441e7c1e462b3ca Jul 05 07:46:26.584393 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.487169 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wnrk5" Jul 05 07:46:26.730506 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.693903 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9eda60f4-0409-4ba2-882a-0fc06614194b-original-pull-secret\") pod \"global-pull-secret-syncer-qmlxc\" (UID: \"9eda60f4-0409-4ba2-882a-0fc06614194b\") " pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:26.730506 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.693961 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs\") pod \"network-metrics-daemon-mt69q\" (UID: \"2b6430fa-c37c-4cc9-81ab-3feb7300273e\") " pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:46:26.730506 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.694024 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gdch\" (UniqueName: \"kubernetes.io/projected/8a151452-12d5-4a93-bffb-e93ee92e8e14-kube-api-access-7gdch\") pod \"network-check-target-2wssl\" (UID: \"8a151452-12d5-4a93-bffb-e93ee92e8e14\") " pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:46:26.730506 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:26.694046 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 07:46:26.730506 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:26.694086 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 07:46:26.730506 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:26.694108 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9eda60f4-0409-4ba2-882a-0fc06614194b-original-pull-secret podName:9eda60f4-0409-4ba2-882a-0fc06614194b nodeName:}" failed. No retries permitted until 2026-07-05 07:46:27.694089137 +0000 UTC m=+3.113822190 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9eda60f4-0409-4ba2-882a-0fc06614194b-original-pull-secret") pod "global-pull-secret-syncer-qmlxc" (UID: "9eda60f4-0409-4ba2-882a-0fc06614194b") : object "kube-system"/"original-pull-secret" not registered Jul 05 07:46:26.730506 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:26.694128 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 07:46:26.730506 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:26.694155 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs podName:2b6430fa-c37c-4cc9-81ab-3feb7300273e nodeName:}" failed. No retries permitted until 2026-07-05 07:46:27.694124674 +0000 UTC m=+3.113857708 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs") pod "network-metrics-daemon-mt69q" (UID: "2b6430fa-c37c-4cc9-81ab-3feb7300273e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 07:46:26.730506 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:26.694163 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 07:46:26.730506 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:26.694175 2566 projected.go:196] Error preparing data for projected volume kube-api-access-7gdch for pod openshift-network-diagnostics/network-check-target-2wssl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 07:46:26.730506 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:26.694218 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a151452-12d5-4a93-bffb-e93ee92e8e14-kube-api-access-7gdch podName:8a151452-12d5-4a93-bffb-e93ee92e8e14 nodeName:}" failed. No retries permitted until 2026-07-05 07:46:27.694206103 +0000 UTC m=+3.113939136 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7gdch" (UniqueName: "kubernetes.io/projected/8a151452-12d5-4a93-bffb-e93ee92e8e14-kube-api-access-7gdch") pod "network-check-target-2wssl" (UID: "8a151452-12d5-4a93-bffb-e93ee92e8e14") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 07:46:26.852995 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:26.800261 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 07:46:27.032332 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:27.032225 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-04 07:41:26 +0000 UTC" deadline="2028-01-09 09:20:58.442196415 +0000 UTC" Jul 05 07:46:27.032332 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:27.032283 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13273h34m31.409917538s" Jul 05 07:46:27.126233 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:27.125649 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:46:27.126233 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:27.125787 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mt69q" podUID="2b6430fa-c37c-4cc9-81ab-3feb7300273e" Jul 05 07:46:27.145876 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:27.145812 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" event={"ID":"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00","Type":"ContainerStarted","Data":"eb3bc04d9abfda8fff817e867f0a113d506ec6fb160cc3f67f7f8e9ca95968d5"} Jul 05 07:46:27.168852 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:27.168727 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-31.ec2.internal" event={"ID":"b889babd03ac98faf589183734c44eef","Type":"ContainerStarted","Data":"7595616a5dc55076f3b55939ceba10e0497513d80588f2dcba09b3e20d9186ef"} Jul 05 07:46:27.190226 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:27.190176 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zgccj" event={"ID":"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece","Type":"ContainerStarted","Data":"1cd55966095bd7a27411ee2508e7ae50d3a61129fc725c6dbf25a663ef10449f"} Jul 05 07:46:27.204781 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:27.204694 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wnrk5" event={"ID":"917e3b12-6478-4463-a3e1-b63829bf2c84","Type":"ContainerStarted","Data":"fdc7caee9916b6bc0b627ab42c12e55923ef5613462bdf36df3c25e0d44802d8"} Jul 05 07:46:27.205512 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:27.205076 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 07:46:27.211382 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:27.211356 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9dnrn" event={"ID":"b9bcc734-1c69-432f-bcb6-f2e88175856c","Type":"ContainerStarted","Data":"92a37711db44c03cf85cbf3bf5edb16df4a9e354dcd06afcc661933be5d05c33"} Jul 05 07:46:27.229011 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:27.228956 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc6pw" event={"ID":"2eb183c3-5aec-4b47-827c-5cd3d1185bdf","Type":"ContainerStarted","Data":"d4645b049787250c7dd5b46ae4f836f433ff15bd84b1718ecf94fb2bb83f29a9"} Jul 05 07:46:27.244765 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:27.244689 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-31.ec2.internal" event={"ID":"4da58462e79ad0d87f76c33f35ac75ff","Type":"ContainerStarted","Data":"2287a717a883a5b8804e4f943a923f04eb0a76ec5f2fe9342894eeedac7f0fb2"} Jul 05 07:46:27.263670 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:27.263639 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-thrp6" event={"ID":"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da","Type":"ContainerStarted","Data":"af3c7f0bad2995abc994afc4133a75695805ecca4a4da8b97441e7c1e462b3ca"} Jul 05 07:46:27.279310 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:27.279261 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q7zq5" event={"ID":"a50d8e5b-1a7b-4028-846e-73a293b0e9e2","Type":"ContainerStarted","Data":"411bc32f71d0eb985b5d41de77eadaef9f8b35b10d0b8e10e4250a63ff5b181a"} Jul 05 07:46:27.295464 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:27.295403 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z2h2b" event={"ID":"0a695ef6-9710-4847-bde7-ae627055ffab","Type":"ContainerStarted","Data":"42af7faf95f6a9719c2b6ce4637f59ca5d39f48eb4370233ca75c8986516aae8"} Jul 05 07:46:27.333538 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:27.333463 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6s2tr" event={"ID":"13a9ecf4-ffb1-4611-99bc-e629936bab5d","Type":"ContainerStarted","Data":"c0625c57ab9c036e284a6f160deff0ea031a3e1a47147efe91faa04e4753f051"} Jul 05 07:46:27.703463 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:27.703384 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9eda60f4-0409-4ba2-882a-0fc06614194b-original-pull-secret\") pod \"global-pull-secret-syncer-qmlxc\" (UID: \"9eda60f4-0409-4ba2-882a-0fc06614194b\") " pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:27.703463 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:27.703435 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs\") pod \"network-metrics-daemon-mt69q\" (UID: \"2b6430fa-c37c-4cc9-81ab-3feb7300273e\") " pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:46:27.703693 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:27.703492 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gdch\" (UniqueName: \"kubernetes.io/projected/8a151452-12d5-4a93-bffb-e93ee92e8e14-kube-api-access-7gdch\") pod \"network-check-target-2wssl\" (UID: \"8a151452-12d5-4a93-bffb-e93ee92e8e14\") " pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:46:27.703693 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:27.703634 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 07:46:27.703693 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:27.703651 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 07:46:27.703693 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:27.703662 2566 projected.go:196] Error preparing data for projected volume kube-api-access-7gdch for pod openshift-network-diagnostics/network-check-target-2wssl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 07:46:27.703894 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:27.703724 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a151452-12d5-4a93-bffb-e93ee92e8e14-kube-api-access-7gdch podName:8a151452-12d5-4a93-bffb-e93ee92e8e14 nodeName:}" failed. No retries permitted until 2026-07-05 07:46:29.703704442 +0000 UTC m=+5.123437498 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7gdch" (UniqueName: "kubernetes.io/projected/8a151452-12d5-4a93-bffb-e93ee92e8e14-kube-api-access-7gdch") pod "network-check-target-2wssl" (UID: "8a151452-12d5-4a93-bffb-e93ee92e8e14") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 07:46:27.704164 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:27.704126 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 07:46:27.704258 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:27.704218 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9eda60f4-0409-4ba2-882a-0fc06614194b-original-pull-secret podName:9eda60f4-0409-4ba2-882a-0fc06614194b nodeName:}" failed. No retries permitted until 2026-07-05 07:46:29.704184112 +0000 UTC m=+5.123917145 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9eda60f4-0409-4ba2-882a-0fc06614194b-original-pull-secret") pod "global-pull-secret-syncer-qmlxc" (UID: "9eda60f4-0409-4ba2-882a-0fc06614194b") : object "kube-system"/"original-pull-secret" not registered Jul 05 07:46:27.704258 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:27.704229 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 07:46:27.704369 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:27.704269 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs podName:2b6430fa-c37c-4cc9-81ab-3feb7300273e nodeName:}" failed. No retries permitted until 2026-07-05 07:46:29.704257804 +0000 UTC m=+5.123990849 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs") pod "network-metrics-daemon-mt69q" (UID: "2b6430fa-c37c-4cc9-81ab-3feb7300273e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 07:46:28.033490 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:28.033387 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-04 07:41:26 +0000 UTC" deadline="2028-03-28 23:41:10.20421114 +0000 UTC" Jul 05 07:46:28.033490 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:28.033420 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15183h54m42.170795135s" Jul 05 07:46:28.120918 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:28.120301 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:28.120918 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:28.120433 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qmlxc" podUID="9eda60f4-0409-4ba2-882a-0fc06614194b" Jul 05 07:46:28.120918 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:28.120517 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:46:28.120918 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:28.120590 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wssl" podUID="8a151452-12d5-4a93-bffb-e93ee92e8e14" Jul 05 07:46:28.271575 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:28.271547 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 07:46:29.120193 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:29.120160 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:46:29.120634 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:29.120401 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mt69q" podUID="2b6430fa-c37c-4cc9-81ab-3feb7300273e" Jul 05 07:46:29.719601 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:29.719563 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9eda60f4-0409-4ba2-882a-0fc06614194b-original-pull-secret\") pod \"global-pull-secret-syncer-qmlxc\" (UID: \"9eda60f4-0409-4ba2-882a-0fc06614194b\") " pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:29.719792 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:29.719615 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs\") pod \"network-metrics-daemon-mt69q\" (UID: \"2b6430fa-c37c-4cc9-81ab-3feb7300273e\") " pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:46:29.719792 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:29.719675 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gdch\" (UniqueName: \"kubernetes.io/projected/8a151452-12d5-4a93-bffb-e93ee92e8e14-kube-api-access-7gdch\") pod \"network-check-target-2wssl\" (UID: \"8a151452-12d5-4a93-bffb-e93ee92e8e14\") " pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:46:29.719917 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:29.719830 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 07:46:29.719917 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:29.719851 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 07:46:29.719917 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:29.719864 2566 projected.go:196] Error preparing data for projected volume kube-api-access-7gdch for pod openshift-network-diagnostics/network-check-target-2wssl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 07:46:29.720064 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:29.719948 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a151452-12d5-4a93-bffb-e93ee92e8e14-kube-api-access-7gdch podName:8a151452-12d5-4a93-bffb-e93ee92e8e14 nodeName:}" failed. No retries permitted until 2026-07-05 07:46:33.719913043 +0000 UTC m=+9.139646080 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7gdch" (UniqueName: "kubernetes.io/projected/8a151452-12d5-4a93-bffb-e93ee92e8e14-kube-api-access-7gdch") pod "network-check-target-2wssl" (UID: "8a151452-12d5-4a93-bffb-e93ee92e8e14") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 07:46:29.720403 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:29.720381 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 07:46:29.720468 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:29.720451 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9eda60f4-0409-4ba2-882a-0fc06614194b-original-pull-secret podName:9eda60f4-0409-4ba2-882a-0fc06614194b nodeName:}" failed. No retries permitted until 2026-07-05 07:46:33.720434085 +0000 UTC m=+9.140167149 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9eda60f4-0409-4ba2-882a-0fc06614194b-original-pull-secret") pod "global-pull-secret-syncer-qmlxc" (UID: "9eda60f4-0409-4ba2-882a-0fc06614194b") : object "kube-system"/"original-pull-secret" not registered Jul 05 07:46:29.720540 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:29.720527 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 07:46:29.720596 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:29.720569 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs podName:2b6430fa-c37c-4cc9-81ab-3feb7300273e nodeName:}" failed. No retries permitted until 2026-07-05 07:46:33.720556972 +0000 UTC m=+9.140290007 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs") pod "network-metrics-daemon-mt69q" (UID: "2b6430fa-c37c-4cc9-81ab-3feb7300273e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 07:46:30.120386 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:30.120310 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:46:30.120386 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:30.120358 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:30.120854 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:30.120462 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wssl" podUID="8a151452-12d5-4a93-bffb-e93ee92e8e14" Jul 05 07:46:30.120854 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:30.120558 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qmlxc" podUID="9eda60f4-0409-4ba2-882a-0fc06614194b" Jul 05 07:46:31.120196 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:31.120164 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:46:31.120386 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:31.120312 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mt69q" podUID="2b6430fa-c37c-4cc9-81ab-3feb7300273e" Jul 05 07:46:32.119989 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:32.119959 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:32.120520 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:32.119959 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:46:32.120520 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:32.120077 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qmlxc" podUID="9eda60f4-0409-4ba2-882a-0fc06614194b" Jul 05 07:46:32.120520 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:32.120197 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wssl" podUID="8a151452-12d5-4a93-bffb-e93ee92e8e14" Jul 05 07:46:33.120296 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:33.120245 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:46:33.120733 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:33.120390 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mt69q" podUID="2b6430fa-c37c-4cc9-81ab-3feb7300273e" Jul 05 07:46:33.751002 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:33.750963 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9eda60f4-0409-4ba2-882a-0fc06614194b-original-pull-secret\") pod \"global-pull-secret-syncer-qmlxc\" (UID: \"9eda60f4-0409-4ba2-882a-0fc06614194b\") " pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:33.751181 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:33.751011 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs\") pod \"network-metrics-daemon-mt69q\" (UID: \"2b6430fa-c37c-4cc9-81ab-3feb7300273e\") " pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:46:33.751181 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:33.751079 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gdch\" (UniqueName: \"kubernetes.io/projected/8a151452-12d5-4a93-bffb-e93ee92e8e14-kube-api-access-7gdch\") pod \"network-check-target-2wssl\" (UID: \"8a151452-12d5-4a93-bffb-e93ee92e8e14\") " pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:46:33.751288 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:33.751242 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 07:46:33.751288 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:33.751274 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 07:46:33.751404 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:33.751308 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9eda60f4-0409-4ba2-882a-0fc06614194b-original-pull-secret podName:9eda60f4-0409-4ba2-882a-0fc06614194b nodeName:}" failed. No retries permitted until 2026-07-05 07:46:41.751289224 +0000 UTC m=+17.171022260 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9eda60f4-0409-4ba2-882a-0fc06614194b-original-pull-secret") pod "global-pull-secret-syncer-qmlxc" (UID: "9eda60f4-0409-4ba2-882a-0fc06614194b") : object "kube-system"/"original-pull-secret" not registered Jul 05 07:46:33.751404 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:33.751341 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs podName:2b6430fa-c37c-4cc9-81ab-3feb7300273e nodeName:}" failed. No retries permitted until 2026-07-05 07:46:41.751316515 +0000 UTC m=+17.171049561 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs") pod "network-metrics-daemon-mt69q" (UID: "2b6430fa-c37c-4cc9-81ab-3feb7300273e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 07:46:33.751404 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:33.751389 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 07:46:33.751404 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:33.751403 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 07:46:33.751608 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:33.751416 2566 projected.go:196] Error preparing data for projected volume kube-api-access-7gdch for pod openshift-network-diagnostics/network-check-target-2wssl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 07:46:33.751608 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:33.751454 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a151452-12d5-4a93-bffb-e93ee92e8e14-kube-api-access-7gdch podName:8a151452-12d5-4a93-bffb-e93ee92e8e14 nodeName:}" failed. No retries permitted until 2026-07-05 07:46:41.751441368 +0000 UTC m=+17.171174417 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7gdch" (UniqueName: "kubernetes.io/projected/8a151452-12d5-4a93-bffb-e93ee92e8e14-kube-api-access-7gdch") pod "network-check-target-2wssl" (UID: "8a151452-12d5-4a93-bffb-e93ee92e8e14") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 07:46:34.119699 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:34.119613 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:34.119699 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:34.119633 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:46:34.119917 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:34.119741 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qmlxc" podUID="9eda60f4-0409-4ba2-882a-0fc06614194b" Jul 05 07:46:34.119917 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:34.119834 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wssl" podUID="8a151452-12d5-4a93-bffb-e93ee92e8e14" Jul 05 07:46:35.124182 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:35.123718 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:46:35.124182 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:35.123834 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mt69q" podUID="2b6430fa-c37c-4cc9-81ab-3feb7300273e" Jul 05 07:46:36.119732 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:36.119699 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:36.119904 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:36.119819 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qmlxc" podUID="9eda60f4-0409-4ba2-882a-0fc06614194b" Jul 05 07:46:36.119904 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:36.119872 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:46:36.120029 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:36.119970 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wssl" podUID="8a151452-12d5-4a93-bffb-e93ee92e8e14" Jul 05 07:46:37.121363 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:37.120235 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:46:37.121363 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:37.120372 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mt69q" podUID="2b6430fa-c37c-4cc9-81ab-3feb7300273e" Jul 05 07:46:38.120529 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:38.120452 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:46:38.120694 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:38.120559 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wssl" podUID="8a151452-12d5-4a93-bffb-e93ee92e8e14" Jul 05 07:46:38.120694 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:38.120588 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:38.120694 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:38.120664 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qmlxc" podUID="9eda60f4-0409-4ba2-882a-0fc06614194b" Jul 05 07:46:39.120678 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:39.120634 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:46:39.121169 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:39.120779 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mt69q" podUID="2b6430fa-c37c-4cc9-81ab-3feb7300273e" Jul 05 07:46:40.120195 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:40.120161 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:40.120360 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:40.120167 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:46:40.120360 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:40.120277 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qmlxc" podUID="9eda60f4-0409-4ba2-882a-0fc06614194b" Jul 05 07:46:40.120474 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:40.120373 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wssl" podUID="8a151452-12d5-4a93-bffb-e93ee92e8e14" Jul 05 07:46:41.120526 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:41.120354 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:46:41.120978 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:41.120615 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mt69q" podUID="2b6430fa-c37c-4cc9-81ab-3feb7300273e" Jul 05 07:46:41.811165 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:41.811117 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gdch\" (UniqueName: \"kubernetes.io/projected/8a151452-12d5-4a93-bffb-e93ee92e8e14-kube-api-access-7gdch\") pod \"network-check-target-2wssl\" (UID: \"8a151452-12d5-4a93-bffb-e93ee92e8e14\") " pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:46:41.811346 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:41.811184 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9eda60f4-0409-4ba2-882a-0fc06614194b-original-pull-secret\") pod \"global-pull-secret-syncer-qmlxc\" (UID: \"9eda60f4-0409-4ba2-882a-0fc06614194b\") " pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:41.811346 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:41.811207 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs\") pod \"network-metrics-daemon-mt69q\" (UID: \"2b6430fa-c37c-4cc9-81ab-3feb7300273e\") " pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:46:41.811346 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:41.811244 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 07:46:41.811346 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:41.811266 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 07:46:41.811346 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:41.811276 2566 projected.go:196] Error preparing data for projected volume kube-api-access-7gdch for pod openshift-network-diagnostics/network-check-target-2wssl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 07:46:41.811346 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:41.811308 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 07:46:41.811346 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:41.811332 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a151452-12d5-4a93-bffb-e93ee92e8e14-kube-api-access-7gdch podName:8a151452-12d5-4a93-bffb-e93ee92e8e14 nodeName:}" failed. No retries permitted until 2026-07-05 07:46:57.811314246 +0000 UTC m=+33.231047279 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7gdch" (UniqueName: "kubernetes.io/projected/8a151452-12d5-4a93-bffb-e93ee92e8e14-kube-api-access-7gdch") pod "network-check-target-2wssl" (UID: "8a151452-12d5-4a93-bffb-e93ee92e8e14") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 07:46:41.811562 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:41.811359 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs podName:2b6430fa-c37c-4cc9-81ab-3feb7300273e nodeName:}" failed. No retries permitted until 2026-07-05 07:46:57.811346984 +0000 UTC m=+33.231080016 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs") pod "network-metrics-daemon-mt69q" (UID: "2b6430fa-c37c-4cc9-81ab-3feb7300273e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 07:46:41.811562 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:41.811308 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 07:46:41.811562 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:41.811393 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9eda60f4-0409-4ba2-882a-0fc06614194b-original-pull-secret podName:9eda60f4-0409-4ba2-882a-0fc06614194b nodeName:}" failed. No retries permitted until 2026-07-05 07:46:57.811387067 +0000 UTC m=+33.231120100 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9eda60f4-0409-4ba2-882a-0fc06614194b-original-pull-secret") pod "global-pull-secret-syncer-qmlxc" (UID: "9eda60f4-0409-4ba2-882a-0fc06614194b") : object "kube-system"/"original-pull-secret" not registered Jul 05 07:46:42.120339 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:42.120266 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:42.120497 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:42.120398 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qmlxc" podUID="9eda60f4-0409-4ba2-882a-0fc06614194b" Jul 05 07:46:42.120497 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:42.120457 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:46:42.120905 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:42.120575 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wssl" podUID="8a151452-12d5-4a93-bffb-e93ee92e8e14" Jul 05 07:46:43.120233 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:43.120196 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:46:43.120417 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:43.120345 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mt69q" podUID="2b6430fa-c37c-4cc9-81ab-3feb7300273e" Jul 05 07:46:44.120645 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:44.120614 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:44.121034 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:44.120741 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qmlxc" podUID="9eda60f4-0409-4ba2-882a-0fc06614194b" Jul 05 07:46:44.121034 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:44.120804 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:46:44.121034 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:44.120895 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wssl" podUID="8a151452-12d5-4a93-bffb-e93ee92e8e14" Jul 05 07:46:45.121344 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:45.121311 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:46:45.121769 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:45.121423 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mt69q" podUID="2b6430fa-c37c-4cc9-81ab-3feb7300273e" Jul 05 07:46:46.120529 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:46.120487 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:46.120627 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:46.120607 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qmlxc" podUID="9eda60f4-0409-4ba2-882a-0fc06614194b" Jul 05 07:46:46.120672 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:46.120641 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:46:46.120723 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:46.120708 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wssl" podUID="8a151452-12d5-4a93-bffb-e93ee92e8e14" Jul 05 07:46:46.374255 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:46.374221 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zgccj" event={"ID":"cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece","Type":"ContainerStarted","Data":"7fe7a21d1b95f2d9ddcc5bf1c5c25cdb9a9d9b56ee5b7c73b7bc0f055445d75c"} Jul 05 07:46:46.380595 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:46.380565 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-31.ec2.internal" event={"ID":"4da58462e79ad0d87f76c33f35ac75ff","Type":"ContainerStarted","Data":"4c1975d3f56ba0febd650168cdb0a38f882c49ece737164c890174a9eef99ed0"} Jul 05 07:46:46.385111 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:46.385086 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-thrp6" event={"ID":"505f6ad2-0909-4ed9-b4d8-eb54ea52d0da","Type":"ContainerStarted","Data":"23395a2a3b6a75699526b3cbd8a6b3f7addcb96c2cb604279f11f2d0c8db125b"} Jul 05 07:46:46.423885 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:46.423812 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-31.ec2.internal" podStartSLOduration=21.42379255 podStartE2EDuration="21.42379255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 07:46:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:46:46.423610747 +0000 UTC m=+21.843343803" watchObservedRunningTime="2026-07-05 07:46:46.42379255 +0000 UTC m=+21.843525606" Jul 05 07:46:46.424226 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:46.424157 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zgccj" podStartSLOduration=1.585072327 podStartE2EDuration="21.424124812s" totalImagesPullingTime="19.839052485s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 07:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:46:46.395072557 +0000 UTC m=+21.814805615" watchObservedRunningTime="2026-07-05 07:46:46.424124812 +0000 UTC m=+21.843857869" Jul 05 07:46:47.120935 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:47.120771 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:46:47.121044 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:47.121024 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mt69q" podUID="2b6430fa-c37c-4cc9-81ab-3feb7300273e" Jul 05 07:46:47.388145 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:47.388096 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc6pw" event={"ID":"2eb183c3-5aec-4b47-827c-5cd3d1185bdf","Type":"ContainerStarted","Data":"de3ab59209fb7e57767944d80a42802e31d1bf44b7bc17cb22d33f251f067113"} Jul 05 07:46:47.389508 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:47.389327 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q7zq5" event={"ID":"a50d8e5b-1a7b-4028-846e-73a293b0e9e2","Type":"ContainerStarted","Data":"9816e3a126a13f4f5cbf0c3f5d200138fb0ba8a8d8925db4e6749f96b8216722"} Jul 05 07:46:47.390680 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:47.390658 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z2h2b" event={"ID":"0a695ef6-9710-4847-bde7-ae627055ffab","Type":"ContainerStarted","Data":"a4bc4b45424074a5d09288f41352b6b56103546b4c74861314375b96402e63fb"} Jul 05 07:46:47.392013 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:47.391991 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6s2tr" event={"ID":"13a9ecf4-ffb1-4611-99bc-e629936bab5d","Type":"ContainerStarted","Data":"bf8a0ec1cfe0f1fd6136ba84a25e52c30be39facc4e80476ac4eefb60ed10e47"} Jul 05 07:46:47.395110 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:47.395091 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" event={"ID":"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00","Type":"ContainerStarted","Data":"21bfb5ae60a1f10aa0203207fea24a22883d644f3e64f8960bf349b6a6b690c9"} Jul 05 07:46:47.395217 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:47.395156 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" event={"ID":"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00","Type":"ContainerStarted","Data":"8b9a6fe44c1f8ebfedf794a28648a60a9331407443dbf315fc41c7e54649334b"} Jul 05 07:46:47.395217 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:47.395197 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" event={"ID":"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00","Type":"ContainerStarted","Data":"790166efa05ddd8634cc01b839fc04c496bc5b2f62e2397156b2ea25ffc28e89"} Jul 05 07:46:47.395294 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:47.395228 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" event={"ID":"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00","Type":"ContainerStarted","Data":"304dd9c3d696a4ff5940f2c5db23adb9e821e7ee22e1e247240fd7ec65d92b12"} Jul 05 07:46:47.395294 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:47.395256 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" event={"ID":"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00","Type":"ContainerStarted","Data":"9491b3c07e536d3a1dddca1b917a498dec21aa028fe4bc9ad0aab6223faecded"} Jul 05 07:46:47.395294 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:47.395291 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" event={"ID":"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00","Type":"ContainerStarted","Data":"6ce020b93f9173faae24ab200695be3735b3b41da5600c73661141c0196907d9"} Jul 05 07:46:47.396418 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:47.396398 2566 generic.go:356] "Generic (PLEG): container finished" podID="b889babd03ac98faf589183734c44eef" containerID="973150b6de96d4d86cd1621346367a57c89299cfd3b520449abedcee8023719a" exitCode=0 Jul 05 07:46:47.396489 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:47.396464 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-31.ec2.internal" event={"ID":"b889babd03ac98faf589183734c44eef","Type":"ContainerDied","Data":"973150b6de96d4d86cd1621346367a57c89299cfd3b520449abedcee8023719a"} Jul 05 07:46:47.397897 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:47.397873 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wnrk5" event={"ID":"917e3b12-6478-4463-a3e1-b63829bf2c84","Type":"ContainerStarted","Data":"1c36bd4f90a43e1aa6b0ce0158c4aded737e83b2ef6b865648bd1948ef271c81"} Jul 05 07:46:47.399511 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:47.399488 2566 generic.go:356] "Generic (PLEG): container finished" podID="b9bcc734-1c69-432f-bcb6-f2e88175856c" containerID="bd33882871c28c46cd90a31a2bd6cdba23c815ca55818563843f6bfc097d0e49" exitCode=0 Jul 05 07:46:47.399592 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:47.399559 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9dnrn" event={"ID":"b9bcc734-1c69-432f-bcb6-f2e88175856c","Type":"ContainerDied","Data":"bd33882871c28c46cd90a31a2bd6cdba23c815ca55818563843f6bfc097d0e49"} Jul 05 07:46:47.404507 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:47.404472 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-thrp6" podStartSLOduration=2.912152693 podStartE2EDuration="22.404460198s" totalImagesPullingTime="19.492307505s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 07:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:46:46.459377259 +0000 UTC m=+21.879110314" watchObservedRunningTime="2026-07-05 07:46:47.404460198 +0000 UTC m=+22.824193251" Jul 05 07:46:47.404591 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:47.404565 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-q7zq5" podStartSLOduration=2.913530947 podStartE2EDuration="22.404559562s" totalImagesPullingTime="19.491028615s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 07:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:46:47.40442201 +0000 UTC m=+22.824155062" watchObservedRunningTime="2026-07-05 07:46:47.404559562 +0000 UTC m=+22.824292617" Jul 05 07:46:47.431838 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:47.431800 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-z2h2b" podStartSLOduration=2.8536540070000003 podStartE2EDuration="22.431785284s" totalImagesPullingTime="19.578131277s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 07:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:46:47.418958601 +0000 UTC m=+22.838691655" watchObservedRunningTime="2026-07-05 07:46:47.431785284 +0000 UTC m=+22.851518339" Jul 05 07:46:47.431958 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:47.431929 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wnrk5" podStartSLOduration=2.947140023 podStartE2EDuration="22.431921286s" totalImagesPullingTime="19.484781263s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 07:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:46:47.431892217 +0000 UTC m=+22.851625274" watchObservedRunningTime="2026-07-05 07:46:47.431921286 +0000 UTC m=+22.851654342" Jul 05 07:46:47.461424 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:47.461375 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6s2tr" podStartSLOduration=2.736984033 podStartE2EDuration="22.461356277s" totalImagesPullingTime="19.724372244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 07:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:46:47.445553586 +0000 UTC m=+22.865286641" watchObservedRunningTime="2026-07-05 07:46:47.461356277 +0000 UTC m=+22.881089333" Jul 05 07:46:47.600540 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:47.600467 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:46:47.692554 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:47.692517 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:46:47.913962 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:47.913877 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:46:48.006329 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:48.006296 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:46:48.120560 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:48.120531 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:48.120739 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:48.120573 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:46:48.120739 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:48.120655 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qmlxc" podUID="9eda60f4-0409-4ba2-882a-0fc06614194b" Jul 05 07:46:48.120854 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:48.120787 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wssl" podUID="8a151452-12d5-4a93-bffb-e93ee92e8e14" Jul 05 07:46:48.314397 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:48.314339 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:46:48.379998 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:48.379978 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 05 07:46:48.404589 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:48.404568 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-31.ec2.internal" event={"ID":"b889babd03ac98faf589183734c44eef","Type":"ContainerStarted","Data":"ad57ef9e6fd009974f964bfb43d1aa00adf150ab39c88711a071430ba290e579"} Jul 05 07:46:48.406417 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:48.406383 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc6pw" event={"ID":"2eb183c3-5aec-4b47-827c-5cd3d1185bdf","Type":"ContainerStarted","Data":"e99f91bc425d3b541620d4a83fd83922ab500b162cb2a6f575b74565f72ca7b0"} Jul 05 07:46:48.413753 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:48.413728 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:46:48.418763 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:48.418715 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-31.ec2.internal" podStartSLOduration=23.418698527 podStartE2EDuration="23.418698527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 07:46:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:46:48.418419615 +0000 UTC m=+23.838152671" watchObservedRunningTime="2026-07-05 07:46:48.418698527 +0000 UTC m=+23.838431583" Jul 05 07:46:49.090377 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:49.090277 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-05T07:46:48.379992407Z","UUID":"5022f0c2-8c52-4c60-8a43-f5f755849ebd","Handler":null,"Name":"","Endpoint":""} Jul 05 07:46:49.092157 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:49.092000 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 05 07:46:49.092157 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:49.092034 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 05 07:46:49.120639 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:49.120607 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:46:49.120768 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:49.120747 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mt69q" podUID="2b6430fa-c37c-4cc9-81ab-3feb7300273e" Jul 05 07:46:49.130322 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:49.130296 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:46:49.411770 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:49.411744 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" event={"ID":"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00","Type":"ContainerStarted","Data":"f8480180f142e884dcf54406ad762b1416f02e08155d8d990994278e1ffa9d2b"} Jul 05 07:46:49.514723 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:49.514692 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:46:49.614798 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:49.614733 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:46:50.120387 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:50.120359 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:50.120387 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:50.120380 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:46:50.120589 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:50.120463 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wssl" podUID="8a151452-12d5-4a93-bffb-e93ee92e8e14" Jul 05 07:46:50.120649 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:50.120596 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qmlxc" podUID="9eda60f4-0409-4ba2-882a-0fc06614194b" Jul 05 07:46:50.414963 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:50.414883 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc6pw" event={"ID":"2eb183c3-5aec-4b47-827c-5cd3d1185bdf","Type":"ContainerStarted","Data":"17eba18c04cfeb4d8ed712e00e7876aba38de728ea0b0463095d2a0fe1222db5"} Jul 05 07:46:50.432012 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:50.431963 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc6pw" podStartSLOduration=3.519443364 podStartE2EDuration="25.431950595s" totalImagesPullingTime="21.912507231s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 07:46:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:46:50.431611563 +0000 UTC m=+25.851344619" watchObservedRunningTime="2026-07-05 07:46:50.431950595 +0000 UTC m=+25.851683650" Jul 05 07:46:51.120260 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:51.120230 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:46:51.120444 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:51.120363 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mt69q" podUID="2b6430fa-c37c-4cc9-81ab-3feb7300273e" Jul 05 07:46:51.678347 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:51.678319 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6s2tr" Jul 05 07:46:51.726283 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:51.726212 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6s2tr" Jul 05 07:46:51.726800 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:51.726781 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6s2tr" Jul 05 07:46:52.120345 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:52.120263 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:52.120521 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:52.120378 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qmlxc" podUID="9eda60f4-0409-4ba2-882a-0fc06614194b" Jul 05 07:46:52.120521 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:52.120435 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:46:52.120645 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:52.120520 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wssl" podUID="8a151452-12d5-4a93-bffb-e93ee92e8e14" Jul 05 07:46:52.420515 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:52.420441 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6s2tr" Jul 05 07:46:52.473935 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:52.473910 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:46:52.851768 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:52.851638 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:46:52.957087 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:52.957056 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:46:53.120889 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:53.120851 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:46:53.121012 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:53.120980 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mt69q" podUID="2b6430fa-c37c-4cc9-81ab-3feb7300273e" Jul 05 07:46:53.424519 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:53.424458 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" event={"ID":"7f4e258c-e3e6-48d8-a144-0a7fcb20bd00","Type":"ContainerStarted","Data":"fcb59fe68aecbfb9d4172b4b96d349d2e71d56308b0bd7bbf7483f27fd8b4370"} Jul 05 07:46:53.424684 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:53.424662 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:53.426325 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:53.426304 2566 generic.go:356] "Generic (PLEG): container finished" podID="b9bcc734-1c69-432f-bcb6-f2e88175856c" containerID="37a9d5c6fc2e8668a5f69e14ce24c58a96513f75fe72ce15eed97144a1189e67" exitCode=0 Jul 05 07:46:53.426424 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:53.426387 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9dnrn" event={"ID":"b9bcc734-1c69-432f-bcb6-f2e88175856c","Type":"ContainerDied","Data":"37a9d5c6fc2e8668a5f69e14ce24c58a96513f75fe72ce15eed97144a1189e67"} Jul 05 07:46:53.439799 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:53.439781 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:53.449895 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:53.449860 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" podStartSLOduration=8.32733088 podStartE2EDuration="28.44984828s" totalImagesPullingTime="20.1225174s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 07:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:46:53.449283624 +0000 UTC m=+28.869016678" watchObservedRunningTime="2026-07-05 07:46:53.44984828 +0000 UTC m=+28.869581364" Jul 05 07:46:54.120256 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:54.120220 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:46:54.121353 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:54.120351 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wssl" podUID="8a151452-12d5-4a93-bffb-e93ee92e8e14" Jul 05 07:46:54.121353 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:54.120578 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:54.121353 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:54.120677 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qmlxc" podUID="9eda60f4-0409-4ba2-882a-0fc06614194b" Jul 05 07:46:54.429041 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:54.428979 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:54.429206 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:54.429052 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:54.443063 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:54.443029 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:46:54.806013 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:54.805797 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2wssl"] Jul 05 07:46:54.806122 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:54.806060 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:46:54.806184 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:54.806154 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wssl" podUID="8a151452-12d5-4a93-bffb-e93ee92e8e14" Jul 05 07:46:54.808463 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:54.808441 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mt69q"] Jul 05 07:46:54.808570 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:54.808551 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:46:54.808656 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:54.808640 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mt69q" podUID="2b6430fa-c37c-4cc9-81ab-3feb7300273e" Jul 05 07:46:54.816212 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:54.816188 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qmlxc"] Jul 05 07:46:54.816316 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:54.816283 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:54.816399 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:54.816373 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qmlxc" podUID="9eda60f4-0409-4ba2-882a-0fc06614194b" Jul 05 07:46:55.432374 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:55.432341 2566 generic.go:356] "Generic (PLEG): container finished" podID="b9bcc734-1c69-432f-bcb6-f2e88175856c" containerID="ddf35fdfeb8a03fd8acc7f4099c2f1a7e7ad7bcc840dcbf636a6099b181d0b24" exitCode=0 Jul 05 07:46:55.432822 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:55.432408 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9dnrn" event={"ID":"b9bcc734-1c69-432f-bcb6-f2e88175856c","Type":"ContainerDied","Data":"ddf35fdfeb8a03fd8acc7f4099c2f1a7e7ad7bcc840dcbf636a6099b181d0b24"} Jul 05 07:46:55.568918 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:55.568890 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:46:55.621768 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:55.621737 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:46:56.120025 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:56.119999 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:46:56.120025 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:56.120020 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:46:56.120233 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:56.120024 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:56.120233 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:56.120111 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mt69q" podUID="2b6430fa-c37c-4cc9-81ab-3feb7300273e" Jul 05 07:46:56.120233 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:56.120168 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wssl" podUID="8a151452-12d5-4a93-bffb-e93ee92e8e14" Jul 05 07:46:56.120326 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:56.120240 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qmlxc" podUID="9eda60f4-0409-4ba2-882a-0fc06614194b" Jul 05 07:46:56.436446 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:56.436414 2566 generic.go:356] "Generic (PLEG): container finished" podID="b9bcc734-1c69-432f-bcb6-f2e88175856c" containerID="ac77947f16b4afdaa8c4edd0931eefcbcf61d6ab2b6c9355a7b050ba9b2b7f83" exitCode=0 Jul 05 07:46:56.436806 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:56.436499 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9dnrn" event={"ID":"b9bcc734-1c69-432f-bcb6-f2e88175856c","Type":"ContainerDied","Data":"ac77947f16b4afdaa8c4edd0931eefcbcf61d6ab2b6c9355a7b050ba9b2b7f83"} Jul 05 07:46:57.532212 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:57.532168 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:46:57.628816 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:57.628776 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:46:57.838945 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:57.838913 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gdch\" (UniqueName: \"kubernetes.io/projected/8a151452-12d5-4a93-bffb-e93ee92e8e14-kube-api-access-7gdch\") pod \"network-check-target-2wssl\" (UID: \"8a151452-12d5-4a93-bffb-e93ee92e8e14\") " pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:46:57.839107 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:57.838966 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9eda60f4-0409-4ba2-882a-0fc06614194b-original-pull-secret\") pod \"global-pull-secret-syncer-qmlxc\" (UID: \"9eda60f4-0409-4ba2-882a-0fc06614194b\") " pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:57.839107 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:57.838990 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs\") pod \"network-metrics-daemon-mt69q\" (UID: \"2b6430fa-c37c-4cc9-81ab-3feb7300273e\") " pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:46:57.839107 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:57.839091 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 07:46:57.839296 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:57.839115 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 07:46:57.839296 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:57.839114 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 07:46:57.839296 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:57.839176 2566 projected.go:196] Error preparing data for projected volume kube-api-access-7gdch for pod openshift-network-diagnostics/network-check-target-2wssl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 07:46:57.839296 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:57.839187 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 07:46:57.839296 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:57.839203 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs podName:2b6430fa-c37c-4cc9-81ab-3feb7300273e nodeName:}" failed. No retries permitted until 2026-07-05 07:47:29.839182229 +0000 UTC m=+65.258915263 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs") pod "network-metrics-daemon-mt69q" (UID: "2b6430fa-c37c-4cc9-81ab-3feb7300273e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 07:46:57.839296 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:57.839234 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a151452-12d5-4a93-bffb-e93ee92e8e14-kube-api-access-7gdch podName:8a151452-12d5-4a93-bffb-e93ee92e8e14 nodeName:}" failed. No retries permitted until 2026-07-05 07:47:29.839216362 +0000 UTC m=+65.258949396 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7gdch" (UniqueName: "kubernetes.io/projected/8a151452-12d5-4a93-bffb-e93ee92e8e14-kube-api-access-7gdch") pod "network-check-target-2wssl" (UID: "8a151452-12d5-4a93-bffb-e93ee92e8e14") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 07:46:57.839296 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:57.839254 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9eda60f4-0409-4ba2-882a-0fc06614194b-original-pull-secret podName:9eda60f4-0409-4ba2-882a-0fc06614194b nodeName:}" failed. No retries permitted until 2026-07-05 07:47:29.839244244 +0000 UTC m=+65.258977279 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9eda60f4-0409-4ba2-882a-0fc06614194b-original-pull-secret") pod "global-pull-secret-syncer-qmlxc" (UID: "9eda60f4-0409-4ba2-882a-0fc06614194b") : object "kube-system"/"original-pull-secret" not registered Jul 05 07:46:58.120343 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:58.120270 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:46:58.120493 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:58.120374 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:46:58.120493 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:58.120383 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wssl" podUID="8a151452-12d5-4a93-bffb-e93ee92e8e14" Jul 05 07:46:58.120493 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:58.120387 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:46:58.120493 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:58.120484 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mt69q" podUID="2b6430fa-c37c-4cc9-81ab-3feb7300273e" Jul 05 07:46:58.120629 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:46:58.120569 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qmlxc" podUID="9eda60f4-0409-4ba2-882a-0fc06614194b" Jul 05 07:46:59.822640 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:59.822612 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-31.ec2.internal" event="NodeReady" Jul 05 07:46:59.823422 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:59.823402 2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 05 07:46:59.863577 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:59.863548 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pndsb"] Jul 05 07:46:59.866019 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:59.866002 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pndsb" Jul 05 07:46:59.867258 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:59.867234 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6d2v5"] Jul 05 07:46:59.868758 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:59.868737 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 05 07:46:59.868861 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:59.868762 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-845z6\"" Jul 05 07:46:59.868861 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:59.868741 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 05 07:46:59.869087 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:59.868943 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6d2v5" Jul 05 07:46:59.871401 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:59.871382 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 05 07:46:59.871656 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:59.871514 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 05 07:46:59.871656 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:59.871553 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 05 07:46:59.871656 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:59.871595 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fl762\"" Jul 05 07:46:59.875686 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:59.875655 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pndsb"] Jul 05 07:46:59.878288 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:59.878271 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6d2v5"] Jul 05 07:46:59.957415 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:59.957339 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brpk5\" (UniqueName: \"kubernetes.io/projected/ab7d905e-50ca-4fc8-861b-97c9a87c22c1-kube-api-access-brpk5\") pod \"ingress-canary-6d2v5\" (UID: \"ab7d905e-50ca-4fc8-861b-97c9a87c22c1\") " pod="openshift-ingress-canary/ingress-canary-6d2v5" Jul 05 07:46:59.957415 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:59.957380 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-metrics-tls\") pod \"dns-default-pndsb\" (UID: \"a6fc0e8f-0a92-40af-8e70-40e4dc38504c\") " pod="openshift-dns/dns-default-pndsb" Jul 05 07:46:59.957608 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:59.957448 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-tmp-dir\") pod \"dns-default-pndsb\" (UID: \"a6fc0e8f-0a92-40af-8e70-40e4dc38504c\") " pod="openshift-dns/dns-default-pndsb" Jul 05 07:46:59.957608 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:59.957496 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgn6d\" (UniqueName: \"kubernetes.io/projected/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-kube-api-access-tgn6d\") pod \"dns-default-pndsb\" (UID: \"a6fc0e8f-0a92-40af-8e70-40e4dc38504c\") " pod="openshift-dns/dns-default-pndsb" Jul 05 07:46:59.957608 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:59.957526 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab7d905e-50ca-4fc8-861b-97c9a87c22c1-cert\") pod \"ingress-canary-6d2v5\" (UID: \"ab7d905e-50ca-4fc8-861b-97c9a87c22c1\") " pod="openshift-ingress-canary/ingress-canary-6d2v5" Jul 05 07:46:59.957608 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:59.957552 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-config-volume\") pod \"dns-default-pndsb\" (UID: \"a6fc0e8f-0a92-40af-8e70-40e4dc38504c\") " pod="openshift-dns/dns-default-pndsb" Jul 05 07:46:59.975986 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:46:59.975959 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:47:00.025100 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:00.025062 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:47:00.058217 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:00.058189 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab7d905e-50ca-4fc8-861b-97c9a87c22c1-cert\") pod \"ingress-canary-6d2v5\" (UID: \"ab7d905e-50ca-4fc8-861b-97c9a87c22c1\") " pod="openshift-ingress-canary/ingress-canary-6d2v5" Jul 05 07:47:00.058365 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:00.058227 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-config-volume\") pod \"dns-default-pndsb\" (UID: \"a6fc0e8f-0a92-40af-8e70-40e4dc38504c\") " pod="openshift-dns/dns-default-pndsb" Jul 05 07:47:00.058440 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:00.058398 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brpk5\" (UniqueName: \"kubernetes.io/projected/ab7d905e-50ca-4fc8-861b-97c9a87c22c1-kube-api-access-brpk5\") pod \"ingress-canary-6d2v5\" (UID: \"ab7d905e-50ca-4fc8-861b-97c9a87c22c1\") " pod="openshift-ingress-canary/ingress-canary-6d2v5" Jul 05 07:47:00.058495 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:00.058437 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-metrics-tls\") pod \"dns-default-pndsb\" (UID: \"a6fc0e8f-0a92-40af-8e70-40e4dc38504c\") " pod="openshift-dns/dns-default-pndsb" Jul 05 07:47:00.058546 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:00.058498 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-tmp-dir\") pod \"dns-default-pndsb\" (UID: \"a6fc0e8f-0a92-40af-8e70-40e4dc38504c\") " pod="openshift-dns/dns-default-pndsb" Jul 05 07:47:00.058584 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:00.058556 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgn6d\" (UniqueName: \"kubernetes.io/projected/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-kube-api-access-tgn6d\") pod \"dns-default-pndsb\" (UID: \"a6fc0e8f-0a92-40af-8e70-40e4dc38504c\") " pod="openshift-dns/dns-default-pndsb" Jul 05 07:47:00.058828 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:47:00.058805 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 07:47:00.059101 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:47:00.058897 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-metrics-tls podName:a6fc0e8f-0a92-40af-8e70-40e4dc38504c nodeName:}" failed. No retries permitted until 2026-07-05 07:47:00.5588703 +0000 UTC m=+35.978603347 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-metrics-tls") pod "dns-default-pndsb" (UID: "a6fc0e8f-0a92-40af-8e70-40e4dc38504c") : secret "dns-default-metrics-tls" not found Jul 05 07:47:00.059101 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:00.059052 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-config-volume\") pod \"dns-default-pndsb\" (UID: \"a6fc0e8f-0a92-40af-8e70-40e4dc38504c\") " pod="openshift-dns/dns-default-pndsb" Jul 05 07:47:00.059303 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:00.059054 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-tmp-dir\") pod \"dns-default-pndsb\" (UID: \"a6fc0e8f-0a92-40af-8e70-40e4dc38504c\") " pod="openshift-dns/dns-default-pndsb" Jul 05 07:47:00.063081 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:00.063059 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab7d905e-50ca-4fc8-861b-97c9a87c22c1-cert\") pod \"ingress-canary-6d2v5\" (UID: \"ab7d905e-50ca-4fc8-861b-97c9a87c22c1\") " pod="openshift-ingress-canary/ingress-canary-6d2v5" Jul 05 07:47:00.069441 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:00.069419 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgn6d\" (UniqueName: \"kubernetes.io/projected/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-kube-api-access-tgn6d\") pod \"dns-default-pndsb\" (UID: \"a6fc0e8f-0a92-40af-8e70-40e4dc38504c\") " pod="openshift-dns/dns-default-pndsb" Jul 05 07:47:00.069441 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:00.069427 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brpk5\" (UniqueName: \"kubernetes.io/projected/ab7d905e-50ca-4fc8-861b-97c9a87c22c1-kube-api-access-brpk5\") pod \"ingress-canary-6d2v5\" (UID: \"ab7d905e-50ca-4fc8-861b-97c9a87c22c1\") " pod="openshift-ingress-canary/ingress-canary-6d2v5" Jul 05 07:47:00.120210 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:00.120185 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:47:00.120210 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:00.120204 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:47:00.120363 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:00.120335 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:47:00.122987 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:00.122968 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 05 07:47:00.123143 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:00.122971 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 05 07:47:00.123246 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:00.123124 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 05 07:47:00.123307 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:00.123293 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 05 07:47:00.123409 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:00.123377 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rkspj\"" Jul 05 07:47:00.123508 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:00.123431 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bgn42\"" Jul 05 07:47:00.186119 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:00.186093 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6d2v5" Jul 05 07:47:00.495841 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:00.495818 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6d2v5"] Jul 05 07:47:00.509241 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:47:00.509213 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab7d905e_50ca_4fc8_861b_97c9a87c22c1.slice/crio-a7ff94cacbd4f1b7645134d3024aafb0c2c78e9fb874444caf924c6891671c98 WatchSource:0}: Error finding container a7ff94cacbd4f1b7645134d3024aafb0c2c78e9fb874444caf924c6891671c98: Status 404 returned error can't find the container with id a7ff94cacbd4f1b7645134d3024aafb0c2c78e9fb874444caf924c6891671c98 Jul 05 07:47:00.562289 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:00.562046 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-metrics-tls\") pod \"dns-default-pndsb\" (UID: \"a6fc0e8f-0a92-40af-8e70-40e4dc38504c\") " pod="openshift-dns/dns-default-pndsb" Jul 05 07:47:00.562362 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:47:00.562204 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 07:47:00.562419 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:47:00.562409 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-metrics-tls podName:a6fc0e8f-0a92-40af-8e70-40e4dc38504c nodeName:}" failed. No retries permitted until 2026-07-05 07:47:01.562394 +0000 UTC m=+36.982127036 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-metrics-tls") pod "dns-default-pndsb" (UID: "a6fc0e8f-0a92-40af-8e70-40e4dc38504c") : secret "dns-default-metrics-tls" not found Jul 05 07:47:01.450104 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:01.450062 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6d2v5" event={"ID":"ab7d905e-50ca-4fc8-861b-97c9a87c22c1","Type":"ContainerStarted","Data":"a7ff94cacbd4f1b7645134d3024aafb0c2c78e9fb874444caf924c6891671c98"} Jul 05 07:47:01.453102 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:01.453077 2566 generic.go:356] "Generic (PLEG): container finished" podID="b9bcc734-1c69-432f-bcb6-f2e88175856c" containerID="2f42f012598eb4a301dd2dea00e7eb816f481b78f4cd706748956aa9858d4b4b" exitCode=0 Jul 05 07:47:01.453222 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:01.453120 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9dnrn" event={"ID":"b9bcc734-1c69-432f-bcb6-f2e88175856c","Type":"ContainerDied","Data":"2f42f012598eb4a301dd2dea00e7eb816f481b78f4cd706748956aa9858d4b4b"} Jul 05 07:47:01.570025 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:01.570000 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-metrics-tls\") pod \"dns-default-pndsb\" (UID: \"a6fc0e8f-0a92-40af-8e70-40e4dc38504c\") " pod="openshift-dns/dns-default-pndsb" Jul 05 07:47:01.570183 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:47:01.570108 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 07:47:01.570257 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:47:01.570190 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-metrics-tls podName:a6fc0e8f-0a92-40af-8e70-40e4dc38504c nodeName:}" failed. No retries permitted until 2026-07-05 07:47:03.570172777 +0000 UTC m=+38.989905829 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-metrics-tls") pod "dns-default-pndsb" (UID: "a6fc0e8f-0a92-40af-8e70-40e4dc38504c") : secret "dns-default-metrics-tls" not found Jul 05 07:47:02.458994 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:02.458960 2566 generic.go:356] "Generic (PLEG): container finished" podID="b9bcc734-1c69-432f-bcb6-f2e88175856c" containerID="7f6f1078962535c57b1dbe24c45f7dae5d1f9d2f7682950cefef1cafb6b23ea1" exitCode=0 Jul 05 07:47:02.459424 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:02.459001 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9dnrn" event={"ID":"b9bcc734-1c69-432f-bcb6-f2e88175856c","Type":"ContainerDied","Data":"7f6f1078962535c57b1dbe24c45f7dae5d1f9d2f7682950cefef1cafb6b23ea1"} Jul 05 07:47:03.464248 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:03.464208 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9dnrn" event={"ID":"b9bcc734-1c69-432f-bcb6-f2e88175856c","Type":"ContainerStarted","Data":"93a1e20fa877e0f44bbac417a7b4c3a039838d22ab7bf2a70780f3e78e161d4f"} Jul 05 07:47:03.465511 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:03.465490 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6d2v5" event={"ID":"ab7d905e-50ca-4fc8-861b-97c9a87c22c1","Type":"ContainerStarted","Data":"853916855e0efb98fb520c1c38159228cbc0b7eadcae5baab4184638ffafd0d7"} Jul 05 07:47:03.486826 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:03.486113 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9dnrn" podStartSLOduration=7.453813141 podStartE2EDuration="38.486093473s" totalImagesPullingTime="31.032280332s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 07:46:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:47:03.484648991 +0000 UTC m=+38.904382057" watchObservedRunningTime="2026-07-05 07:47:03.486093473 +0000 UTC m=+38.905826530" Jul 05 07:47:03.498681 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:03.498634 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6d2v5" podStartSLOduration=2.122921133 podStartE2EDuration="4.498618808s" totalImagesPullingTime="2.375697675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 07:46:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:47:03.498314513 +0000 UTC m=+38.918047589" watchObservedRunningTime="2026-07-05 07:47:03.498618808 +0000 UTC m=+38.918351841" Jul 05 07:47:03.585707 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:03.585662 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-metrics-tls\") pod \"dns-default-pndsb\" (UID: \"a6fc0e8f-0a92-40af-8e70-40e4dc38504c\") " pod="openshift-dns/dns-default-pndsb" Jul 05 07:47:03.585906 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:47:03.585803 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 07:47:03.585906 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:47:03.585881 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-metrics-tls podName:a6fc0e8f-0a92-40af-8e70-40e4dc38504c nodeName:}" failed. No retries permitted until 2026-07-05 07:47:07.585861331 +0000 UTC m=+43.005594381 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-metrics-tls") pod "dns-default-pndsb" (UID: "a6fc0e8f-0a92-40af-8e70-40e4dc38504c") : secret "dns-default-metrics-tls" not found Jul 05 07:47:03.610542 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:03.610514 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:47:03.662591 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:03.662561 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:47:04.186191 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:04.186159 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:47:04.236150 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:04.236094 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:47:07.379919 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:07.379884 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:47:07.483892 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:07.483843 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:47:07.613299 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:07.613265 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-metrics-tls\") pod \"dns-default-pndsb\" (UID: \"a6fc0e8f-0a92-40af-8e70-40e4dc38504c\") " pod="openshift-dns/dns-default-pndsb" Jul 05 07:47:07.613459 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:47:07.613392 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 07:47:07.613459 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:47:07.613446 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-metrics-tls podName:a6fc0e8f-0a92-40af-8e70-40e4dc38504c nodeName:}" failed. No retries permitted until 2026-07-05 07:47:15.613432323 +0000 UTC m=+51.033165356 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-metrics-tls") pod "dns-default-pndsb" (UID: "a6fc0e8f-0a92-40af-8e70-40e4dc38504c") : secret "dns-default-metrics-tls" not found Jul 05 07:47:08.426425 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:08.426383 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:47:08.475416 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:08.475384 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:47:09.410572 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:09.410528 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:47:09.511953 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:09.511912 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:47:09.611858 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:09.611832 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:47:13.574096 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:13.574061 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:47:13.622619 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:13.622590 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:47:14.394000 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:14.393930 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:47:15.664388 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:15.664353 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-metrics-tls\") pod \"dns-default-pndsb\" (UID: \"a6fc0e8f-0a92-40af-8e70-40e4dc38504c\") " pod="openshift-dns/dns-default-pndsb" Jul 05 07:47:15.664765 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:47:15.664511 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 07:47:15.664765 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:47:15.664584 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-metrics-tls podName:a6fc0e8f-0a92-40af-8e70-40e4dc38504c nodeName:}" failed. No retries permitted until 2026-07-05 07:47:31.66456761 +0000 UTC m=+67.084300648 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-metrics-tls") pod "dns-default-pndsb" (UID: "a6fc0e8f-0a92-40af-8e70-40e4dc38504c") : secret "dns-default-metrics-tls" not found Jul 05 07:47:20.416504 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:20.416471 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:47:20.466530 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:20.466503 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:47:24.902810 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:24.902776 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:47:26.446922 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:26.446896 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hzvp7" Jul 05 07:47:26.591791 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:26.591755 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:47:26.645924 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:26.645901 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:47:27.533598 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:27.533545 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:47:27.609727 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:27.609680 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:47:29.850233 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:29.850194 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gdch\" (UniqueName: \"kubernetes.io/projected/8a151452-12d5-4a93-bffb-e93ee92e8e14-kube-api-access-7gdch\") pod \"network-check-target-2wssl\" (UID: \"8a151452-12d5-4a93-bffb-e93ee92e8e14\") " pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:47:29.850233 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:29.850240 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9eda60f4-0409-4ba2-882a-0fc06614194b-original-pull-secret\") pod \"global-pull-secret-syncer-qmlxc\" (UID: \"9eda60f4-0409-4ba2-882a-0fc06614194b\") " pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:47:29.850688 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:29.850260 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs\") pod \"network-metrics-daemon-mt69q\" (UID: \"2b6430fa-c37c-4cc9-81ab-3feb7300273e\") " pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:47:29.853008 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:29.852987 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 05 07:47:29.853129 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:29.853111 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 05 07:47:29.853182 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:29.853161 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 05 07:47:29.861323 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:47:29.861305 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 05 07:47:29.861398 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:47:29.861378 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs podName:2b6430fa-c37c-4cc9-81ab-3feb7300273e nodeName:}" failed. No retries permitted until 2026-07-05 07:48:33.861358009 +0000 UTC m=+129.281091043 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs") pod "network-metrics-daemon-mt69q" (UID: "2b6430fa-c37c-4cc9-81ab-3feb7300273e") : secret "metrics-daemon-secret" not found Jul 05 07:47:29.863521 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:29.863507 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 05 07:47:29.864573 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:29.864557 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9eda60f4-0409-4ba2-882a-0fc06614194b-original-pull-secret\") pod \"global-pull-secret-syncer-qmlxc\" (UID: \"9eda60f4-0409-4ba2-882a-0fc06614194b\") " pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:47:29.873867 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:29.873847 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gdch\" (UniqueName: \"kubernetes.io/projected/8a151452-12d5-4a93-bffb-e93ee92e8e14-kube-api-access-7gdch\") pod \"network-check-target-2wssl\" (UID: \"8a151452-12d5-4a93-bffb-e93ee92e8e14\") " pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:47:30.131273 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:30.131218 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qmlxc" Jul 05 07:47:30.146076 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:30.146057 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bgn42\"" Jul 05 07:47:30.153666 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:30.153653 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:47:30.274153 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:30.274109 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qmlxc"] Jul 05 07:47:30.277593 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:47:30.277568 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eda60f4_0409_4ba2_882a_0fc06614194b.slice/crio-728762229ffecc379ed3ddd2df8a73e1e3661d0c5a31d0c21da0ba56c5828977 WatchSource:0}: Error finding container 728762229ffecc379ed3ddd2df8a73e1e3661d0c5a31d0c21da0ba56c5828977: Status 404 returned error can't find the container with id 728762229ffecc379ed3ddd2df8a73e1e3661d0c5a31d0c21da0ba56c5828977 Jul 05 07:47:30.293902 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:30.293880 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2wssl"] Jul 05 07:47:30.296734 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:47:30.296703 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a151452_12d5_4a93_bffb_e93ee92e8e14.slice/crio-38e2a79523939b8aa27f476a25fb7e50aceb16163f719c9909ab654418bd4441 WatchSource:0}: Error finding container 38e2a79523939b8aa27f476a25fb7e50aceb16163f719c9909ab654418bd4441: Status 404 returned error can't find the container with id 38e2a79523939b8aa27f476a25fb7e50aceb16163f719c9909ab654418bd4441 Jul 05 07:47:30.526658 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:30.526627 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2wssl" event={"ID":"8a151452-12d5-4a93-bffb-e93ee92e8e14","Type":"ContainerStarted","Data":"38e2a79523939b8aa27f476a25fb7e50aceb16163f719c9909ab654418bd4441"} Jul 05 07:47:30.527805 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:30.527783 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qmlxc" event={"ID":"9eda60f4-0409-4ba2-882a-0fc06614194b","Type":"ContainerStarted","Data":"728762229ffecc379ed3ddd2df8a73e1e3661d0c5a31d0c21da0ba56c5828977"} Jul 05 07:47:31.665747 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:31.665658 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-metrics-tls\") pod \"dns-default-pndsb\" (UID: \"a6fc0e8f-0a92-40af-8e70-40e4dc38504c\") " pod="openshift-dns/dns-default-pndsb" Jul 05 07:47:31.666278 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:47:31.665761 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 07:47:31.666278 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:47:31.665829 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-metrics-tls podName:a6fc0e8f-0a92-40af-8e70-40e4dc38504c nodeName:}" failed. No retries permitted until 2026-07-05 07:48:03.665806694 +0000 UTC m=+99.085539743 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-metrics-tls") pod "dns-default-pndsb" (UID: "a6fc0e8f-0a92-40af-8e70-40e4dc38504c") : secret "dns-default-metrics-tls" not found Jul 05 07:47:35.541742 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:35.541706 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qmlxc" event={"ID":"9eda60f4-0409-4ba2-882a-0fc06614194b","Type":"ContainerStarted","Data":"8a3256a5f830c87b9029bacfc338a73637ed4ad1bf3dacae6749b304218a5486"} Jul 05 07:47:35.543051 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:35.543029 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2wssl" event={"ID":"8a151452-12d5-4a93-bffb-e93ee92e8e14","Type":"ContainerStarted","Data":"b166d01ade9d074c440dd56a622643ecd66aac1705fd434f37ba6c30b18274b6"} Jul 05 07:47:35.543189 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:35.543178 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:47:35.568049 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:35.568008 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qmlxc" podStartSLOduration=65.994124488 podStartE2EDuration="1m10.567996654s" totalImagesPullingTime="4.573872166s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 07:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:47:35.55460591 +0000 UTC m=+70.974338966" watchObservedRunningTime="2026-07-05 07:47:35.567996654 +0000 UTC m=+70.987729708" Jul 05 07:47:35.568424 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:35.568403 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2wssl" podStartSLOduration=66.016384705 podStartE2EDuration="1m10.568396075s" totalImagesPullingTime="4.55201137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 07:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:47:35.567499707 +0000 UTC m=+70.987232763" watchObservedRunningTime="2026-07-05 07:47:35.568396075 +0000 UTC m=+70.988129129" Jul 05 07:47:45.464199 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:45.464155 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:47:45.516809 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:45.516777 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:47:45.564775 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:47:45.564747 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:48:03.669662 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:48:03.669616 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-metrics-tls\") pod \"dns-default-pndsb\" (UID: \"a6fc0e8f-0a92-40af-8e70-40e4dc38504c\") " pod="openshift-dns/dns-default-pndsb" Jul 05 07:48:03.670178 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:48:03.669767 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 07:48:03.670178 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:48:03.669847 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-metrics-tls podName:a6fc0e8f-0a92-40af-8e70-40e4dc38504c nodeName:}" failed. No retries permitted until 2026-07-05 07:49:07.669829371 +0000 UTC m=+163.089562405 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-metrics-tls") pod "dns-default-pndsb" (UID: "a6fc0e8f-0a92-40af-8e70-40e4dc38504c") : secret "dns-default-metrics-tls" not found Jul 05 07:48:06.547741 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:48:06.547708 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2wssl" Jul 05 07:48:10.355203 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:48:10.355171 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d846fc544-7f5g2"] Jul 05 07:48:10.357763 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:48:10.357747 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d846fc544-7f5g2" Jul 05 07:48:10.361822 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:48:10.361803 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-2gstz\"" Jul 05 07:48:10.361952 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:48:10.361824 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 05 07:48:10.361952 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:48:10.361833 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 05 07:48:10.361952 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:48:10.361879 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 05 07:48:10.362216 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:48:10.362199 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 05 07:48:10.367989 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:48:10.367967 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d846fc544-7f5g2"] Jul 05 07:48:10.415348 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:48:10.415330 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mfbm\" (UniqueName: \"kubernetes.io/projected/21d83ec6-9ed8-4794-b1b1-2bbc5cba3955-kube-api-access-5mfbm\") pod \"managed-serviceaccount-addon-agent-7d846fc544-7f5g2\" (UID: \"21d83ec6-9ed8-4794-b1b1-2bbc5cba3955\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d846fc544-7f5g2" Jul 05 07:48:10.415443 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:48:10.415363 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/21d83ec6-9ed8-4794-b1b1-2bbc5cba3955-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d846fc544-7f5g2\" (UID: \"21d83ec6-9ed8-4794-b1b1-2bbc5cba3955\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d846fc544-7f5g2" Jul 05 07:48:10.515774 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:48:10.515751 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/21d83ec6-9ed8-4794-b1b1-2bbc5cba3955-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d846fc544-7f5g2\" (UID: \"21d83ec6-9ed8-4794-b1b1-2bbc5cba3955\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d846fc544-7f5g2" Jul 05 07:48:10.515851 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:48:10.515812 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mfbm\" (UniqueName: \"kubernetes.io/projected/21d83ec6-9ed8-4794-b1b1-2bbc5cba3955-kube-api-access-5mfbm\") pod \"managed-serviceaccount-addon-agent-7d846fc544-7f5g2\" (UID: \"21d83ec6-9ed8-4794-b1b1-2bbc5cba3955\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d846fc544-7f5g2" Jul 05 07:48:10.518068 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:48:10.518050 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/21d83ec6-9ed8-4794-b1b1-2bbc5cba3955-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d846fc544-7f5g2\" (UID: \"21d83ec6-9ed8-4794-b1b1-2bbc5cba3955\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d846fc544-7f5g2" Jul 05 07:48:10.528655 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:48:10.528634 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mfbm\" (UniqueName: \"kubernetes.io/projected/21d83ec6-9ed8-4794-b1b1-2bbc5cba3955-kube-api-access-5mfbm\") pod \"managed-serviceaccount-addon-agent-7d846fc544-7f5g2\" (UID: \"21d83ec6-9ed8-4794-b1b1-2bbc5cba3955\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d846fc544-7f5g2" Jul 05 07:48:10.675855 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:48:10.675800 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d846fc544-7f5g2" Jul 05 07:48:10.788982 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:48:10.788955 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d846fc544-7f5g2"] Jul 05 07:48:10.792065 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:48:10.792040 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21d83ec6_9ed8_4794_b1b1_2bbc5cba3955.slice/crio-f2f0313fa7282ffb8a0af0b981cd885acda3d6110b6f1ca31ae9c369840c0972 WatchSource:0}: Error finding container f2f0313fa7282ffb8a0af0b981cd885acda3d6110b6f1ca31ae9c369840c0972: Status 404 returned error can't find the container with id f2f0313fa7282ffb8a0af0b981cd885acda3d6110b6f1ca31ae9c369840c0972 Jul 05 07:48:11.628481 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:48:11.628430 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d846fc544-7f5g2" event={"ID":"21d83ec6-9ed8-4794-b1b1-2bbc5cba3955","Type":"ContainerStarted","Data":"f2f0313fa7282ffb8a0af0b981cd885acda3d6110b6f1ca31ae9c369840c0972"} Jul 05 07:48:14.636027 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:48:14.635981 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d846fc544-7f5g2" event={"ID":"21d83ec6-9ed8-4794-b1b1-2bbc5cba3955","Type":"ContainerStarted","Data":"487e3c8237c748072ae9fe718eb5c6d0c7e5ab8699afbbb12aa6e2d7c7dfea57"} Jul 05 07:48:14.651832 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:48:14.651786 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d846fc544-7f5g2" podStartSLOduration=1.831119841 podStartE2EDuration="4.651769513s" totalImagesPullingTime="2.820649672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 07:48:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:48:14.649953433 +0000 UTC m=+110.069686488" watchObservedRunningTime="2026-07-05 07:48:14.651769513 +0000 UTC m=+110.071502569" Jul 05 07:48:15.461146 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:48:15.461100 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:48:15.513091 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:48:15.513061 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:48:33.868414 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:48:33.868371 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs\") pod \"network-metrics-daemon-mt69q\" (UID: \"2b6430fa-c37c-4cc9-81ab-3feb7300273e\") " pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:48:33.868881 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:48:33.868498 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 05 07:48:33.868881 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:48:33.868552 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs podName:2b6430fa-c37c-4cc9-81ab-3feb7300273e nodeName:}" failed. No retries permitted until 2026-07-05 07:50:35.868537974 +0000 UTC m=+251.288271010 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs") pod "network-metrics-daemon-mt69q" (UID: "2b6430fa-c37c-4cc9-81ab-3feb7300273e") : secret "metrics-daemon-secret" not found Jul 05 07:49:02.880233 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:49:02.880180 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pndsb" podUID="a6fc0e8f-0a92-40af-8e70-40e4dc38504c" Jul 05 07:49:03.139072 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:49:03.138972 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mt69q" podUID="2b6430fa-c37c-4cc9-81ab-3feb7300273e" Jul 05 07:49:03.748616 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:49:03.748584 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pndsb" Jul 05 07:49:07.688000 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:49:07.687951 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-metrics-tls\") pod \"dns-default-pndsb\" (UID: \"a6fc0e8f-0a92-40af-8e70-40e4dc38504c\") " pod="openshift-dns/dns-default-pndsb" Jul 05 07:49:07.688408 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:49:07.688097 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 07:49:07.688408 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:49:07.688184 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-metrics-tls podName:a6fc0e8f-0a92-40af-8e70-40e4dc38504c nodeName:}" failed. No retries permitted until 2026-07-05 07:51:09.688166704 +0000 UTC m=+285.107899740 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-metrics-tls") pod "dns-default-pndsb" (UID: "a6fc0e8f-0a92-40af-8e70-40e4dc38504c") : secret "dns-default-metrics-tls" not found Jul 05 07:49:14.120386 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:49:14.120336 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:50:05.791776 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:05.791740 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:13.909304 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:13.909273 2566 generic.go:356] "Generic (PLEG): container finished" podID="21d83ec6-9ed8-4794-b1b1-2bbc5cba3955" containerID="487e3c8237c748072ae9fe718eb5c6d0c7e5ab8699afbbb12aa6e2d7c7dfea57" exitCode=255 Jul 05 07:50:13.909615 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:13.909322 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d846fc544-7f5g2" event={"ID":"21d83ec6-9ed8-4794-b1b1-2bbc5cba3955","Type":"ContainerDied","Data":"487e3c8237c748072ae9fe718eb5c6d0c7e5ab8699afbbb12aa6e2d7c7dfea57"} Jul 05 07:50:13.914999 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:13.914983 2566 scope.go:117] "RemoveContainer" containerID="487e3c8237c748072ae9fe718eb5c6d0c7e5ab8699afbbb12aa6e2d7c7dfea57" Jul 05 07:50:14.913790 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:14.913754 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d846fc544-7f5g2" event={"ID":"21d83ec6-9ed8-4794-b1b1-2bbc5cba3955","Type":"ContainerStarted","Data":"7b63c37e559021659fa9ac71c279cc6b67739c83b1076a07e52f013acec7f95f"} Jul 05 07:50:29.027671 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.027638 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5bf4ff6889-zjz47"] Jul 05 07:50:29.030535 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.030517 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b4754f8b-cp8mm"] Jul 05 07:50:29.030660 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.030641 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:50:29.033430 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.033408 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:29.033568 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.033459 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 05 07:50:29.033638 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.033600 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 05 07:50:29.033958 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.033942 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 05 07:50:29.034438 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.034418 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 05 07:50:29.034541 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.034452 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 05 07:50:29.034738 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.034720 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-c4whj\"" Jul 05 07:50:29.035010 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.034997 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 05 07:50:29.035875 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.035851 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hmr4g\"" Jul 05 07:50:29.036513 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.036494 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 05 07:50:29.037076 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.037056 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 05 07:50:29.037379 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.037361 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 05 07:50:29.045389 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.045373 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 05 07:50:29.048502 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.048480 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5bf4ff6889-zjz47"] Jul 05 07:50:29.049366 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.049344 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b4754f8b-cp8mm"] Jul 05 07:50:29.088883 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.088854 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-registry-tls\") pod \"image-registry-b4754f8b-cp8mm\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:29.088978 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.088886 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/44860d7b-edf6-41fa-889e-10aa1e202e6b-registry-certificates\") pod \"image-registry-b4754f8b-cp8mm\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:29.088978 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.088920 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/44860d7b-edf6-41fa-889e-10aa1e202e6b-ca-trust-extracted\") pod \"image-registry-b4754f8b-cp8mm\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:29.088978 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.088940 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/44860d7b-edf6-41fa-889e-10aa1e202e6b-trusted-ca\") pod \"image-registry-b4754f8b-cp8mm\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:29.089075 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.088988 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/44860d7b-edf6-41fa-889e-10aa1e202e6b-installation-pull-secrets\") pod \"image-registry-b4754f8b-cp8mm\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:29.089075 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.089021 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-bound-sa-token\") pod \"image-registry-b4754f8b-cp8mm\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:29.089075 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.089041 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d924fc46-4762-4449-a1b6-bec710c87473-default-certificate\") pod \"router-default-5bf4ff6889-zjz47\" (UID: \"d924fc46-4762-4449-a1b6-bec710c87473\") " pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:50:29.089075 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.089058 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n49q\" (UniqueName: \"kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-kube-api-access-8n49q\") pod \"image-registry-b4754f8b-cp8mm\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:29.089227 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.089081 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d924fc46-4762-4449-a1b6-bec710c87473-service-ca-bundle\") pod \"router-default-5bf4ff6889-zjz47\" (UID: \"d924fc46-4762-4449-a1b6-bec710c87473\") " pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:50:29.089227 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.089112 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjl57\" (UniqueName: \"kubernetes.io/projected/d924fc46-4762-4449-a1b6-bec710c87473-kube-api-access-tjl57\") pod \"router-default-5bf4ff6889-zjz47\" (UID: \"d924fc46-4762-4449-a1b6-bec710c87473\") " pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:50:29.089227 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.089197 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d924fc46-4762-4449-a1b6-bec710c87473-stats-auth\") pod \"router-default-5bf4ff6889-zjz47\" (UID: \"d924fc46-4762-4449-a1b6-bec710c87473\") " pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:50:29.089227 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.089212 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d924fc46-4762-4449-a1b6-bec710c87473-metrics-certs\") pod \"router-default-5bf4ff6889-zjz47\" (UID: \"d924fc46-4762-4449-a1b6-bec710c87473\") " pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:50:29.089355 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.089228 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/44860d7b-edf6-41fa-889e-10aa1e202e6b-image-registry-private-configuration\") pod \"image-registry-b4754f8b-cp8mm\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:29.127354 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.127334 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wpsxf"] Jul 05 07:50:29.130078 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.130064 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wpsxf" Jul 05 07:50:29.132730 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.132712 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 05 07:50:29.132832 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.132775 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 05 07:50:29.132898 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.132841 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5qjv9\"" Jul 05 07:50:29.133021 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.133005 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 05 07:50:29.140580 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.140562 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wpsxf"] Jul 05 07:50:29.189809 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.189789 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wlkh\" (UniqueName: \"kubernetes.io/projected/119ae6c1-756b-4255-bf55-1eaa15f9e400-kube-api-access-5wlkh\") pod \"cluster-samples-operator-56fcf86bf-wpsxf\" (UID: \"119ae6c1-756b-4255-bf55-1eaa15f9e400\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wpsxf" Jul 05 07:50:29.189901 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.189821 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d924fc46-4762-4449-a1b6-bec710c87473-stats-auth\") pod \"router-default-5bf4ff6889-zjz47\" (UID: \"d924fc46-4762-4449-a1b6-bec710c87473\") " pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:50:29.189901 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.189839 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d924fc46-4762-4449-a1b6-bec710c87473-metrics-certs\") pod \"router-default-5bf4ff6889-zjz47\" (UID: \"d924fc46-4762-4449-a1b6-bec710c87473\") " pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:50:29.189901 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.189857 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/44860d7b-edf6-41fa-889e-10aa1e202e6b-image-registry-private-configuration\") pod \"image-registry-b4754f8b-cp8mm\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:29.189901 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.189889 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-registry-tls\") pod \"image-registry-b4754f8b-cp8mm\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:29.190103 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.189914 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/44860d7b-edf6-41fa-889e-10aa1e202e6b-registry-certificates\") pod \"image-registry-b4754f8b-cp8mm\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:29.190103 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:29.189953 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 05 07:50:29.190103 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.189957 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/44860d7b-edf6-41fa-889e-10aa1e202e6b-ca-trust-extracted\") pod \"image-registry-b4754f8b-cp8mm\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:29.190103 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.189982 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/44860d7b-edf6-41fa-889e-10aa1e202e6b-trusted-ca\") pod \"image-registry-b4754f8b-cp8mm\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:29.190103 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:29.190011 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 05 07:50:29.190103 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:29.190032 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b4754f8b-cp8mm: secret "image-registry-tls" not found Jul 05 07:50:29.190427 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:29.190018 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d924fc46-4762-4449-a1b6-bec710c87473-metrics-certs podName:d924fc46-4762-4449-a1b6-bec710c87473 nodeName:}" failed. No retries permitted until 2026-07-05 07:50:29.689997917 +0000 UTC m=+245.109730964 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d924fc46-4762-4449-a1b6-bec710c87473-metrics-certs") pod "router-default-5bf4ff6889-zjz47" (UID: "d924fc46-4762-4449-a1b6-bec710c87473") : secret "router-metrics-certs-default" not found Jul 05 07:50:29.190427 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:29.190169 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-registry-tls podName:44860d7b-edf6-41fa-889e-10aa1e202e6b nodeName:}" failed. No retries permitted until 2026-07-05 07:50:29.6901501 +0000 UTC m=+245.109883148 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-registry-tls") pod "image-registry-b4754f8b-cp8mm" (UID: "44860d7b-edf6-41fa-889e-10aa1e202e6b") : secret "image-registry-tls" not found Jul 05 07:50:29.190427 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.190204 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/44860d7b-edf6-41fa-889e-10aa1e202e6b-installation-pull-secrets\") pod \"image-registry-b4754f8b-cp8mm\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:29.190427 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.190238 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-bound-sa-token\") pod \"image-registry-b4754f8b-cp8mm\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:29.190427 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.190262 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d924fc46-4762-4449-a1b6-bec710c87473-default-certificate\") pod \"router-default-5bf4ff6889-zjz47\" (UID: \"d924fc46-4762-4449-a1b6-bec710c87473\") " pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:50:29.190427 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.190289 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n49q\" (UniqueName: \"kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-kube-api-access-8n49q\") pod \"image-registry-b4754f8b-cp8mm\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:29.190427 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.190317 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d924fc46-4762-4449-a1b6-bec710c87473-service-ca-bundle\") pod \"router-default-5bf4ff6889-zjz47\" (UID: \"d924fc46-4762-4449-a1b6-bec710c87473\") " pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:50:29.190427 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.190343 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjl57\" (UniqueName: \"kubernetes.io/projected/d924fc46-4762-4449-a1b6-bec710c87473-kube-api-access-tjl57\") pod \"router-default-5bf4ff6889-zjz47\" (UID: \"d924fc46-4762-4449-a1b6-bec710c87473\") " pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:50:29.190427 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.190376 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/119ae6c1-756b-4255-bf55-1eaa15f9e400-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-wpsxf\" (UID: \"119ae6c1-756b-4255-bf55-1eaa15f9e400\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wpsxf" Jul 05 07:50:29.190427 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.190398 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/44860d7b-edf6-41fa-889e-10aa1e202e6b-ca-trust-extracted\") pod \"image-registry-b4754f8b-cp8mm\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:29.190876 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.190627 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/44860d7b-edf6-41fa-889e-10aa1e202e6b-registry-certificates\") pod \"image-registry-b4754f8b-cp8mm\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:29.190876 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:29.190647 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d924fc46-4762-4449-a1b6-bec710c87473-service-ca-bundle podName:d924fc46-4762-4449-a1b6-bec710c87473 nodeName:}" failed. No retries permitted until 2026-07-05 07:50:29.690632249 +0000 UTC m=+245.110365287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d924fc46-4762-4449-a1b6-bec710c87473-service-ca-bundle") pod "router-default-5bf4ff6889-zjz47" (UID: "d924fc46-4762-4449-a1b6-bec710c87473") : configmap references non-existent config key: service-ca.crt Jul 05 07:50:29.191071 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.190934 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/44860d7b-edf6-41fa-889e-10aa1e202e6b-trusted-ca\") pod \"image-registry-b4754f8b-cp8mm\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:29.192375 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.192354 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/44860d7b-edf6-41fa-889e-10aa1e202e6b-image-registry-private-configuration\") pod \"image-registry-b4754f8b-cp8mm\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:29.192451 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.192398 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d924fc46-4762-4449-a1b6-bec710c87473-stats-auth\") pod \"router-default-5bf4ff6889-zjz47\" (UID: \"d924fc46-4762-4449-a1b6-bec710c87473\") " pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:50:29.193029 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.193008 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/44860d7b-edf6-41fa-889e-10aa1e202e6b-installation-pull-secrets\") pod \"image-registry-b4754f8b-cp8mm\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:29.193067 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.193051 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d924fc46-4762-4449-a1b6-bec710c87473-default-certificate\") pod \"router-default-5bf4ff6889-zjz47\" (UID: \"d924fc46-4762-4449-a1b6-bec710c87473\") " pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:50:29.200012 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.199985 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-bound-sa-token\") pod \"image-registry-b4754f8b-cp8mm\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:29.200091 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.200024 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjl57\" (UniqueName: \"kubernetes.io/projected/d924fc46-4762-4449-a1b6-bec710c87473-kube-api-access-tjl57\") pod \"router-default-5bf4ff6889-zjz47\" (UID: \"d924fc46-4762-4449-a1b6-bec710c87473\") " pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:50:29.200620 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.200604 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n49q\" (UniqueName: \"kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-kube-api-access-8n49q\") pod \"image-registry-b4754f8b-cp8mm\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:29.266758 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.266730 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:29.290982 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.290940 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/119ae6c1-756b-4255-bf55-1eaa15f9e400-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-wpsxf\" (UID: \"119ae6c1-756b-4255-bf55-1eaa15f9e400\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wpsxf" Jul 05 07:50:29.290982 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.290972 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wlkh\" (UniqueName: \"kubernetes.io/projected/119ae6c1-756b-4255-bf55-1eaa15f9e400-kube-api-access-5wlkh\") pod \"cluster-samples-operator-56fcf86bf-wpsxf\" (UID: \"119ae6c1-756b-4255-bf55-1eaa15f9e400\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wpsxf" Jul 05 07:50:29.291117 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:29.291078 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 05 07:50:29.291196 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:29.291166 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/119ae6c1-756b-4255-bf55-1eaa15f9e400-samples-operator-tls podName:119ae6c1-756b-4255-bf55-1eaa15f9e400 nodeName:}" failed. No retries permitted until 2026-07-05 07:50:29.791149453 +0000 UTC m=+245.210882503 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/119ae6c1-756b-4255-bf55-1eaa15f9e400-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-wpsxf" (UID: "119ae6c1-756b-4255-bf55-1eaa15f9e400") : secret "samples-operator-tls" not found Jul 05 07:50:29.298566 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.298548 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wlkh\" (UniqueName: \"kubernetes.io/projected/119ae6c1-756b-4255-bf55-1eaa15f9e400-kube-api-access-5wlkh\") pod \"cluster-samples-operator-56fcf86bf-wpsxf\" (UID: \"119ae6c1-756b-4255-bf55-1eaa15f9e400\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wpsxf" Jul 05 07:50:29.366943 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.366915 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:29.694968 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.694881 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d924fc46-4762-4449-a1b6-bec710c87473-service-ca-bundle\") pod \"router-default-5bf4ff6889-zjz47\" (UID: \"d924fc46-4762-4449-a1b6-bec710c87473\") " pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:50:29.694968 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.694941 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d924fc46-4762-4449-a1b6-bec710c87473-metrics-certs\") pod \"router-default-5bf4ff6889-zjz47\" (UID: \"d924fc46-4762-4449-a1b6-bec710c87473\") " pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:50:29.695212 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.695035 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-registry-tls\") pod \"image-registry-b4754f8b-cp8mm\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:29.695212 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:29.695048 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 05 07:50:29.695212 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:29.695109 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d924fc46-4762-4449-a1b6-bec710c87473-metrics-certs podName:d924fc46-4762-4449-a1b6-bec710c87473 nodeName:}" failed. No retries permitted until 2026-07-05 07:50:30.695089195 +0000 UTC m=+246.114822230 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d924fc46-4762-4449-a1b6-bec710c87473-metrics-certs") pod "router-default-5bf4ff6889-zjz47" (UID: "d924fc46-4762-4449-a1b6-bec710c87473") : secret "router-metrics-certs-default" not found Jul 05 07:50:29.695212 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:29.695125 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d924fc46-4762-4449-a1b6-bec710c87473-service-ca-bundle podName:d924fc46-4762-4449-a1b6-bec710c87473 nodeName:}" failed. No retries permitted until 2026-07-05 07:50:30.695116684 +0000 UTC m=+246.114849717 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d924fc46-4762-4449-a1b6-bec710c87473-service-ca-bundle") pod "router-default-5bf4ff6889-zjz47" (UID: "d924fc46-4762-4449-a1b6-bec710c87473") : configmap references non-existent config key: service-ca.crt Jul 05 07:50:29.695212 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:29.695129 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 05 07:50:29.695212 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:29.695158 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b4754f8b-cp8mm: secret "image-registry-tls" not found Jul 05 07:50:29.695212 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:29.695213 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-registry-tls podName:44860d7b-edf6-41fa-889e-10aa1e202e6b nodeName:}" failed. No retries permitted until 2026-07-05 07:50:30.695197861 +0000 UTC m=+246.114930910 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-registry-tls") pod "image-registry-b4754f8b-cp8mm" (UID: "44860d7b-edf6-41fa-889e-10aa1e202e6b") : secret "image-registry-tls" not found Jul 05 07:50:29.796084 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:29.796050 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/119ae6c1-756b-4255-bf55-1eaa15f9e400-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-wpsxf\" (UID: \"119ae6c1-756b-4255-bf55-1eaa15f9e400\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wpsxf" Jul 05 07:50:29.796236 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:29.796189 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 05 07:50:29.796278 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:29.796238 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/119ae6c1-756b-4255-bf55-1eaa15f9e400-samples-operator-tls podName:119ae6c1-756b-4255-bf55-1eaa15f9e400 nodeName:}" failed. No retries permitted until 2026-07-05 07:50:30.796226019 +0000 UTC m=+246.215959052 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/119ae6c1-756b-4255-bf55-1eaa15f9e400-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-wpsxf" (UID: "119ae6c1-756b-4255-bf55-1eaa15f9e400") : secret "samples-operator-tls" not found Jul 05 07:50:30.704525 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:30.704489 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d924fc46-4762-4449-a1b6-bec710c87473-metrics-certs\") pod \"router-default-5bf4ff6889-zjz47\" (UID: \"d924fc46-4762-4449-a1b6-bec710c87473\") " pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:50:30.704525 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:30.704531 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-registry-tls\") pod \"image-registry-b4754f8b-cp8mm\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:30.704950 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:30.704575 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d924fc46-4762-4449-a1b6-bec710c87473-service-ca-bundle\") pod \"router-default-5bf4ff6889-zjz47\" (UID: \"d924fc46-4762-4449-a1b6-bec710c87473\") " pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:50:30.704950 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:30.704635 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 05 07:50:30.704950 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:30.704696 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d924fc46-4762-4449-a1b6-bec710c87473-metrics-certs podName:d924fc46-4762-4449-a1b6-bec710c87473 nodeName:}" failed. No retries permitted until 2026-07-05 07:50:32.704679593 +0000 UTC m=+248.124412625 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d924fc46-4762-4449-a1b6-bec710c87473-metrics-certs") pod "router-default-5bf4ff6889-zjz47" (UID: "d924fc46-4762-4449-a1b6-bec710c87473") : secret "router-metrics-certs-default" not found Jul 05 07:50:30.704950 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:30.704698 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 05 07:50:30.704950 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:30.704708 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d924fc46-4762-4449-a1b6-bec710c87473-service-ca-bundle podName:d924fc46-4762-4449-a1b6-bec710c87473 nodeName:}" failed. No retries permitted until 2026-07-05 07:50:32.704702117 +0000 UTC m=+248.124435150 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d924fc46-4762-4449-a1b6-bec710c87473-service-ca-bundle") pod "router-default-5bf4ff6889-zjz47" (UID: "d924fc46-4762-4449-a1b6-bec710c87473") : configmap references non-existent config key: service-ca.crt Jul 05 07:50:30.704950 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:30.704713 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b4754f8b-cp8mm: secret "image-registry-tls" not found Jul 05 07:50:30.704950 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:30.704746 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-registry-tls podName:44860d7b-edf6-41fa-889e-10aa1e202e6b nodeName:}" failed. No retries permitted until 2026-07-05 07:50:32.704731017 +0000 UTC m=+248.124464054 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-registry-tls") pod "image-registry-b4754f8b-cp8mm" (UID: "44860d7b-edf6-41fa-889e-10aa1e202e6b") : secret "image-registry-tls" not found Jul 05 07:50:30.805012 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:30.804982 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/119ae6c1-756b-4255-bf55-1eaa15f9e400-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-wpsxf\" (UID: \"119ae6c1-756b-4255-bf55-1eaa15f9e400\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wpsxf" Jul 05 07:50:30.805166 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:30.805095 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 05 07:50:30.805239 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:30.805169 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/119ae6c1-756b-4255-bf55-1eaa15f9e400-samples-operator-tls podName:119ae6c1-756b-4255-bf55-1eaa15f9e400 nodeName:}" failed. No retries permitted until 2026-07-05 07:50:32.805152291 +0000 UTC m=+248.224885329 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/119ae6c1-756b-4255-bf55-1eaa15f9e400-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-wpsxf" (UID: "119ae6c1-756b-4255-bf55-1eaa15f9e400") : secret "samples-operator-tls" not found Jul 05 07:50:31.032629 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:31.032595 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:31.080851 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:31.080826 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:32.719885 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:32.719856 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d924fc46-4762-4449-a1b6-bec710c87473-service-ca-bundle\") pod \"router-default-5bf4ff6889-zjz47\" (UID: \"d924fc46-4762-4449-a1b6-bec710c87473\") " pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:50:32.720281 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:32.719907 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d924fc46-4762-4449-a1b6-bec710c87473-metrics-certs\") pod \"router-default-5bf4ff6889-zjz47\" (UID: \"d924fc46-4762-4449-a1b6-bec710c87473\") " pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:50:32.720281 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:32.719943 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-registry-tls\") pod \"image-registry-b4754f8b-cp8mm\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:32.720281 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:32.720018 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 05 07:50:32.720281 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:32.720038 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d924fc46-4762-4449-a1b6-bec710c87473-service-ca-bundle podName:d924fc46-4762-4449-a1b6-bec710c87473 nodeName:}" failed. No retries permitted until 2026-07-05 07:50:36.720016495 +0000 UTC m=+252.139749546 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d924fc46-4762-4449-a1b6-bec710c87473-service-ca-bundle") pod "router-default-5bf4ff6889-zjz47" (UID: "d924fc46-4762-4449-a1b6-bec710c87473") : configmap references non-existent config key: service-ca.crt Jul 05 07:50:32.720281 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:32.720054 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 05 07:50:32.720281 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:32.720066 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b4754f8b-cp8mm: secret "image-registry-tls" not found Jul 05 07:50:32.720281 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:32.720069 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d924fc46-4762-4449-a1b6-bec710c87473-metrics-certs podName:d924fc46-4762-4449-a1b6-bec710c87473 nodeName:}" failed. No retries permitted until 2026-07-05 07:50:36.720056863 +0000 UTC m=+252.139789897 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d924fc46-4762-4449-a1b6-bec710c87473-metrics-certs") pod "router-default-5bf4ff6889-zjz47" (UID: "d924fc46-4762-4449-a1b6-bec710c87473") : secret "router-metrics-certs-default" not found Jul 05 07:50:32.720281 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:32.720099 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-registry-tls podName:44860d7b-edf6-41fa-889e-10aa1e202e6b nodeName:}" failed. No retries permitted until 2026-07-05 07:50:36.720088745 +0000 UTC m=+252.139821781 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-registry-tls") pod "image-registry-b4754f8b-cp8mm" (UID: "44860d7b-edf6-41fa-889e-10aa1e202e6b") : secret "image-registry-tls" not found Jul 05 07:50:32.820551 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:32.820519 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/119ae6c1-756b-4255-bf55-1eaa15f9e400-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-wpsxf\" (UID: \"119ae6c1-756b-4255-bf55-1eaa15f9e400\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wpsxf" Jul 05 07:50:32.820698 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:32.820632 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 05 07:50:32.820698 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:32.820677 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/119ae6c1-756b-4255-bf55-1eaa15f9e400-samples-operator-tls podName:119ae6c1-756b-4255-bf55-1eaa15f9e400 nodeName:}" failed. No retries permitted until 2026-07-05 07:50:36.820664898 +0000 UTC m=+252.240397936 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/119ae6c1-756b-4255-bf55-1eaa15f9e400-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-wpsxf" (UID: "119ae6c1-756b-4255-bf55-1eaa15f9e400") : secret "samples-operator-tls" not found Jul 05 07:50:34.751758 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:34.751713 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:34.841568 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:34.841539 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:34.942247 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:34.942211 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:34.996820 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:34.996777 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:35.040041 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:35.040018 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-f24dc"] Jul 05 07:50:35.044107 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:35.044092 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f24dc" Jul 05 07:50:35.046819 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:35.046798 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 05 07:50:35.046919 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:35.046879 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 05 07:50:35.047048 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:35.047031 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qvgqr\"" Jul 05 07:50:35.048251 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:35.048233 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 05 07:50:35.048349 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:35.048304 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 05 07:50:35.053824 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:35.053801 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f24dc"] Jul 05 07:50:35.075277 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:35.075254 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:35.136047 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:35.136023 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aca8f321-4806-4a75-8598-c6b0a6494cf1-data-volume\") pod \"insights-runtime-extractor-f24dc\" (UID: \"aca8f321-4806-4a75-8598-c6b0a6494cf1\") " pod="openshift-insights/insights-runtime-extractor-f24dc" Jul 05 07:50:35.136148 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:35.136050 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x55jk\" (UniqueName: \"kubernetes.io/projected/aca8f321-4806-4a75-8598-c6b0a6494cf1-kube-api-access-x55jk\") pod \"insights-runtime-extractor-f24dc\" (UID: \"aca8f321-4806-4a75-8598-c6b0a6494cf1\") " pod="openshift-insights/insights-runtime-extractor-f24dc" Jul 05 07:50:35.136148 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:35.136069 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aca8f321-4806-4a75-8598-c6b0a6494cf1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f24dc\" (UID: \"aca8f321-4806-4a75-8598-c6b0a6494cf1\") " pod="openshift-insights/insights-runtime-extractor-f24dc" Jul 05 07:50:35.136231 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:35.136198 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aca8f321-4806-4a75-8598-c6b0a6494cf1-crio-socket\") pod \"insights-runtime-extractor-f24dc\" (UID: \"aca8f321-4806-4a75-8598-c6b0a6494cf1\") " pod="openshift-insights/insights-runtime-extractor-f24dc" Jul 05 07:50:35.136264 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:35.136229 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aca8f321-4806-4a75-8598-c6b0a6494cf1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f24dc\" (UID: \"aca8f321-4806-4a75-8598-c6b0a6494cf1\") " pod="openshift-insights/insights-runtime-extractor-f24dc" Jul 05 07:50:35.236765 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:35.236726 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aca8f321-4806-4a75-8598-c6b0a6494cf1-crio-socket\") pod \"insights-runtime-extractor-f24dc\" (UID: \"aca8f321-4806-4a75-8598-c6b0a6494cf1\") " pod="openshift-insights/insights-runtime-extractor-f24dc" Jul 05 07:50:35.236893 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:35.236784 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aca8f321-4806-4a75-8598-c6b0a6494cf1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f24dc\" (UID: \"aca8f321-4806-4a75-8598-c6b0a6494cf1\") " pod="openshift-insights/insights-runtime-extractor-f24dc" Jul 05 07:50:35.236893 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:35.236820 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aca8f321-4806-4a75-8598-c6b0a6494cf1-data-volume\") pod \"insights-runtime-extractor-f24dc\" (UID: \"aca8f321-4806-4a75-8598-c6b0a6494cf1\") " pod="openshift-insights/insights-runtime-extractor-f24dc" Jul 05 07:50:35.236893 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:35.236836 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x55jk\" (UniqueName: \"kubernetes.io/projected/aca8f321-4806-4a75-8598-c6b0a6494cf1-kube-api-access-x55jk\") pod \"insights-runtime-extractor-f24dc\" (UID: \"aca8f321-4806-4a75-8598-c6b0a6494cf1\") " pod="openshift-insights/insights-runtime-extractor-f24dc" Jul 05 07:50:35.236893 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:35.236853 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aca8f321-4806-4a75-8598-c6b0a6494cf1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f24dc\" (UID: \"aca8f321-4806-4a75-8598-c6b0a6494cf1\") " pod="openshift-insights/insights-runtime-extractor-f24dc" Jul 05 07:50:35.236893 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:35.236853 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aca8f321-4806-4a75-8598-c6b0a6494cf1-crio-socket\") pod \"insights-runtime-extractor-f24dc\" (UID: \"aca8f321-4806-4a75-8598-c6b0a6494cf1\") " pod="openshift-insights/insights-runtime-extractor-f24dc" Jul 05 07:50:35.237231 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:35.236927 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 07:50:35.237231 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:35.236960 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 07:50:35.237231 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:35.237000 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aca8f321-4806-4a75-8598-c6b0a6494cf1-insights-runtime-extractor-tls podName:aca8f321-4806-4a75-8598-c6b0a6494cf1 nodeName:}" failed. No retries permitted until 2026-07-05 07:50:35.736978617 +0000 UTC m=+251.156711664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aca8f321-4806-4a75-8598-c6b0a6494cf1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f24dc" (UID: "aca8f321-4806-4a75-8598-c6b0a6494cf1") : secret "insights-runtime-extractor-tls" not found Jul 05 07:50:35.237231 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:35.237032 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aca8f321-4806-4a75-8598-c6b0a6494cf1-kube-rbac-proxy-cm podName:aca8f321-4806-4a75-8598-c6b0a6494cf1 nodeName:}" failed. No retries permitted until 2026-07-05 07:50:35.737016436 +0000 UTC m=+251.156749473 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aca8f321-4806-4a75-8598-c6b0a6494cf1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f24dc" (UID: "aca8f321-4806-4a75-8598-c6b0a6494cf1") : configmap "kube-rbac-proxy" not found Jul 05 07:50:35.237231 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:35.237221 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aca8f321-4806-4a75-8598-c6b0a6494cf1-data-volume\") pod \"insights-runtime-extractor-f24dc\" (UID: \"aca8f321-4806-4a75-8598-c6b0a6494cf1\") " pod="openshift-insights/insights-runtime-extractor-f24dc" Jul 05 07:50:35.244378 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:35.244361 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x55jk\" (UniqueName: \"kubernetes.io/projected/aca8f321-4806-4a75-8598-c6b0a6494cf1-kube-api-access-x55jk\") pod \"insights-runtime-extractor-f24dc\" (UID: \"aca8f321-4806-4a75-8598-c6b0a6494cf1\") " pod="openshift-insights/insights-runtime-extractor-f24dc" Jul 05 07:50:35.439645 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:35.439570 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:35.540729 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:35.540701 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:35.741927 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:35.741847 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aca8f321-4806-4a75-8598-c6b0a6494cf1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f24dc\" (UID: \"aca8f321-4806-4a75-8598-c6b0a6494cf1\") " pod="openshift-insights/insights-runtime-extractor-f24dc" Jul 05 07:50:35.741927 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:35.741906 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aca8f321-4806-4a75-8598-c6b0a6494cf1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f24dc\" (UID: \"aca8f321-4806-4a75-8598-c6b0a6494cf1\") " pod="openshift-insights/insights-runtime-extractor-f24dc" Jul 05 07:50:35.742088 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:35.741964 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 07:50:35.742088 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:35.741989 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 07:50:35.742088 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:35.742012 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aca8f321-4806-4a75-8598-c6b0a6494cf1-kube-rbac-proxy-cm podName:aca8f321-4806-4a75-8598-c6b0a6494cf1 nodeName:}" failed. No retries permitted until 2026-07-05 07:50:36.741999532 +0000 UTC m=+252.161732564 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aca8f321-4806-4a75-8598-c6b0a6494cf1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f24dc" (UID: "aca8f321-4806-4a75-8598-c6b0a6494cf1") : configmap "kube-rbac-proxy" not found Jul 05 07:50:35.742088 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:35.742048 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aca8f321-4806-4a75-8598-c6b0a6494cf1-insights-runtime-extractor-tls podName:aca8f321-4806-4a75-8598-c6b0a6494cf1 nodeName:}" failed. No retries permitted until 2026-07-05 07:50:36.742035058 +0000 UTC m=+252.161768091 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aca8f321-4806-4a75-8598-c6b0a6494cf1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f24dc" (UID: "aca8f321-4806-4a75-8598-c6b0a6494cf1") : secret "insights-runtime-extractor-tls" not found Jul 05 07:50:35.942829 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:35.942804 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs\") pod \"network-metrics-daemon-mt69q\" (UID: \"2b6430fa-c37c-4cc9-81ab-3feb7300273e\") " pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:50:35.943155 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:35.942937 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 05 07:50:35.943155 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:35.942989 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs podName:2b6430fa-c37c-4cc9-81ab-3feb7300273e nodeName:}" failed. No retries permitted until 2026-07-05 07:52:37.942975921 +0000 UTC m=+373.362708953 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs") pod "network-metrics-daemon-mt69q" (UID: "2b6430fa-c37c-4cc9-81ab-3feb7300273e") : secret "metrics-daemon-secret" not found Jul 05 07:50:36.749944 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:36.749912 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aca8f321-4806-4a75-8598-c6b0a6494cf1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f24dc\" (UID: \"aca8f321-4806-4a75-8598-c6b0a6494cf1\") " pod="openshift-insights/insights-runtime-extractor-f24dc" Jul 05 07:50:36.749944 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:36.749949 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d924fc46-4762-4449-a1b6-bec710c87473-metrics-certs\") pod \"router-default-5bf4ff6889-zjz47\" (UID: \"d924fc46-4762-4449-a1b6-bec710c87473\") " pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:50:36.750162 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:36.750003 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d924fc46-4762-4449-a1b6-bec710c87473-service-ca-bundle\") pod \"router-default-5bf4ff6889-zjz47\" (UID: \"d924fc46-4762-4449-a1b6-bec710c87473\") " pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:50:36.750162 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:36.750030 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 07:50:36.750162 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:36.750047 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aca8f321-4806-4a75-8598-c6b0a6494cf1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f24dc\" (UID: \"aca8f321-4806-4a75-8598-c6b0a6494cf1\") " pod="openshift-insights/insights-runtime-extractor-f24dc" Jul 05 07:50:36.750162 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:36.750091 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aca8f321-4806-4a75-8598-c6b0a6494cf1-kube-rbac-proxy-cm podName:aca8f321-4806-4a75-8598-c6b0a6494cf1 nodeName:}" failed. No retries permitted until 2026-07-05 07:50:38.750074082 +0000 UTC m=+254.169807135 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aca8f321-4806-4a75-8598-c6b0a6494cf1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f24dc" (UID: "aca8f321-4806-4a75-8598-c6b0a6494cf1") : configmap "kube-rbac-proxy" not found Jul 05 07:50:36.750162 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:36.750155 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 07:50:36.750397 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:36.750164 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 05 07:50:36.750397 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:36.750186 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d924fc46-4762-4449-a1b6-bec710c87473-service-ca-bundle podName:d924fc46-4762-4449-a1b6-bec710c87473 nodeName:}" failed. No retries permitted until 2026-07-05 07:50:44.750168323 +0000 UTC m=+260.169901370 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d924fc46-4762-4449-a1b6-bec710c87473-service-ca-bundle") pod "router-default-5bf4ff6889-zjz47" (UID: "d924fc46-4762-4449-a1b6-bec710c87473") : configmap references non-existent config key: service-ca.crt Jul 05 07:50:36.750397 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:36.750210 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aca8f321-4806-4a75-8598-c6b0a6494cf1-insights-runtime-extractor-tls podName:aca8f321-4806-4a75-8598-c6b0a6494cf1 nodeName:}" failed. No retries permitted until 2026-07-05 07:50:38.750201134 +0000 UTC m=+254.169934168 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aca8f321-4806-4a75-8598-c6b0a6494cf1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f24dc" (UID: "aca8f321-4806-4a75-8598-c6b0a6494cf1") : secret "insights-runtime-extractor-tls" not found Jul 05 07:50:36.750397 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:36.750233 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-registry-tls\") pod \"image-registry-b4754f8b-cp8mm\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:36.750397 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:36.750285 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d924fc46-4762-4449-a1b6-bec710c87473-metrics-certs podName:d924fc46-4762-4449-a1b6-bec710c87473 nodeName:}" failed. No retries permitted until 2026-07-05 07:50:44.750277397 +0000 UTC m=+260.170010431 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d924fc46-4762-4449-a1b6-bec710c87473-metrics-certs") pod "router-default-5bf4ff6889-zjz47" (UID: "d924fc46-4762-4449-a1b6-bec710c87473") : secret "router-metrics-certs-default" not found Jul 05 07:50:36.750397 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:36.750311 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 05 07:50:36.750397 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:36.750332 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b4754f8b-cp8mm: secret "image-registry-tls" not found Jul 05 07:50:36.750397 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:36.750385 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-registry-tls podName:44860d7b-edf6-41fa-889e-10aa1e202e6b nodeName:}" failed. No retries permitted until 2026-07-05 07:50:44.750369677 +0000 UTC m=+260.170102723 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-registry-tls") pod "image-registry-b4754f8b-cp8mm" (UID: "44860d7b-edf6-41fa-889e-10aa1e202e6b") : secret "image-registry-tls" not found Jul 05 07:50:36.850863 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:36.850837 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/119ae6c1-756b-4255-bf55-1eaa15f9e400-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-wpsxf\" (UID: \"119ae6c1-756b-4255-bf55-1eaa15f9e400\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wpsxf" Jul 05 07:50:36.850982 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:36.850927 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 05 07:50:36.850982 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:36.850964 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/119ae6c1-756b-4255-bf55-1eaa15f9e400-samples-operator-tls podName:119ae6c1-756b-4255-bf55-1eaa15f9e400 nodeName:}" failed. No retries permitted until 2026-07-05 07:50:44.850954616 +0000 UTC m=+260.270687648 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/119ae6c1-756b-4255-bf55-1eaa15f9e400-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-wpsxf" (UID: "119ae6c1-756b-4255-bf55-1eaa15f9e400") : secret "samples-operator-tls" not found Jul 05 07:50:37.076104 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:37.076064 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:37.125107 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:37.125078 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:37.937338 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:37.937308 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:38.122040 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:38.122017 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q7zq5_a50d8e5b-1a7b-4028-846e-73a293b0e9e2/dns-node-resolver/0.log" Jul 05 07:50:38.764969 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:38.764928 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aca8f321-4806-4a75-8598-c6b0a6494cf1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f24dc\" (UID: \"aca8f321-4806-4a75-8598-c6b0a6494cf1\") " pod="openshift-insights/insights-runtime-extractor-f24dc" Jul 05 07:50:38.765119 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:38.764993 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aca8f321-4806-4a75-8598-c6b0a6494cf1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f24dc\" (UID: \"aca8f321-4806-4a75-8598-c6b0a6494cf1\") " pod="openshift-insights/insights-runtime-extractor-f24dc" Jul 05 07:50:38.765119 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:38.765070 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 07:50:38.765245 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:38.765071 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 07:50:38.765245 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:38.765171 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aca8f321-4806-4a75-8598-c6b0a6494cf1-insights-runtime-extractor-tls podName:aca8f321-4806-4a75-8598-c6b0a6494cf1 nodeName:}" failed. No retries permitted until 2026-07-05 07:50:42.765117297 +0000 UTC m=+258.184850332 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aca8f321-4806-4a75-8598-c6b0a6494cf1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f24dc" (UID: "aca8f321-4806-4a75-8598-c6b0a6494cf1") : secret "insights-runtime-extractor-tls" not found Jul 05 07:50:38.765245 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:38.765218 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aca8f321-4806-4a75-8598-c6b0a6494cf1-kube-rbac-proxy-cm podName:aca8f321-4806-4a75-8598-c6b0a6494cf1 nodeName:}" failed. No retries permitted until 2026-07-05 07:50:42.765200146 +0000 UTC m=+258.184933181 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aca8f321-4806-4a75-8598-c6b0a6494cf1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f24dc" (UID: "aca8f321-4806-4a75-8598-c6b0a6494cf1") : configmap "kube-rbac-proxy" not found Jul 05 07:50:38.921490 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:38.921467 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z2h2b_0a695ef6-9710-4847-bde7-ae627055ffab/node-ca/0.log" Jul 05 07:50:38.995429 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:38.995405 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:39.125024 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:39.124960 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:39.225609 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:39.225586 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:39.413755 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:39.413701 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:39.503215 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:39.503193 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:39.522265 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:39.522248 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6d2v5_ab7d905e-50ca-4fc8-861b-97c9a87c22c1/serve-healthcheck-canary/0.log" Jul 05 07:50:39.604042 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:39.604023 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:39.704597 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:39.704522 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:40.224308 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:40.224276 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:40.324128 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:40.324102 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:40.702770 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:40.702727 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:41.494417 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:41.494377 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:41.693962 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:41.693935 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:42.095702 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:42.095669 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:42.297938 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:42.297906 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:42.793408 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:42.793375 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aca8f321-4806-4a75-8598-c6b0a6494cf1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f24dc\" (UID: \"aca8f321-4806-4a75-8598-c6b0a6494cf1\") " pod="openshift-insights/insights-runtime-extractor-f24dc" Jul 05 07:50:42.793820 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:42.793440 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aca8f321-4806-4a75-8598-c6b0a6494cf1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f24dc\" (UID: \"aca8f321-4806-4a75-8598-c6b0a6494cf1\") " pod="openshift-insights/insights-runtime-extractor-f24dc" Jul 05 07:50:42.793820 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:42.793520 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 07:50:42.793820 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:42.793579 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aca8f321-4806-4a75-8598-c6b0a6494cf1-insights-runtime-extractor-tls podName:aca8f321-4806-4a75-8598-c6b0a6494cf1 nodeName:}" failed. No retries permitted until 2026-07-05 07:50:50.793564916 +0000 UTC m=+266.213297949 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aca8f321-4806-4a75-8598-c6b0a6494cf1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f24dc" (UID: "aca8f321-4806-4a75-8598-c6b0a6494cf1") : secret "insights-runtime-extractor-tls" not found Jul 05 07:50:42.793820 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:42.793521 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 07:50:42.793820 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:42.793671 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aca8f321-4806-4a75-8598-c6b0a6494cf1-kube-rbac-proxy-cm podName:aca8f321-4806-4a75-8598-c6b0a6494cf1 nodeName:}" failed. No retries permitted until 2026-07-05 07:50:50.793652205 +0000 UTC m=+266.213385239 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aca8f321-4806-4a75-8598-c6b0a6494cf1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f24dc" (UID: "aca8f321-4806-4a75-8598-c6b0a6494cf1") : configmap "kube-rbac-proxy" not found Jul 05 07:50:42.895332 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:42.895307 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:42.940704 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:42.940683 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:43.298372 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:43.298342 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:43.694187 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:43.694093 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:43.897211 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:43.897184 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:44.502739 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:44.502707 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:44.557062 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:44.557041 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:44.806828 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:44.806797 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d924fc46-4762-4449-a1b6-bec710c87473-metrics-certs\") pod \"router-default-5bf4ff6889-zjz47\" (UID: \"d924fc46-4762-4449-a1b6-bec710c87473\") " pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:50:44.806948 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:44.806855 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d924fc46-4762-4449-a1b6-bec710c87473-service-ca-bundle\") pod \"router-default-5bf4ff6889-zjz47\" (UID: \"d924fc46-4762-4449-a1b6-bec710c87473\") " pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:50:44.806948 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:44.806916 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-registry-tls\") pod \"image-registry-b4754f8b-cp8mm\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:44.807042 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:50:44.807027 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d924fc46-4762-4449-a1b6-bec710c87473-service-ca-bundle podName:d924fc46-4762-4449-a1b6-bec710c87473 nodeName:}" failed. No retries permitted until 2026-07-05 07:51:00.807012074 +0000 UTC m=+276.226745106 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d924fc46-4762-4449-a1b6-bec710c87473-service-ca-bundle") pod "router-default-5bf4ff6889-zjz47" (UID: "d924fc46-4762-4449-a1b6-bec710c87473") : configmap references non-existent config key: service-ca.crt Jul 05 07:50:44.809309 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:44.809279 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d924fc46-4762-4449-a1b6-bec710c87473-metrics-certs\") pod \"router-default-5bf4ff6889-zjz47\" (UID: \"d924fc46-4762-4449-a1b6-bec710c87473\") " pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:50:44.809410 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:44.809372 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-registry-tls\") pod \"image-registry-b4754f8b-cp8mm\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:44.900830 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:44.900804 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:44.907955 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:44.907934 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/119ae6c1-756b-4255-bf55-1eaa15f9e400-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-wpsxf\" (UID: \"119ae6c1-756b-4255-bf55-1eaa15f9e400\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wpsxf" Jul 05 07:50:44.909926 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:44.909901 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/119ae6c1-756b-4255-bf55-1eaa15f9e400-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-wpsxf\" (UID: \"119ae6c1-756b-4255-bf55-1eaa15f9e400\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wpsxf" Jul 05 07:50:44.947340 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:44.947319 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:45.038397 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:45.038370 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wpsxf" Jul 05 07:50:45.073036 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:45.072968 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b4754f8b-cp8mm"] Jul 05 07:50:45.076408 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:50:45.076381 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44860d7b_edf6_41fa_889e_10aa1e202e6b.slice/crio-58d5728084b19bee23111e2df09d81b12761b21a087acc6f7689ef1f44619cfa WatchSource:0}: Error finding container 58d5728084b19bee23111e2df09d81b12761b21a087acc6f7689ef1f44619cfa: Status 404 returned error can't find the container with id 58d5728084b19bee23111e2df09d81b12761b21a087acc6f7689ef1f44619cfa Jul 05 07:50:45.122552 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:45.122505 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:45.168231 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:45.168208 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wpsxf"] Jul 05 07:50:45.471989 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:45.471910 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:45.697473 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:45.697434 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:45.989799 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:45.989720 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" event={"ID":"44860d7b-edf6-41fa-889e-10aa1e202e6b","Type":"ContainerStarted","Data":"29a0c3082d6e2892347acd48dfa51df24e3a9095f2995d3c41de3086b7d78f2c"} Jul 05 07:50:45.990396 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:45.989812 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" event={"ID":"44860d7b-edf6-41fa-889e-10aa1e202e6b","Type":"ContainerStarted","Data":"58d5728084b19bee23111e2df09d81b12761b21a087acc6f7689ef1f44619cfa"} Jul 05 07:50:45.990396 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:45.989839 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:50:45.990984 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:45.990955 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wpsxf" event={"ID":"119ae6c1-756b-4255-bf55-1eaa15f9e400","Type":"ContainerStarted","Data":"6d75f3999c950dc5adeef10fa38b01ac2a519a09df706013dd34d818618f3dd6"} Jul 05 07:50:46.011284 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:46.011221 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" podStartSLOduration=17.011200995 podStartE2EDuration="17.011200995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 07:50:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:50:46.009082577 +0000 UTC m=+261.428815631" watchObservedRunningTime="2026-07-05 07:50:46.011200995 +0000 UTC m=+261.430934051" Jul 05 07:50:46.100903 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:46.100871 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:46.296372 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:46.296341 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:46.895396 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:46.895353 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:47.496722 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:47.496612 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:47.698515 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:47.698471 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:47.894418 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:47.894381 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:47.995189 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:47.995157 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:47.998611 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:47.998588 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wpsxf" event={"ID":"119ae6c1-756b-4255-bf55-1eaa15f9e400","Type":"ContainerStarted","Data":"6cdc4b3ac02e9061845bad0baf47eec6246f5feafbc08d7877403cd78a90e63c"} Jul 05 07:50:47.998718 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:47.998634 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wpsxf" event={"ID":"119ae6c1-756b-4255-bf55-1eaa15f9e400","Type":"ContainerStarted","Data":"16f5087d1140130bf5b3443ec3b392a1e75ce0f88131ca7f9ffca6fbfb1beee1"} Jul 05 07:50:48.014546 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:48.014506 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wpsxf" podStartSLOduration=17.126758531 podStartE2EDuration="19.014492597s" totalImagesPullingTime="1.887734066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 07:50:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:50:48.013249234 +0000 UTC m=+263.432982288" watchObservedRunningTime="2026-07-05 07:50:48.014492597 +0000 UTC m=+263.434225670" Jul 05 07:50:48.095551 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:48.095516 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:48.895181 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:48.895151 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:49.297150 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:49.297090 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:49.496995 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:49.496953 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:49.694809 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:49.694736 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:50.855323 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:50.855279 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aca8f321-4806-4a75-8598-c6b0a6494cf1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f24dc\" (UID: \"aca8f321-4806-4a75-8598-c6b0a6494cf1\") " pod="openshift-insights/insights-runtime-extractor-f24dc" Jul 05 07:50:50.855702 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:50.855335 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aca8f321-4806-4a75-8598-c6b0a6494cf1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f24dc\" (UID: \"aca8f321-4806-4a75-8598-c6b0a6494cf1\") " pod="openshift-insights/insights-runtime-extractor-f24dc" Jul 05 07:50:50.855792 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:50.855776 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aca8f321-4806-4a75-8598-c6b0a6494cf1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f24dc\" (UID: \"aca8f321-4806-4a75-8598-c6b0a6494cf1\") " pod="openshift-insights/insights-runtime-extractor-f24dc" Jul 05 07:50:50.857563 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:50.857543 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aca8f321-4806-4a75-8598-c6b0a6494cf1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f24dc\" (UID: \"aca8f321-4806-4a75-8598-c6b0a6494cf1\") " pod="openshift-insights/insights-runtime-extractor-f24dc" Jul 05 07:50:50.955070 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:50.955040 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f24dc" Jul 05 07:50:51.084729 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:51.084701 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f24dc"] Jul 05 07:50:51.088446 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:50:51.088416 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaca8f321_4806_4a75_8598_c6b0a6494cf1.slice/crio-768f79b268f5b96d028533c858638c49da0f47f82b6adbc40310310d351fcbb8 WatchSource:0}: Error finding container 768f79b268f5b96d028533c858638c49da0f47f82b6adbc40310310d351fcbb8: Status 404 returned error can't find the container with id 768f79b268f5b96d028533c858638c49da0f47f82b6adbc40310310d351fcbb8 Jul 05 07:50:52.014185 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:52.014153 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f24dc" event={"ID":"aca8f321-4806-4a75-8598-c6b0a6494cf1","Type":"ContainerStarted","Data":"768f79b268f5b96d028533c858638c49da0f47f82b6adbc40310310d351fcbb8"} Jul 05 07:50:55.024489 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:55.024457 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f24dc" event={"ID":"aca8f321-4806-4a75-8598-c6b0a6494cf1","Type":"ContainerStarted","Data":"e77ee9a4e03fab5f3825b088bdab6f1af6d1f40ee9a2a7a5c543512e47ca652f"} Jul 05 07:50:56.033308 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.033251 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f24dc" event={"ID":"aca8f321-4806-4a75-8598-c6b0a6494cf1","Type":"ContainerStarted","Data":"6226b180ab2a7f95b8ce9bff967a921ac99dc2d180d0e49b680a86cb9a175ea5"} Jul 05 07:50:56.105295 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.105253 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:56.157754 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.157723 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:56.258753 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.258722 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:56.405750 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.405683 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:56.623758 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.623727 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b4754f8b-cp8mm"] Jul 05 07:50:56.672934 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.672858 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-79d66dc46b-vv59p"] Jul 05 07:50:56.677307 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.677286 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" Jul 05 07:50:56.690713 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.690691 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79d66dc46b-vv59p"] Jul 05 07:50:56.749743 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.749703 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:56.801933 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.801899 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/988967a8-61a6-424f-a248-5102c8c259ef-trusted-ca\") pod \"image-registry-79d66dc46b-vv59p\" (UID: \"988967a8-61a6-424f-a248-5102c8c259ef\") " pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" Jul 05 07:50:56.802081 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.801949 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/988967a8-61a6-424f-a248-5102c8c259ef-ca-trust-extracted\") pod \"image-registry-79d66dc46b-vv59p\" (UID: \"988967a8-61a6-424f-a248-5102c8c259ef\") " pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" Jul 05 07:50:56.802081 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.801996 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmgdt\" (UniqueName: \"kubernetes.io/projected/988967a8-61a6-424f-a248-5102c8c259ef-kube-api-access-kmgdt\") pod \"image-registry-79d66dc46b-vv59p\" (UID: \"988967a8-61a6-424f-a248-5102c8c259ef\") " pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" Jul 05 07:50:56.802081 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.802040 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/988967a8-61a6-424f-a248-5102c8c259ef-installation-pull-secrets\") pod \"image-registry-79d66dc46b-vv59p\" (UID: \"988967a8-61a6-424f-a248-5102c8c259ef\") " pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" Jul 05 07:50:56.802081 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.802067 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/988967a8-61a6-424f-a248-5102c8c259ef-bound-sa-token\") pod \"image-registry-79d66dc46b-vv59p\" (UID: \"988967a8-61a6-424f-a248-5102c8c259ef\") " pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" Jul 05 07:50:56.802276 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.802103 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/988967a8-61a6-424f-a248-5102c8c259ef-image-registry-private-configuration\") pod \"image-registry-79d66dc46b-vv59p\" (UID: \"988967a8-61a6-424f-a248-5102c8c259ef\") " pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" Jul 05 07:50:56.802276 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.802169 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/988967a8-61a6-424f-a248-5102c8c259ef-registry-tls\") pod \"image-registry-79d66dc46b-vv59p\" (UID: \"988967a8-61a6-424f-a248-5102c8c259ef\") " pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" Jul 05 07:50:56.802276 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.802204 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/988967a8-61a6-424f-a248-5102c8c259ef-registry-certificates\") pod \"image-registry-79d66dc46b-vv59p\" (UID: \"988967a8-61a6-424f-a248-5102c8c259ef\") " pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" Jul 05 07:50:56.846154 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.846109 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:56.902809 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.902784 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/988967a8-61a6-424f-a248-5102c8c259ef-trusted-ca\") pod \"image-registry-79d66dc46b-vv59p\" (UID: \"988967a8-61a6-424f-a248-5102c8c259ef\") " pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" Jul 05 07:50:56.902964 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.902816 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/988967a8-61a6-424f-a248-5102c8c259ef-ca-trust-extracted\") pod \"image-registry-79d66dc46b-vv59p\" (UID: \"988967a8-61a6-424f-a248-5102c8c259ef\") " pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" Jul 05 07:50:56.902964 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.902838 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmgdt\" (UniqueName: \"kubernetes.io/projected/988967a8-61a6-424f-a248-5102c8c259ef-kube-api-access-kmgdt\") pod \"image-registry-79d66dc46b-vv59p\" (UID: \"988967a8-61a6-424f-a248-5102c8c259ef\") " pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" Jul 05 07:50:56.903073 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.902961 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/988967a8-61a6-424f-a248-5102c8c259ef-installation-pull-secrets\") pod \"image-registry-79d66dc46b-vv59p\" (UID: \"988967a8-61a6-424f-a248-5102c8c259ef\") " pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" Jul 05 07:50:56.903073 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.902999 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/988967a8-61a6-424f-a248-5102c8c259ef-bound-sa-token\") pod \"image-registry-79d66dc46b-vv59p\" (UID: \"988967a8-61a6-424f-a248-5102c8c259ef\") " pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" Jul 05 07:50:56.903073 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.903040 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/988967a8-61a6-424f-a248-5102c8c259ef-image-registry-private-configuration\") pod \"image-registry-79d66dc46b-vv59p\" (UID: \"988967a8-61a6-424f-a248-5102c8c259ef\") " pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" Jul 05 07:50:56.903241 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.903074 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/988967a8-61a6-424f-a248-5102c8c259ef-registry-tls\") pod \"image-registry-79d66dc46b-vv59p\" (UID: \"988967a8-61a6-424f-a248-5102c8c259ef\") " pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" Jul 05 07:50:56.903241 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.903104 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/988967a8-61a6-424f-a248-5102c8c259ef-registry-certificates\") pod \"image-registry-79d66dc46b-vv59p\" (UID: \"988967a8-61a6-424f-a248-5102c8c259ef\") " pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" Jul 05 07:50:56.903355 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.903331 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/988967a8-61a6-424f-a248-5102c8c259ef-ca-trust-extracted\") pod \"image-registry-79d66dc46b-vv59p\" (UID: \"988967a8-61a6-424f-a248-5102c8c259ef\") " pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" Jul 05 07:50:56.903920 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.903892 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/988967a8-61a6-424f-a248-5102c8c259ef-trusted-ca\") pod \"image-registry-79d66dc46b-vv59p\" (UID: \"988967a8-61a6-424f-a248-5102c8c259ef\") " pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" Jul 05 07:50:56.904051 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.903957 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/988967a8-61a6-424f-a248-5102c8c259ef-registry-certificates\") pod \"image-registry-79d66dc46b-vv59p\" (UID: \"988967a8-61a6-424f-a248-5102c8c259ef\") " pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" Jul 05 07:50:56.905700 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.905663 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/988967a8-61a6-424f-a248-5102c8c259ef-installation-pull-secrets\") pod \"image-registry-79d66dc46b-vv59p\" (UID: \"988967a8-61a6-424f-a248-5102c8c259ef\") " pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" Jul 05 07:50:56.906452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.906411 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/988967a8-61a6-424f-a248-5102c8c259ef-image-registry-private-configuration\") pod \"image-registry-79d66dc46b-vv59p\" (UID: \"988967a8-61a6-424f-a248-5102c8c259ef\") " pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" Jul 05 07:50:56.906896 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.906871 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/988967a8-61a6-424f-a248-5102c8c259ef-registry-tls\") pod \"image-registry-79d66dc46b-vv59p\" (UID: \"988967a8-61a6-424f-a248-5102c8c259ef\") " pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" Jul 05 07:50:56.910673 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.910654 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmgdt\" (UniqueName: \"kubernetes.io/projected/988967a8-61a6-424f-a248-5102c8c259ef-kube-api-access-kmgdt\") pod \"image-registry-79d66dc46b-vv59p\" (UID: \"988967a8-61a6-424f-a248-5102c8c259ef\") " pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" Jul 05 07:50:56.910751 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.910734 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/988967a8-61a6-424f-a248-5102c8c259ef-bound-sa-token\") pod \"image-registry-79d66dc46b-vv59p\" (UID: \"988967a8-61a6-424f-a248-5102c8c259ef\") " pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" Jul 05 07:50:56.986488 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:56.986411 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" Jul 05 07:50:57.173519 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:57.173482 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:57.230011 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:57.229981 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:57.376825 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:57.376786 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:57.430810 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:57.430768 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:57.536145 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:57.536093 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:57.638303 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:57.638229 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:57.726463 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:57.726438 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79d66dc46b-vv59p"] Jul 05 07:50:57.729101 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:50:57.729076 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod988967a8_61a6_424f_a248_5102c8c259ef.slice/crio-3d4a0de32ca0eab08e486dbf7ecdcb04b3b47ce3551003154e15616cb75257ff WatchSource:0}: Error finding container 3d4a0de32ca0eab08e486dbf7ecdcb04b3b47ce3551003154e15616cb75257ff: Status 404 returned error can't find the container with id 3d4a0de32ca0eab08e486dbf7ecdcb04b3b47ce3551003154e15616cb75257ff Jul 05 07:50:57.984821 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:57.984741 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:58.042051 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:58.042011 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" event={"ID":"988967a8-61a6-424f-a248-5102c8c259ef","Type":"ContainerStarted","Data":"097bb263525c68e2633689a97d6dbba30f1a1de471629e8fe366b96e45652799"} Jul 05 07:50:58.042236 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:58.042070 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" event={"ID":"988967a8-61a6-424f-a248-5102c8c259ef","Type":"ContainerStarted","Data":"3d4a0de32ca0eab08e486dbf7ecdcb04b3b47ce3551003154e15616cb75257ff"} Jul 05 07:50:58.042236 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:58.042172 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" Jul 05 07:50:58.044050 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:58.044025 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f24dc" event={"ID":"aca8f321-4806-4a75-8598-c6b0a6494cf1","Type":"ContainerStarted","Data":"db78303d433881744f8976cc9ec5efb6ddbfc29b1eb91610a409ac68da7bb861"} Jul 05 07:50:58.061468 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:58.061423 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" podStartSLOduration=2.061411075 podStartE2EDuration="2.061411075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 07:50:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:50:58.060461532 +0000 UTC m=+273.480194586" watchObservedRunningTime="2026-07-05 07:50:58.061411075 +0000 UTC m=+273.481144129" Jul 05 07:50:58.076903 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:58.076855 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-f24dc" podStartSLOduration=16.614496151 podStartE2EDuration="23.076842589s" totalImagesPullingTime="6.462346438s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 07:50:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:50:58.076599492 +0000 UTC m=+273.496332552" watchObservedRunningTime="2026-07-05 07:50:58.076842589 +0000 UTC m=+273.496575644" Jul 05 07:50:58.186151 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:58.186100 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:58.512182 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:58.512129 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:58.802909 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:58.802822 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:58.851470 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:58.851445 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:59.121740 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:59.121669 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:50:59.221532 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:50:59.221502 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:00.211388 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:00.211354 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:00.271291 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:00.271266 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:00.831016 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:00.830983 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d924fc46-4762-4449-a1b6-bec710c87473-service-ca-bundle\") pod \"router-default-5bf4ff6889-zjz47\" (UID: \"d924fc46-4762-4449-a1b6-bec710c87473\") " pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:51:00.831587 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:00.831571 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d924fc46-4762-4449-a1b6-bec710c87473-service-ca-bundle\") pod \"router-default-5bf4ff6889-zjz47\" (UID: \"d924fc46-4762-4449-a1b6-bec710c87473\") " pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:51:00.841042 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:00.841025 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:51:00.964825 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:00.964793 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5bf4ff6889-zjz47"] Jul 05 07:51:00.966659 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:51:00.966630 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd924fc46_4762_4449_a1b6_bec710c87473.slice/crio-cda7b20aea7bcebb7bf72e61c2a496e84bddc42704dd084d92b399140de8f0df WatchSource:0}: Error finding container cda7b20aea7bcebb7bf72e61c2a496e84bddc42704dd084d92b399140de8f0df: Status 404 returned error can't find the container with id cda7b20aea7bcebb7bf72e61c2a496e84bddc42704dd084d92b399140de8f0df Jul 05 07:51:01.055855 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:01.055815 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5bf4ff6889-zjz47" event={"ID":"d924fc46-4762-4449-a1b6-bec710c87473","Type":"ContainerStarted","Data":"1a9bfc7c2ab45c76522f8cec5537dfef2684003d3bdad6f841b2a8921793b3c8"} Jul 05 07:51:01.055992 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:01.055876 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5bf4ff6889-zjz47" event={"ID":"d924fc46-4762-4449-a1b6-bec710c87473","Type":"ContainerStarted","Data":"cda7b20aea7bcebb7bf72e61c2a496e84bddc42704dd084d92b399140de8f0df"} Jul 05 07:51:01.073407 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:01.073358 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5bf4ff6889-zjz47" podStartSLOduration=32.073340916 podStartE2EDuration="32.073340916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 07:50:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:51:01.072226812 +0000 UTC m=+276.491959858" watchObservedRunningTime="2026-07-05 07:51:01.073340916 +0000 UTC m=+276.493073971" Jul 05 07:51:01.842101 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:01.842056 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:51:01.844726 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:01.844704 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:51:02.059031 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:02.059005 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:51:02.060202 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:02.060182 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5bf4ff6889-zjz47" Jul 05 07:51:03.653993 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:03.653961 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:03.755457 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:03.755428 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:03.818071 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:03.818033 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:03.821369 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:03.821344 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pv4gb"] Jul 05 07:51:03.825362 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:03.825346 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pv4gb" Jul 05 07:51:03.827745 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:03.827719 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 05 07:51:03.827864 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:03.827836 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9jkwd\"" Jul 05 07:51:03.831677 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:03.831425 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pv4gb"] Jul 05 07:51:03.955638 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:03.955541 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2b9a6d5d-914e-42f4-b709-6644bbbf58ef-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-pv4gb\" (UID: \"2b9a6d5d-914e-42f4-b709-6644bbbf58ef\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pv4gb" Jul 05 07:51:04.056412 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:04.056378 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2b9a6d5d-914e-42f4-b709-6644bbbf58ef-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-pv4gb\" (UID: \"2b9a6d5d-914e-42f4-b709-6644bbbf58ef\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pv4gb" Jul 05 07:51:04.056591 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:51:04.056538 2566 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 05 07:51:04.056660 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:51:04.056631 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b9a6d5d-914e-42f4-b709-6644bbbf58ef-tls-certificates podName:2b9a6d5d-914e-42f4-b709-6644bbbf58ef nodeName:}" failed. No retries permitted until 2026-07-05 07:51:04.55660651 +0000 UTC m=+279.976339565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/2b9a6d5d-914e-42f4-b709-6644bbbf58ef-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-pv4gb" (UID: "2b9a6d5d-914e-42f4-b709-6644bbbf58ef") : secret "prometheus-operator-admission-webhook-tls" not found Jul 05 07:51:04.103552 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:04.103517 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:04.560545 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:04.560514 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2b9a6d5d-914e-42f4-b709-6644bbbf58ef-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-pv4gb\" (UID: \"2b9a6d5d-914e-42f4-b709-6644bbbf58ef\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pv4gb" Jul 05 07:51:04.562825 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:04.562797 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2b9a6d5d-914e-42f4-b709-6644bbbf58ef-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-pv4gb\" (UID: \"2b9a6d5d-914e-42f4-b709-6644bbbf58ef\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pv4gb" Jul 05 07:51:04.734320 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:04.734232 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pv4gb" Jul 05 07:51:04.852533 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:04.852505 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pv4gb"] Jul 05 07:51:04.856400 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:51:04.856376 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b9a6d5d_914e_42f4_b709_6644bbbf58ef.slice/crio-388b8b02f3bbb940e72a310cd55cbfd8fc9251a61ee199cd8c69e6ea2f0a4bf7 WatchSource:0}: Error finding container 388b8b02f3bbb940e72a310cd55cbfd8fc9251a61ee199cd8c69e6ea2f0a4bf7: Status 404 returned error can't find the container with id 388b8b02f3bbb940e72a310cd55cbfd8fc9251a61ee199cd8c69e6ea2f0a4bf7 Jul 05 07:51:05.067414 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:05.067381 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pv4gb" event={"ID":"2b9a6d5d-914e-42f4-b709-6644bbbf58ef","Type":"ContainerStarted","Data":"388b8b02f3bbb940e72a310cd55cbfd8fc9251a61ee199cd8c69e6ea2f0a4bf7"} Jul 05 07:51:06.071980 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:06.071947 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pv4gb" event={"ID":"2b9a6d5d-914e-42f4-b709-6644bbbf58ef","Type":"ContainerStarted","Data":"17639840e1e55dff019336f2147966de1bb38efad3705dec981df5a047c3ed05"} Jul 05 07:51:06.072344 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:06.072119 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pv4gb" Jul 05 07:51:06.076452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:06.076430 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pv4gb" Jul 05 07:51:06.086788 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:06.086722 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pv4gb" podStartSLOduration=1.975312442 podStartE2EDuration="3.086708804s" totalImagesPullingTime="1.111396362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 07:51:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:51:06.085805525 +0000 UTC m=+281.505538579" watchObservedRunningTime="2026-07-05 07:51:06.086708804 +0000 UTC m=+281.506441858" Jul 05 07:51:06.628950 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:06.628922 2566 patch_prober.go:28] interesting pod/image-registry-b4754f8b-cp8mm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 05 07:51:06.629100 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:06.628970 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" podUID="44860d7b-edf6-41fa-889e-10aa1e202e6b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 05 07:51:06.749334 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:51:06.749296 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pndsb" podUID="a6fc0e8f-0a92-40af-8e70-40e4dc38504c" Jul 05 07:51:06.845171 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:06.845128 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:06.931469 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:06.931403 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:07.076197 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:07.076170 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pndsb" Jul 05 07:51:07.126820 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:07.126792 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:08.410000 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.409960 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bdfd4677f-6zc6s"] Jul 05 07:51:08.410972 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.410940 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:08.413105 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.413089 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bdfd4677f-6zc6s" Jul 05 07:51:08.416933 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.416906 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 05 07:51:08.417056 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.416987 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 05 07:51:08.417056 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.416997 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xdvvm\"" Jul 05 07:51:08.417056 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.417029 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 05 07:51:08.417056 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.417009 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 05 07:51:08.417316 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.417300 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 05 07:51:08.417316 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.417310 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 05 07:51:08.417418 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.417320 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 05 07:51:08.422274 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.422257 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 05 07:51:08.422854 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.422836 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bdfd4677f-6zc6s"] Jul 05 07:51:08.461347 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.461319 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:08.488435 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.488412 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-console-config\") pod \"console-bdfd4677f-6zc6s\" (UID: \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\") " pod="openshift-console/console-bdfd4677f-6zc6s" Jul 05 07:51:08.488515 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.488446 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-service-ca\") pod \"console-bdfd4677f-6zc6s\" (UID: \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\") " pod="openshift-console/console-bdfd4677f-6zc6s" Jul 05 07:51:08.488515 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.488483 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-oauth-serving-cert\") pod \"console-bdfd4677f-6zc6s\" (UID: \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\") " pod="openshift-console/console-bdfd4677f-6zc6s" Jul 05 07:51:08.488604 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.488514 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6crrt\" (UniqueName: \"kubernetes.io/projected/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-kube-api-access-6crrt\") pod \"console-bdfd4677f-6zc6s\" (UID: \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\") " pod="openshift-console/console-bdfd4677f-6zc6s" Jul 05 07:51:08.488604 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.488534 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-console-serving-cert\") pod \"console-bdfd4677f-6zc6s\" (UID: \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\") " pod="openshift-console/console-bdfd4677f-6zc6s" Jul 05 07:51:08.488703 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.488617 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-console-oauth-config\") pod \"console-bdfd4677f-6zc6s\" (UID: \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\") " pod="openshift-console/console-bdfd4677f-6zc6s" Jul 05 07:51:08.488703 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.488678 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-trusted-ca-bundle\") pod \"console-bdfd4677f-6zc6s\" (UID: \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\") " pod="openshift-console/console-bdfd4677f-6zc6s" Jul 05 07:51:08.589818 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.589793 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-console-config\") pod \"console-bdfd4677f-6zc6s\" (UID: \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\") " pod="openshift-console/console-bdfd4677f-6zc6s" Jul 05 07:51:08.589925 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.589830 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-service-ca\") pod \"console-bdfd4677f-6zc6s\" (UID: \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\") " pod="openshift-console/console-bdfd4677f-6zc6s" Jul 05 07:51:08.589925 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.589907 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-oauth-serving-cert\") pod \"console-bdfd4677f-6zc6s\" (UID: \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\") " pod="openshift-console/console-bdfd4677f-6zc6s" Jul 05 07:51:08.590031 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.589936 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6crrt\" (UniqueName: \"kubernetes.io/projected/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-kube-api-access-6crrt\") pod \"console-bdfd4677f-6zc6s\" (UID: \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\") " pod="openshift-console/console-bdfd4677f-6zc6s" Jul 05 07:51:08.590031 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.589971 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-console-serving-cert\") pod \"console-bdfd4677f-6zc6s\" (UID: \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\") " pod="openshift-console/console-bdfd4677f-6zc6s" Jul 05 07:51:08.590031 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.590006 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-console-oauth-config\") pod \"console-bdfd4677f-6zc6s\" (UID: \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\") " pod="openshift-console/console-bdfd4677f-6zc6s" Jul 05 07:51:08.590195 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.590175 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-trusted-ca-bundle\") pod \"console-bdfd4677f-6zc6s\" (UID: \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\") " pod="openshift-console/console-bdfd4677f-6zc6s" Jul 05 07:51:08.590638 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.590611 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-console-config\") pod \"console-bdfd4677f-6zc6s\" (UID: \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\") " pod="openshift-console/console-bdfd4677f-6zc6s" Jul 05 07:51:08.590638 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.590631 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-service-ca\") pod \"console-bdfd4677f-6zc6s\" (UID: \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\") " pod="openshift-console/console-bdfd4677f-6zc6s" Jul 05 07:51:08.590774 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.590683 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-oauth-serving-cert\") pod \"console-bdfd4677f-6zc6s\" (UID: \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\") " pod="openshift-console/console-bdfd4677f-6zc6s" Jul 05 07:51:08.590903 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.590882 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-trusted-ca-bundle\") pod \"console-bdfd4677f-6zc6s\" (UID: \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\") " pod="openshift-console/console-bdfd4677f-6zc6s" Jul 05 07:51:08.592506 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.592476 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-console-oauth-config\") pod \"console-bdfd4677f-6zc6s\" (UID: \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\") " pod="openshift-console/console-bdfd4677f-6zc6s" Jul 05 07:51:08.592661 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.592560 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-console-serving-cert\") pod \"console-bdfd4677f-6zc6s\" (UID: \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\") " pod="openshift-console/console-bdfd4677f-6zc6s" Jul 05 07:51:08.598724 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.598707 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6crrt\" (UniqueName: \"kubernetes.io/projected/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-kube-api-access-6crrt\") pod \"console-bdfd4677f-6zc6s\" (UID: \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\") " pod="openshift-console/console-bdfd4677f-6zc6s" Jul 05 07:51:08.722424 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.722375 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bdfd4677f-6zc6s" Jul 05 07:51:08.863378 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:08.863348 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bdfd4677f-6zc6s"] Jul 05 07:51:08.866860 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:51:08.866829 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd99dc7c_1a82_49c1_9834_679e5f40d4f2.slice/crio-bc90d90c7fc1b2ff71c92e3e9467f4c8234296b4891c8ac52bb005e2fa5302c0 WatchSource:0}: Error finding container bc90d90c7fc1b2ff71c92e3e9467f4c8234296b4891c8ac52bb005e2fa5302c0: Status 404 returned error can't find the container with id bc90d90c7fc1b2ff71c92e3e9467f4c8234296b4891c8ac52bb005e2fa5302c0 Jul 05 07:51:09.083651 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:09.083619 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bdfd4677f-6zc6s" event={"ID":"cd99dc7c-1a82-49c1-9834-679e5f40d4f2","Type":"ContainerStarted","Data":"bc90d90c7fc1b2ff71c92e3e9467f4c8234296b4891c8ac52bb005e2fa5302c0"} Jul 05 07:51:09.702804 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:09.702771 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-metrics-tls\") pod \"dns-default-pndsb\" (UID: \"a6fc0e8f-0a92-40af-8e70-40e4dc38504c\") " pod="openshift-dns/dns-default-pndsb" Jul 05 07:51:09.705450 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:09.705425 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6fc0e8f-0a92-40af-8e70-40e4dc38504c-metrics-tls\") pod \"dns-default-pndsb\" (UID: \"a6fc0e8f-0a92-40af-8e70-40e4dc38504c\") " pod="openshift-dns/dns-default-pndsb" Jul 05 07:51:09.780010 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:09.779986 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-845z6\"" Jul 05 07:51:09.788206 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:09.788185 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pndsb" Jul 05 07:51:09.928518 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:09.928491 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pndsb"] Jul 05 07:51:09.932103 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:51:09.932075 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6fc0e8f_0a92_40af_8e70_40e4dc38504c.slice/crio-e04eec6521d5e13714855b3a85ac7558ee1d97a451ecce6083aea4b770f77474 WatchSource:0}: Error finding container e04eec6521d5e13714855b3a85ac7558ee1d97a451ecce6083aea4b770f77474: Status 404 returned error can't find the container with id e04eec6521d5e13714855b3a85ac7558ee1d97a451ecce6083aea4b770f77474 Jul 05 07:51:10.091862 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:10.091822 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pndsb" event={"ID":"a6fc0e8f-0a92-40af-8e70-40e4dc38504c","Type":"ContainerStarted","Data":"e04eec6521d5e13714855b3a85ac7558ee1d97a451ecce6083aea4b770f77474"} Jul 05 07:51:12.012580 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:12.012532 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:13.104619 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:13.104587 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bdfd4677f-6zc6s" event={"ID":"cd99dc7c-1a82-49c1-9834-679e5f40d4f2","Type":"ContainerStarted","Data":"5062ce5176f0ed1d7b3c84722253d2fa5473c05086643eb30e59b6efcdd621c3"} Jul 05 07:51:13.106410 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:13.106381 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pndsb" event={"ID":"a6fc0e8f-0a92-40af-8e70-40e4dc38504c","Type":"ContainerStarted","Data":"c1dd79b7568cfc07df03c00d01e8b860ad7791259b76665e6deaac51afe8602c"} Jul 05 07:51:13.106530 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:13.106437 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pndsb" event={"ID":"a6fc0e8f-0a92-40af-8e70-40e4dc38504c","Type":"ContainerStarted","Data":"a82653c593ac28900137e13e4b94472b36f7d5f43cbf7670bb232d66e5bc0b98"} Jul 05 07:51:13.106530 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:13.106463 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pndsb" Jul 05 07:51:13.120907 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:13.120858 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bdfd4677f-6zc6s" podStartSLOduration=1.518874416 podStartE2EDuration="5.120844898s" totalImagesPullingTime="3.601970482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 07:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:51:13.120411396 +0000 UTC m=+288.540144454" watchObservedRunningTime="2026-07-05 07:51:13.120844898 +0000 UTC m=+288.540577953" Jul 05 07:51:13.139506 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:13.139461 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pndsb" podStartSLOduration=251.598757648 podStartE2EDuration="4m14.139431919s" totalImagesPullingTime="2.540674271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 07:46:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:51:13.138790813 +0000 UTC m=+288.558523869" watchObservedRunningTime="2026-07-05 07:51:13.139431919 +0000 UTC m=+288.559164971" Jul 05 07:51:15.407946 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:15.407915 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:16.563234 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:16.563196 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:16.628194 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:16.628168 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:51:16.990549 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:16.990474 2566 patch_prober.go:28] interesting pod/image-registry-79d66dc46b-vv59p container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 05 07:51:16.990679 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:16.990546 2566 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" podUID="988967a8-61a6-424f-a248-5102c8c259ef" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 05 07:51:17.121349 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:51:17.121313 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mt69q" podUID="2b6430fa-c37c-4cc9-81ab-3feb7300273e" Jul 05 07:51:17.965576 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:17.965542 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:18.108355 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.108321 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:18.213038 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.213009 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:18.243114 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.243035 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4v2v2"] Jul 05 07:51:18.246029 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.246011 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4v2v2" Jul 05 07:51:18.248656 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.248638 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 05 07:51:18.248775 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.248759 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 05 07:51:18.248832 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.248802 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-k9zf7\"" Jul 05 07:51:18.248882 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.248854 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 05 07:51:18.249094 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.249078 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 05 07:51:18.250169 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.250129 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 05 07:51:18.250273 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.250257 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 05 07:51:18.287431 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.287411 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:18.371910 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.371885 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/15708bce-9fc3-44a1-bf40-4878591db45c-root\") pod \"node-exporter-4v2v2\" (UID: \"15708bce-9fc3-44a1-bf40-4878591db45c\") " pod="openshift-monitoring/node-exporter-4v2v2" Jul 05 07:51:18.372015 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.371918 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15708bce-9fc3-44a1-bf40-4878591db45c-metrics-client-ca\") pod \"node-exporter-4v2v2\" (UID: \"15708bce-9fc3-44a1-bf40-4878591db45c\") " pod="openshift-monitoring/node-exporter-4v2v2" Jul 05 07:51:18.372015 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.371938 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/15708bce-9fc3-44a1-bf40-4878591db45c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4v2v2\" (UID: \"15708bce-9fc3-44a1-bf40-4878591db45c\") " pod="openshift-monitoring/node-exporter-4v2v2" Jul 05 07:51:18.372015 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.371968 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15708bce-9fc3-44a1-bf40-4878591db45c-sys\") pod \"node-exporter-4v2v2\" (UID: \"15708bce-9fc3-44a1-bf40-4878591db45c\") " pod="openshift-monitoring/node-exporter-4v2v2" Jul 05 07:51:18.372015 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.371999 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/15708bce-9fc3-44a1-bf40-4878591db45c-node-exporter-tls\") pod \"node-exporter-4v2v2\" (UID: \"15708bce-9fc3-44a1-bf40-4878591db45c\") " pod="openshift-monitoring/node-exporter-4v2v2" Jul 05 07:51:18.372217 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.372041 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/15708bce-9fc3-44a1-bf40-4878591db45c-node-exporter-accelerators-collector-config\") pod \"node-exporter-4v2v2\" (UID: \"15708bce-9fc3-44a1-bf40-4878591db45c\") " pod="openshift-monitoring/node-exporter-4v2v2" Jul 05 07:51:18.372217 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.372069 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/15708bce-9fc3-44a1-bf40-4878591db45c-node-exporter-wtmp\") pod \"node-exporter-4v2v2\" (UID: \"15708bce-9fc3-44a1-bf40-4878591db45c\") " pod="openshift-monitoring/node-exporter-4v2v2" Jul 05 07:51:18.372217 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.372102 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwvgc\" (UniqueName: \"kubernetes.io/projected/15708bce-9fc3-44a1-bf40-4878591db45c-kube-api-access-vwvgc\") pod \"node-exporter-4v2v2\" (UID: \"15708bce-9fc3-44a1-bf40-4878591db45c\") " pod="openshift-monitoring/node-exporter-4v2v2" Jul 05 07:51:18.372217 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.372121 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/15708bce-9fc3-44a1-bf40-4878591db45c-node-exporter-textfile\") pod \"node-exporter-4v2v2\" (UID: \"15708bce-9fc3-44a1-bf40-4878591db45c\") " pod="openshift-monitoring/node-exporter-4v2v2" Jul 05 07:51:18.393548 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.393524 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:18.473024 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.472994 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/15708bce-9fc3-44a1-bf40-4878591db45c-node-exporter-textfile\") pod \"node-exporter-4v2v2\" (UID: \"15708bce-9fc3-44a1-bf40-4878591db45c\") " pod="openshift-monitoring/node-exporter-4v2v2" Jul 05 07:51:18.473024 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.473024 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/15708bce-9fc3-44a1-bf40-4878591db45c-root\") pod \"node-exporter-4v2v2\" (UID: \"15708bce-9fc3-44a1-bf40-4878591db45c\") " pod="openshift-monitoring/node-exporter-4v2v2" Jul 05 07:51:18.473213 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.473047 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15708bce-9fc3-44a1-bf40-4878591db45c-metrics-client-ca\") pod \"node-exporter-4v2v2\" (UID: \"15708bce-9fc3-44a1-bf40-4878591db45c\") " pod="openshift-monitoring/node-exporter-4v2v2" Jul 05 07:51:18.473213 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.473098 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/15708bce-9fc3-44a1-bf40-4878591db45c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4v2v2\" (UID: \"15708bce-9fc3-44a1-bf40-4878591db45c\") " pod="openshift-monitoring/node-exporter-4v2v2" Jul 05 07:51:18.473213 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.473114 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/15708bce-9fc3-44a1-bf40-4878591db45c-root\") pod \"node-exporter-4v2v2\" (UID: \"15708bce-9fc3-44a1-bf40-4878591db45c\") " pod="openshift-monitoring/node-exporter-4v2v2" Jul 05 07:51:18.473213 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.473163 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15708bce-9fc3-44a1-bf40-4878591db45c-sys\") pod \"node-exporter-4v2v2\" (UID: \"15708bce-9fc3-44a1-bf40-4878591db45c\") " pod="openshift-monitoring/node-exporter-4v2v2" Jul 05 07:51:18.473213 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.473199 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/15708bce-9fc3-44a1-bf40-4878591db45c-node-exporter-tls\") pod \"node-exporter-4v2v2\" (UID: \"15708bce-9fc3-44a1-bf40-4878591db45c\") " pod="openshift-monitoring/node-exporter-4v2v2" Jul 05 07:51:18.473432 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.473246 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/15708bce-9fc3-44a1-bf40-4878591db45c-node-exporter-accelerators-collector-config\") pod \"node-exporter-4v2v2\" (UID: \"15708bce-9fc3-44a1-bf40-4878591db45c\") " pod="openshift-monitoring/node-exporter-4v2v2" Jul 05 07:51:18.473432 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.473295 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15708bce-9fc3-44a1-bf40-4878591db45c-sys\") pod \"node-exporter-4v2v2\" (UID: \"15708bce-9fc3-44a1-bf40-4878591db45c\") " pod="openshift-monitoring/node-exporter-4v2v2" Jul 05 07:51:18.473432 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.473294 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/15708bce-9fc3-44a1-bf40-4878591db45c-node-exporter-wtmp\") pod \"node-exporter-4v2v2\" (UID: \"15708bce-9fc3-44a1-bf40-4878591db45c\") " pod="openshift-monitoring/node-exporter-4v2v2" Jul 05 07:51:18.473432 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:51:18.473342 2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 05 07:51:18.473432 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.473361 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwvgc\" (UniqueName: \"kubernetes.io/projected/15708bce-9fc3-44a1-bf40-4878591db45c-kube-api-access-vwvgc\") pod \"node-exporter-4v2v2\" (UID: \"15708bce-9fc3-44a1-bf40-4878591db45c\") " pod="openshift-monitoring/node-exporter-4v2v2" Jul 05 07:51:18.473432 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:51:18.473397 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15708bce-9fc3-44a1-bf40-4878591db45c-node-exporter-tls podName:15708bce-9fc3-44a1-bf40-4878591db45c nodeName:}" failed. No retries permitted until 2026-07-05 07:51:18.973380223 +0000 UTC m=+294.393113261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/15708bce-9fc3-44a1-bf40-4878591db45c-node-exporter-tls") pod "node-exporter-4v2v2" (UID: "15708bce-9fc3-44a1-bf40-4878591db45c") : secret "node-exporter-tls" not found Jul 05 07:51:18.473432 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.473429 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/15708bce-9fc3-44a1-bf40-4878591db45c-node-exporter-wtmp\") pod \"node-exporter-4v2v2\" (UID: \"15708bce-9fc3-44a1-bf40-4878591db45c\") " pod="openshift-monitoring/node-exporter-4v2v2" Jul 05 07:51:18.473737 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.473500 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/15708bce-9fc3-44a1-bf40-4878591db45c-node-exporter-textfile\") pod \"node-exporter-4v2v2\" (UID: \"15708bce-9fc3-44a1-bf40-4878591db45c\") " pod="openshift-monitoring/node-exporter-4v2v2" Jul 05 07:51:18.473879 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.473858 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15708bce-9fc3-44a1-bf40-4878591db45c-metrics-client-ca\") pod \"node-exporter-4v2v2\" (UID: \"15708bce-9fc3-44a1-bf40-4878591db45c\") " pod="openshift-monitoring/node-exporter-4v2v2" Jul 05 07:51:18.473956 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.473940 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/15708bce-9fc3-44a1-bf40-4878591db45c-node-exporter-accelerators-collector-config\") pod \"node-exporter-4v2v2\" (UID: \"15708bce-9fc3-44a1-bf40-4878591db45c\") " pod="openshift-monitoring/node-exporter-4v2v2" Jul 05 07:51:18.475415 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.475390 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/15708bce-9fc3-44a1-bf40-4878591db45c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4v2v2\" (UID: \"15708bce-9fc3-44a1-bf40-4878591db45c\") " pod="openshift-monitoring/node-exporter-4v2v2" Jul 05 07:51:18.481212 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.481193 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwvgc\" (UniqueName: \"kubernetes.io/projected/15708bce-9fc3-44a1-bf40-4878591db45c-kube-api-access-vwvgc\") pod \"node-exporter-4v2v2\" (UID: \"15708bce-9fc3-44a1-bf40-4878591db45c\") " pod="openshift-monitoring/node-exporter-4v2v2" Jul 05 07:51:18.580669 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.580638 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:18.681321 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.681292 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:18.723033 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.723007 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bdfd4677f-6zc6s" Jul 05 07:51:18.723186 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.723064 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bdfd4677f-6zc6s" Jul 05 07:51:18.727700 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.727683 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bdfd4677f-6zc6s" Jul 05 07:51:18.747283 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.747257 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:18.978544 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:18.978450 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/15708bce-9fc3-44a1-bf40-4878591db45c-node-exporter-tls\") pod \"node-exporter-4v2v2\" (UID: \"15708bce-9fc3-44a1-bf40-4878591db45c\") " pod="openshift-monitoring/node-exporter-4v2v2" Jul 05 07:51:18.978915 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:51:18.978580 2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 05 07:51:18.978915 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:51:18.978648 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15708bce-9fc3-44a1-bf40-4878591db45c-node-exporter-tls podName:15708bce-9fc3-44a1-bf40-4878591db45c nodeName:}" failed. No retries permitted until 2026-07-05 07:51:19.978632534 +0000 UTC m=+295.398365569 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/15708bce-9fc3-44a1-bf40-4878591db45c-node-exporter-tls") pod "node-exporter-4v2v2" (UID: "15708bce-9fc3-44a1-bf40-4878591db45c") : secret "node-exporter-tls" not found Jul 05 07:51:19.051606 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.051577 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-79d66dc46b-vv59p" Jul 05 07:51:19.127505 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.127478 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bdfd4677f-6zc6s" Jul 05 07:51:19.178172 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.178125 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:19.277817 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.277783 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:19.345205 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.345172 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:19.349888 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.349867 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 05 07:51:19.353469 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.353455 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.356170 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.356146 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 05 07:51:19.356382 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.356356 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 05 07:51:19.356382 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.356380 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 05 07:51:19.356587 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.356392 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 05 07:51:19.356587 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.356430 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6flsm\"" Jul 05 07:51:19.356587 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.356381 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 05 07:51:19.356587 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.356381 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 05 07:51:19.356587 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.356562 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 05 07:51:19.356847 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.356780 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 05 07:51:19.356847 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.356792 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 05 07:51:19.370853 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.370831 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 05 07:51:19.483820 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.483785 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.483950 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.483832 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8bbv\" (UniqueName: \"kubernetes.io/projected/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-kube-api-access-r8bbv\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.483950 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.483852 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-config-volume\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.483950 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.483906 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.484064 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.483954 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-web-config\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.484064 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.483974 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.484064 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.483996 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.484064 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.484012 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.484064 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.484035 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.484064 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.484050 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.484289 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.484070 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.484289 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.484105 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.484289 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.484169 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-config-out\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.495124 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.495097 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:19.585461 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.585383 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-config-out\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.585461 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.585423 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.585461 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.585452 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8bbv\" (UniqueName: \"kubernetes.io/projected/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-kube-api-access-r8bbv\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.585701 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.585567 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-config-volume\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.585701 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.585605 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.585701 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.585637 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-web-config\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.585701 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.585673 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.585893 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.585773 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.585893 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.585818 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.585893 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.585854 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.585893 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.585882 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.586096 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.585919 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.586096 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.585945 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.586377 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.586353 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.587179 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.587158 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.587325 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.587257 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.587510 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:51:19.587493 2566 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 05 07:51:19.587739 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:51:19.587726 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-secret-alertmanager-main-tls podName:e80e3e02-11c4-4f94-a072-bfe95b79fd1b nodeName:}" failed. No retries permitted until 2026-07-05 07:51:20.087701882 +0000 UTC m=+295.507435220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "e80e3e02-11c4-4f94-a072-bfe95b79fd1b") : secret "alertmanager-main-tls" not found Jul 05 07:51:19.588390 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.588371 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-config-out\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.588534 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.588513 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-web-config\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.588751 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.588730 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.588822 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.588808 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.589178 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.589160 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-config-volume\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.589280 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.589260 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.589951 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.589930 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.590383 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.590364 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.593210 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.593189 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8bbv\" (UniqueName: \"kubernetes.io/projected/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-kube-api-access-r8bbv\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:19.741479 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.741442 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:19.842047 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.841971 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:19.889151 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.889108 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:19.988630 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.988600 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/15708bce-9fc3-44a1-bf40-4878591db45c-node-exporter-tls\") pod \"node-exporter-4v2v2\" (UID: \"15708bce-9fc3-44a1-bf40-4878591db45c\") " pod="openshift-monitoring/node-exporter-4v2v2" Jul 05 07:51:19.990808 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:19.990792 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/15708bce-9fc3-44a1-bf40-4878591db45c-node-exporter-tls\") pod \"node-exporter-4v2v2\" (UID: \"15708bce-9fc3-44a1-bf40-4878591db45c\") " pod="openshift-monitoring/node-exporter-4v2v2" Jul 05 07:51:20.054865 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:20.054830 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4v2v2" Jul 05 07:51:20.066727 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:51:20.066705 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15708bce_9fc3_44a1_bf40_4878591db45c.slice/crio-9e740a2d90be0e4bebea64539a5b7824b5ce6a5adb074eb0f9483d27b870d9d3 WatchSource:0}: Error finding container 9e740a2d90be0e4bebea64539a5b7824b5ce6a5adb074eb0f9483d27b870d9d3: Status 404 returned error can't find the container with id 9e740a2d90be0e4bebea64539a5b7824b5ce6a5adb074eb0f9483d27b870d9d3 Jul 05 07:51:20.089371 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:20.089344 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:20.091635 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:20.091614 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:20.127752 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:20.127680 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4v2v2" event={"ID":"15708bce-9fc3-44a1-bf40-4878591db45c","Type":"ContainerStarted","Data":"9e740a2d90be0e4bebea64539a5b7824b5ce6a5adb074eb0f9483d27b870d9d3"} Jul 05 07:51:20.263191 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:20.263161 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:51:20.393908 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:20.393829 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 05 07:51:20.396403 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:51:20.396375 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode80e3e02_11c4_4f94_a072_bfe95b79fd1b.slice/crio-70fa06ff1f50f554b343f0d01a92503c4715b999c7ce511d235fe04f8795a761 WatchSource:0}: Error finding container 70fa06ff1f50f554b343f0d01a92503c4715b999c7ce511d235fe04f8795a761: Status 404 returned error can't find the container with id 70fa06ff1f50f554b343f0d01a92503c4715b999c7ce511d235fe04f8795a761 Jul 05 07:51:21.131763 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:21.131732 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:21.132650 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:21.132624 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e80e3e02-11c4-4f94-a072-bfe95b79fd1b","Type":"ContainerStarted","Data":"70fa06ff1f50f554b343f0d01a92503c4715b999c7ce511d235fe04f8795a761"} Jul 05 07:51:21.227126 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:21.227091 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:21.286766 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:21.286740 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:21.388380 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:21.388272 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:21.596175 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:21.596145 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:21.644424 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:21.644362 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" podUID="44860d7b-edf6-41fa-889e-10aa1e202e6b" containerName="registry" containerID="cri-o://29a0c3082d6e2892347acd48dfa51df24e3a9095f2995d3c41de3086b7d78f2c" gracePeriod=30 Jul 05 07:51:21.679306 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:21.679282 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:21.877628 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:21.877608 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:51:21.902688 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:21.902621 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-registry-tls\") pod \"44860d7b-edf6-41fa-889e-10aa1e202e6b\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " Jul 05 07:51:21.902688 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:21.902663 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/44860d7b-edf6-41fa-889e-10aa1e202e6b-installation-pull-secrets\") pod \"44860d7b-edf6-41fa-889e-10aa1e202e6b\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " Jul 05 07:51:21.902851 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:21.902694 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-bound-sa-token\") pod \"44860d7b-edf6-41fa-889e-10aa1e202e6b\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " Jul 05 07:51:21.902851 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:21.902719 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8n49q\" (UniqueName: \"kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-kube-api-access-8n49q\") pod \"44860d7b-edf6-41fa-889e-10aa1e202e6b\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " Jul 05 07:51:21.902851 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:21.902785 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/44860d7b-edf6-41fa-889e-10aa1e202e6b-ca-trust-extracted\") pod \"44860d7b-edf6-41fa-889e-10aa1e202e6b\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " Jul 05 07:51:21.902851 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:21.902818 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/44860d7b-edf6-41fa-889e-10aa1e202e6b-trusted-ca\") pod \"44860d7b-edf6-41fa-889e-10aa1e202e6b\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " Jul 05 07:51:21.903041 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:21.902851 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/44860d7b-edf6-41fa-889e-10aa1e202e6b-image-registry-private-configuration\") pod \"44860d7b-edf6-41fa-889e-10aa1e202e6b\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " Jul 05 07:51:21.903041 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:21.902902 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/44860d7b-edf6-41fa-889e-10aa1e202e6b-registry-certificates\") pod \"44860d7b-edf6-41fa-889e-10aa1e202e6b\" (UID: \"44860d7b-edf6-41fa-889e-10aa1e202e6b\") " Jul 05 07:51:21.904063 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:21.903957 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44860d7b-edf6-41fa-889e-10aa1e202e6b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "44860d7b-edf6-41fa-889e-10aa1e202e6b" (UID: "44860d7b-edf6-41fa-889e-10aa1e202e6b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 07:51:21.904402 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:21.904199 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44860d7b-edf6-41fa-889e-10aa1e202e6b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "44860d7b-edf6-41fa-889e-10aa1e202e6b" (UID: "44860d7b-edf6-41fa-889e-10aa1e202e6b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 07:51:21.904402 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:21.904341 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/44860d7b-edf6-41fa-889e-10aa1e202e6b-trusted-ca\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:51:21.904402 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:21.904366 2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/44860d7b-edf6-41fa-889e-10aa1e202e6b-registry-certificates\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:51:21.905384 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:21.905355 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "44860d7b-edf6-41fa-889e-10aa1e202e6b" (UID: "44860d7b-edf6-41fa-889e-10aa1e202e6b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 07:51:21.905492 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:21.905443 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "44860d7b-edf6-41fa-889e-10aa1e202e6b" (UID: "44860d7b-edf6-41fa-889e-10aa1e202e6b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 07:51:21.905728 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:21.905698 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-kube-api-access-8n49q" (OuterVolumeSpecName: "kube-api-access-8n49q") pod "44860d7b-edf6-41fa-889e-10aa1e202e6b" (UID: "44860d7b-edf6-41fa-889e-10aa1e202e6b"). InnerVolumeSpecName "kube-api-access-8n49q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 07:51:21.905887 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:21.905865 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44860d7b-edf6-41fa-889e-10aa1e202e6b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "44860d7b-edf6-41fa-889e-10aa1e202e6b" (UID: "44860d7b-edf6-41fa-889e-10aa1e202e6b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 07:51:21.906037 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:21.906019 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44860d7b-edf6-41fa-889e-10aa1e202e6b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "44860d7b-edf6-41fa-889e-10aa1e202e6b" (UID: "44860d7b-edf6-41fa-889e-10aa1e202e6b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 07:51:21.914947 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:21.914919 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44860d7b-edf6-41fa-889e-10aa1e202e6b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "44860d7b-edf6-41fa-889e-10aa1e202e6b" (UID: "44860d7b-edf6-41fa-889e-10aa1e202e6b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 07:51:22.005452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.005419 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-registry-tls\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:51:22.005452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.005445 2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/44860d7b-edf6-41fa-889e-10aa1e202e6b-installation-pull-secrets\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:51:22.005452 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.005454 2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-bound-sa-token\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:51:22.005653 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.005464 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8n49q\" (UniqueName: \"kubernetes.io/projected/44860d7b-edf6-41fa-889e-10aa1e202e6b-kube-api-access-8n49q\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:51:22.005653 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.005473 2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/44860d7b-edf6-41fa-889e-10aa1e202e6b-ca-trust-extracted\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:51:22.005653 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.005482 2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/44860d7b-edf6-41fa-889e-10aa1e202e6b-image-registry-private-configuration\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:51:22.137461 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.137426 2566 generic.go:356] "Generic (PLEG): container finished" podID="44860d7b-edf6-41fa-889e-10aa1e202e6b" containerID="29a0c3082d6e2892347acd48dfa51df24e3a9095f2995d3c41de3086b7d78f2c" exitCode=0 Jul 05 07:51:22.137907 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.137487 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" Jul 05 07:51:22.137907 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.137501 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" event={"ID":"44860d7b-edf6-41fa-889e-10aa1e202e6b","Type":"ContainerDied","Data":"29a0c3082d6e2892347acd48dfa51df24e3a9095f2995d3c41de3086b7d78f2c"} Jul 05 07:51:22.137907 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.137543 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b4754f8b-cp8mm" event={"ID":"44860d7b-edf6-41fa-889e-10aa1e202e6b","Type":"ContainerDied","Data":"58d5728084b19bee23111e2df09d81b12761b21a087acc6f7689ef1f44619cfa"} Jul 05 07:51:22.138443 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.138409 2566 scope.go:117] "RemoveContainer" containerID="29a0c3082d6e2892347acd48dfa51df24e3a9095f2995d3c41de3086b7d78f2c" Jul 05 07:51:22.139054 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.139030 2566 generic.go:356] "Generic (PLEG): container finished" podID="15708bce-9fc3-44a1-bf40-4878591db45c" containerID="a4a5b85b235a8d0a25dfc82d825a56b655518b55d2a74396dade8945043c62d3" exitCode=0 Jul 05 07:51:22.139185 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.139160 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4v2v2" event={"ID":"15708bce-9fc3-44a1-bf40-4878591db45c","Type":"ContainerDied","Data":"a4a5b85b235a8d0a25dfc82d825a56b655518b55d2a74396dade8945043c62d3"} Jul 05 07:51:22.140874 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.140851 2566 generic.go:356] "Generic (PLEG): container finished" podID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerID="237c0b84940a2f90c5c4c4ef07b16235d1cfac68d29d8c4754dd918b3c5531ac" exitCode=0 Jul 05 07:51:22.140972 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.140895 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e80e3e02-11c4-4f94-a072-bfe95b79fd1b","Type":"ContainerDied","Data":"237c0b84940a2f90c5c4c4ef07b16235d1cfac68d29d8c4754dd918b3c5531ac"} Jul 05 07:51:22.148778 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.148426 2566 scope.go:117] "RemoveContainer" containerID="29a0c3082d6e2892347acd48dfa51df24e3a9095f2995d3c41de3086b7d78f2c" Jul 05 07:51:22.148869 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:51:22.148801 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29a0c3082d6e2892347acd48dfa51df24e3a9095f2995d3c41de3086b7d78f2c\": container with ID starting with 29a0c3082d6e2892347acd48dfa51df24e3a9095f2995d3c41de3086b7d78f2c not found: ID does not exist" containerID="29a0c3082d6e2892347acd48dfa51df24e3a9095f2995d3c41de3086b7d78f2c" Jul 05 07:51:22.148928 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.148844 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29a0c3082d6e2892347acd48dfa51df24e3a9095f2995d3c41de3086b7d78f2c"} err="failed to get container status \"29a0c3082d6e2892347acd48dfa51df24e3a9095f2995d3c41de3086b7d78f2c\": rpc error: code = NotFound desc = could not find container \"29a0c3082d6e2892347acd48dfa51df24e3a9095f2995d3c41de3086b7d78f2c\": container with ID starting with 29a0c3082d6e2892347acd48dfa51df24e3a9095f2995d3c41de3086b7d78f2c not found: ID does not exist" Jul 05 07:51:22.195420 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.195387 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b4754f8b-cp8mm"] Jul 05 07:51:22.198822 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.198805 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-b4754f8b-cp8mm"] Jul 05 07:51:22.622362 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.622328 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5784d6d4d7-svngg"] Jul 05 07:51:22.622651 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.622637 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44860d7b-edf6-41fa-889e-10aa1e202e6b" containerName="registry" Jul 05 07:51:22.622692 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.622652 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="44860d7b-edf6-41fa-889e-10aa1e202e6b" containerName="registry" Jul 05 07:51:22.622733 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.622701 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="44860d7b-edf6-41fa-889e-10aa1e202e6b" containerName="registry" Jul 05 07:51:22.625421 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.625406 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5784d6d4d7-svngg" Jul 05 07:51:22.628218 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.628195 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 05 07:51:22.628332 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.628314 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-xbws5\"" Jul 05 07:51:22.628410 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.628395 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5bfpcr5d614s8\"" Jul 05 07:51:22.629338 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.629315 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 05 07:51:22.629415 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.629347 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 05 07:51:22.629468 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.629353 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 05 07:51:22.636032 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.636014 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5784d6d4d7-svngg"] Jul 05 07:51:22.711160 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.711111 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwfl7\" (UniqueName: \"kubernetes.io/projected/7492730d-f99c-4db1-a9fc-64487b00364e-kube-api-access-cwfl7\") pod \"metrics-server-5784d6d4d7-svngg\" (UID: \"7492730d-f99c-4db1-a9fc-64487b00364e\") " pod="openshift-monitoring/metrics-server-5784d6d4d7-svngg" Jul 05 07:51:22.711308 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.711232 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7492730d-f99c-4db1-a9fc-64487b00364e-secret-metrics-server-tls\") pod \"metrics-server-5784d6d4d7-svngg\" (UID: \"7492730d-f99c-4db1-a9fc-64487b00364e\") " pod="openshift-monitoring/metrics-server-5784d6d4d7-svngg" Jul 05 07:51:22.711308 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.711286 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7492730d-f99c-4db1-a9fc-64487b00364e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5784d6d4d7-svngg\" (UID: \"7492730d-f99c-4db1-a9fc-64487b00364e\") " pod="openshift-monitoring/metrics-server-5784d6d4d7-svngg" Jul 05 07:51:22.711418 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.711317 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7492730d-f99c-4db1-a9fc-64487b00364e-metrics-server-audit-profiles\") pod \"metrics-server-5784d6d4d7-svngg\" (UID: \"7492730d-f99c-4db1-a9fc-64487b00364e\") " pod="openshift-monitoring/metrics-server-5784d6d4d7-svngg" Jul 05 07:51:22.711418 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.711344 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7492730d-f99c-4db1-a9fc-64487b00364e-secret-metrics-server-client-certs\") pod \"metrics-server-5784d6d4d7-svngg\" (UID: \"7492730d-f99c-4db1-a9fc-64487b00364e\") " pod="openshift-monitoring/metrics-server-5784d6d4d7-svngg" Jul 05 07:51:22.711418 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.711386 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7492730d-f99c-4db1-a9fc-64487b00364e-audit-log\") pod \"metrics-server-5784d6d4d7-svngg\" (UID: \"7492730d-f99c-4db1-a9fc-64487b00364e\") " pod="openshift-monitoring/metrics-server-5784d6d4d7-svngg" Jul 05 07:51:22.711562 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.711499 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7492730d-f99c-4db1-a9fc-64487b00364e-client-ca-bundle\") pod \"metrics-server-5784d6d4d7-svngg\" (UID: \"7492730d-f99c-4db1-a9fc-64487b00364e\") " pod="openshift-monitoring/metrics-server-5784d6d4d7-svngg" Jul 05 07:51:22.812459 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.812426 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7492730d-f99c-4db1-a9fc-64487b00364e-client-ca-bundle\") pod \"metrics-server-5784d6d4d7-svngg\" (UID: \"7492730d-f99c-4db1-a9fc-64487b00364e\") " pod="openshift-monitoring/metrics-server-5784d6d4d7-svngg" Jul 05 07:51:22.812645 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.812481 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwfl7\" (UniqueName: \"kubernetes.io/projected/7492730d-f99c-4db1-a9fc-64487b00364e-kube-api-access-cwfl7\") pod \"metrics-server-5784d6d4d7-svngg\" (UID: \"7492730d-f99c-4db1-a9fc-64487b00364e\") " pod="openshift-monitoring/metrics-server-5784d6d4d7-svngg" Jul 05 07:51:22.812645 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.812553 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7492730d-f99c-4db1-a9fc-64487b00364e-secret-metrics-server-tls\") pod \"metrics-server-5784d6d4d7-svngg\" (UID: \"7492730d-f99c-4db1-a9fc-64487b00364e\") " pod="openshift-monitoring/metrics-server-5784d6d4d7-svngg" Jul 05 07:51:22.812645 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.812590 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7492730d-f99c-4db1-a9fc-64487b00364e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5784d6d4d7-svngg\" (UID: \"7492730d-f99c-4db1-a9fc-64487b00364e\") " pod="openshift-monitoring/metrics-server-5784d6d4d7-svngg" Jul 05 07:51:22.812645 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.812613 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7492730d-f99c-4db1-a9fc-64487b00364e-metrics-server-audit-profiles\") pod \"metrics-server-5784d6d4d7-svngg\" (UID: \"7492730d-f99c-4db1-a9fc-64487b00364e\") " pod="openshift-monitoring/metrics-server-5784d6d4d7-svngg" Jul 05 07:51:22.812645 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.812632 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7492730d-f99c-4db1-a9fc-64487b00364e-secret-metrics-server-client-certs\") pod \"metrics-server-5784d6d4d7-svngg\" (UID: \"7492730d-f99c-4db1-a9fc-64487b00364e\") " pod="openshift-monitoring/metrics-server-5784d6d4d7-svngg" Jul 05 07:51:22.812864 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.812674 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7492730d-f99c-4db1-a9fc-64487b00364e-audit-log\") pod \"metrics-server-5784d6d4d7-svngg\" (UID: \"7492730d-f99c-4db1-a9fc-64487b00364e\") " pod="openshift-monitoring/metrics-server-5784d6d4d7-svngg" Jul 05 07:51:22.813151 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.813111 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7492730d-f99c-4db1-a9fc-64487b00364e-audit-log\") pod \"metrics-server-5784d6d4d7-svngg\" (UID: \"7492730d-f99c-4db1-a9fc-64487b00364e\") " pod="openshift-monitoring/metrics-server-5784d6d4d7-svngg" Jul 05 07:51:22.813459 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.813436 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7492730d-f99c-4db1-a9fc-64487b00364e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5784d6d4d7-svngg\" (UID: \"7492730d-f99c-4db1-a9fc-64487b00364e\") " pod="openshift-monitoring/metrics-server-5784d6d4d7-svngg" Jul 05 07:51:22.813695 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.813676 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7492730d-f99c-4db1-a9fc-64487b00364e-metrics-server-audit-profiles\") pod \"metrics-server-5784d6d4d7-svngg\" (UID: \"7492730d-f99c-4db1-a9fc-64487b00364e\") " pod="openshift-monitoring/metrics-server-5784d6d4d7-svngg" Jul 05 07:51:22.815175 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.815156 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7492730d-f99c-4db1-a9fc-64487b00364e-secret-metrics-server-client-certs\") pod \"metrics-server-5784d6d4d7-svngg\" (UID: \"7492730d-f99c-4db1-a9fc-64487b00364e\") " pod="openshift-monitoring/metrics-server-5784d6d4d7-svngg" Jul 05 07:51:22.815642 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.815623 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7492730d-f99c-4db1-a9fc-64487b00364e-secret-metrics-server-tls\") pod \"metrics-server-5784d6d4d7-svngg\" (UID: \"7492730d-f99c-4db1-a9fc-64487b00364e\") " pod="openshift-monitoring/metrics-server-5784d6d4d7-svngg" Jul 05 07:51:22.815678 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.815623 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7492730d-f99c-4db1-a9fc-64487b00364e-client-ca-bundle\") pod \"metrics-server-5784d6d4d7-svngg\" (UID: \"7492730d-f99c-4db1-a9fc-64487b00364e\") " pod="openshift-monitoring/metrics-server-5784d6d4d7-svngg" Jul 05 07:51:22.819657 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.819639 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwfl7\" (UniqueName: \"kubernetes.io/projected/7492730d-f99c-4db1-a9fc-64487b00364e-kube-api-access-cwfl7\") pod \"metrics-server-5784d6d4d7-svngg\" (UID: \"7492730d-f99c-4db1-a9fc-64487b00364e\") " pod="openshift-monitoring/metrics-server-5784d6d4d7-svngg" Jul 05 07:51:22.828825 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.828801 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:22.935034 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:22.934966 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5784d6d4d7-svngg" Jul 05 07:51:23.008539 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:23.008428 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:23.009119 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:23.009096 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-5l4kr"] Jul 05 07:51:23.012752 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:23.012731 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5l4kr" Jul 05 07:51:23.015568 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:23.015549 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 05 07:51:23.015671 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:23.015545 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-t8d2g\"" Jul 05 07:51:23.021344 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:23.021290 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-5l4kr"] Jul 05 07:51:23.110403 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:23.110276 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5784d6d4d7-svngg"] Jul 05 07:51:23.112225 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:23.112203 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pndsb" Jul 05 07:51:23.112986 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:51:23.112962 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7492730d_f99c_4db1_a9fc_64487b00364e.slice/crio-ffa61f2f47a36c077d5235d05c90c190c933afc6025590ef2390d707bf74991d WatchSource:0}: Error finding container ffa61f2f47a36c077d5235d05c90c190c933afc6025590ef2390d707bf74991d: Status 404 returned error can't find the container with id ffa61f2f47a36c077d5235d05c90c190c933afc6025590ef2390d707bf74991d Jul 05 07:51:23.113450 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:23.113423 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:23.114800 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:23.114784 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn8bt\" (UniqueName: \"kubernetes.io/projected/4ba7f0b4-f809-44d0-b929-556bf4c91b69-kube-api-access-fn8bt\") pod \"monitoring-plugin-d5dcff7cf-5l4kr\" (UID: \"4ba7f0b4-f809-44d0-b929-556bf4c91b69\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5l4kr" Jul 05 07:51:23.114874 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:23.114820 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ba7f0b4-f809-44d0-b929-556bf4c91b69-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-5l4kr\" (UID: \"4ba7f0b4-f809-44d0-b929-556bf4c91b69\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5l4kr" Jul 05 07:51:23.125015 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:23.124994 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44860d7b-edf6-41fa-889e-10aa1e202e6b" path="/var/lib/kubelet/pods/44860d7b-edf6-41fa-889e-10aa1e202e6b/volumes" Jul 05 07:51:23.146557 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:23.146525 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5784d6d4d7-svngg" event={"ID":"7492730d-f99c-4db1-a9fc-64487b00364e","Type":"ContainerStarted","Data":"ffa61f2f47a36c077d5235d05c90c190c933afc6025590ef2390d707bf74991d"} Jul 05 07:51:23.149794 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:23.149769 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4v2v2" event={"ID":"15708bce-9fc3-44a1-bf40-4878591db45c","Type":"ContainerStarted","Data":"65140b003b11d0abed63e486984c115475aad476a150d2da2b93b6166e668063"} Jul 05 07:51:23.149904 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:23.149815 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4v2v2" event={"ID":"15708bce-9fc3-44a1-bf40-4878591db45c","Type":"ContainerStarted","Data":"cf021467fd78b6d1fc7dc8ff2650b1d5929ea2e51e58afa37b680564e42907fe"} Jul 05 07:51:23.167261 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:23.167208 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4v2v2" podStartSLOduration=3.936218098 podStartE2EDuration="5.16718962s" totalImagesPullingTime="1.164956648s" totalInitContainerRuntime="66.014874ms" isStatefulPod=true podCreationTimestamp="2026-07-05 07:51:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:51:23.166500666 +0000 UTC m=+298.586233740" watchObservedRunningTime="2026-07-05 07:51:23.16718962 +0000 UTC m=+298.586922676" Jul 05 07:51:23.215267 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:23.215195 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ba7f0b4-f809-44d0-b929-556bf4c91b69-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-5l4kr\" (UID: \"4ba7f0b4-f809-44d0-b929-556bf4c91b69\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5l4kr" Jul 05 07:51:23.215450 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:51:23.215420 2566 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 05 07:51:23.215532 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:51:23.215501 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ba7f0b4-f809-44d0-b929-556bf4c91b69-monitoring-plugin-cert podName:4ba7f0b4-f809-44d0-b929-556bf4c91b69 nodeName:}" failed. No retries permitted until 2026-07-05 07:51:23.715479234 +0000 UTC m=+299.135212301 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/4ba7f0b4-f809-44d0-b929-556bf4c91b69-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-5l4kr" (UID: "4ba7f0b4-f809-44d0-b929-556bf4c91b69") : secret "monitoring-plugin-cert" not found Jul 05 07:51:23.215532 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:23.215522 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn8bt\" (UniqueName: \"kubernetes.io/projected/4ba7f0b4-f809-44d0-b929-556bf4c91b69-kube-api-access-fn8bt\") pod \"monitoring-plugin-d5dcff7cf-5l4kr\" (UID: \"4ba7f0b4-f809-44d0-b929-556bf4c91b69\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5l4kr" Jul 05 07:51:23.223972 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:23.223948 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn8bt\" (UniqueName: \"kubernetes.io/projected/4ba7f0b4-f809-44d0-b929-556bf4c91b69-kube-api-access-fn8bt\") pod \"monitoring-plugin-d5dcff7cf-5l4kr\" (UID: \"4ba7f0b4-f809-44d0-b929-556bf4c91b69\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5l4kr" Jul 05 07:51:23.720565 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:23.720540 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ba7f0b4-f809-44d0-b929-556bf4c91b69-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-5l4kr\" (UID: \"4ba7f0b4-f809-44d0-b929-556bf4c91b69\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5l4kr" Jul 05 07:51:23.720684 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:51:23.720670 2566 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 05 07:51:23.720733 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:51:23.720725 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ba7f0b4-f809-44d0-b929-556bf4c91b69-monitoring-plugin-cert podName:4ba7f0b4-f809-44d0-b929-556bf4c91b69 nodeName:}" failed. No retries permitted until 2026-07-05 07:51:24.720711985 +0000 UTC m=+300.140445017 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/4ba7f0b4-f809-44d0-b929-556bf4c91b69-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-5l4kr" (UID: "4ba7f0b4-f809-44d0-b929-556bf4c91b69") : secret "monitoring-plugin-cert" not found Jul 05 07:51:23.900538 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:23.900506 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:24.006411 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.006353 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:24.054904 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.054861 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:24.156168 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.156107 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e80e3e02-11c4-4f94-a072-bfe95b79fd1b","Type":"ContainerStarted","Data":"dd5e2300b01b612c7ae2e618a3909c2c9cfeda0209a4fc2c3ab766d3b801a31b"} Jul 05 07:51:24.156515 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.156246 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e80e3e02-11c4-4f94-a072-bfe95b79fd1b","Type":"ContainerStarted","Data":"8d592f7d6b1abc579e0aafcf3bcfb463218c3e2da27061af98cf058c60d29008"} Jul 05 07:51:24.156515 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.156292 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e80e3e02-11c4-4f94-a072-bfe95b79fd1b","Type":"ContainerStarted","Data":"1894e9b966609e7a3a2b265678f7e1a5acb1f8f9d5151a6952a08e80aacf5129"} Jul 05 07:51:24.156515 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.156334 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e80e3e02-11c4-4f94-a072-bfe95b79fd1b","Type":"ContainerStarted","Data":"b5c2960460b435be3fe31efe3b77f6222e1767eda338bdd040c79f3eb04ab10a"} Jul 05 07:51:24.156515 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.156372 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e80e3e02-11c4-4f94-a072-bfe95b79fd1b","Type":"ContainerStarted","Data":"e3dcba591eabdcd4a62b73699a1432606faf238810b7b03ecdf2f7a167d569ad"} Jul 05 07:51:24.411989 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.411947 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:24.418497 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.418474 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 05 07:51:24.422439 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.422418 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.425579 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.425507 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ff0m27ipikg1g\"" Jul 05 07:51:24.425677 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.425585 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 05 07:51:24.425677 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.425633 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 05 07:51:24.425677 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.425654 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 05 07:51:24.425677 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.425510 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 05 07:51:24.425925 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.425515 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 05 07:51:24.425925 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.425510 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 05 07:51:24.425925 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.425592 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 05 07:51:24.426064 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.425939 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 05 07:51:24.426923 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.426904 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 05 07:51:24.427435 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.427378 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 05 07:51:24.427435 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.427411 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hjbkh\"" Jul 05 07:51:24.427588 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.427442 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 05 07:51:24.427588 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.427380 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 05 07:51:24.427741 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.427717 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 05 07:51:24.429446 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.429428 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 05 07:51:24.437953 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.437931 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 05 07:51:24.529222 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.529180 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.529410 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.529235 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.529410 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.529303 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.529410 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.529350 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.529410 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.529381 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-web-config\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.529410 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.529408 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.529667 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.529435 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/968b0b3a-3acb-4cde-8343-55e85bebbe2c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.529667 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.529497 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.529667 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.529541 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.529667 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.529577 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.529667 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.529639 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.529977 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.529735 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-config\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.529977 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.529776 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.529977 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.529805 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.529977 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.529890 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/968b0b3a-3acb-4cde-8343-55e85bebbe2c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.529977 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.529929 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.529977 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.529960 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.530291 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.530006 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/968b0b3a-3acb-4cde-8343-55e85bebbe2c-config-out\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.530291 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.530059 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.530291 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.530096 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxjl6\" (UniqueName: \"kubernetes.io/projected/968b0b3a-3acb-4cde-8343-55e85bebbe2c-kube-api-access-pxjl6\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.631048 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.631019 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxjl6\" (UniqueName: \"kubernetes.io/projected/968b0b3a-3acb-4cde-8343-55e85bebbe2c-kube-api-access-pxjl6\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.631235 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.631159 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.631235 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.631193 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.631235 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.631221 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.631389 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.631251 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.631389 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.631279 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-web-config\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.631389 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.631304 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.631389 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.631338 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/968b0b3a-3acb-4cde-8343-55e85bebbe2c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.631389 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.631362 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.631630 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.631393 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.631630 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.631433 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.631630 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.631476 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.631630 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.631518 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-config\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.631630 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.631555 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.631630 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.631580 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.631630 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.631612 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/968b0b3a-3acb-4cde-8343-55e85bebbe2c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.631950 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.631641 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.631950 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.631673 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.631950 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.631713 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/968b0b3a-3acb-4cde-8343-55e85bebbe2c-config-out\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.631950 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.631763 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.632201 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.632171 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.632336 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.632219 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.632838 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.632511 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/968b0b3a-3acb-4cde-8343-55e85bebbe2c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.632838 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.632522 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.632838 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.632721 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.634777 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.633172 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.637909 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.636904 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.637909 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.636916 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.637909 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.636972 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.637909 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.637400 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.637909 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.637637 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.637909 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.637841 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.637909 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.637839 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.638305 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.638232 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/968b0b3a-3acb-4cde-8343-55e85bebbe2c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.638305 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.638278 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-config\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.638810 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.638772 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-web-config\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.638954 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.638930 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.639750 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.639730 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/968b0b3a-3acb-4cde-8343-55e85bebbe2c-config-out\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.639830 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.639797 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.640256 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.640236 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxjl6\" (UniqueName: \"kubernetes.io/projected/968b0b3a-3acb-4cde-8343-55e85bebbe2c-kube-api-access-pxjl6\") pod \"prometheus-k8s-0\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.732996 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.732912 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ba7f0b4-f809-44d0-b929-556bf4c91b69-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-5l4kr\" (UID: \"4ba7f0b4-f809-44d0-b929-556bf4c91b69\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5l4kr" Jul 05 07:51:24.734666 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.734635 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:24.735551 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.735516 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ba7f0b4-f809-44d0-b929-556bf4c91b69-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-5l4kr\" (UID: \"4ba7f0b4-f809-44d0-b929-556bf4c91b69\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5l4kr" Jul 05 07:51:24.825058 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.825032 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5l4kr" Jul 05 07:51:24.997577 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:24.997545 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 05 07:51:25.009149 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:25.008995 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-5l4kr"] Jul 05 07:51:25.013087 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:51:25.013059 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ba7f0b4_f809_44d0_b929_556bf4c91b69.slice/crio-fa9bbf312b083f28822cd72bea98b1e1f0600687ab95e04ad37f9daa943bfd46 WatchSource:0}: Error finding container fa9bbf312b083f28822cd72bea98b1e1f0600687ab95e04ad37f9daa943bfd46: Status 404 returned error can't find the container with id fa9bbf312b083f28822cd72bea98b1e1f0600687ab95e04ad37f9daa943bfd46 Jul 05 07:51:25.028112 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:25.028091 2566 kubelet.go:1648] "Image garbage collection succeeded" Jul 05 07:51:25.162632 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:25.162586 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e80e3e02-11c4-4f94-a072-bfe95b79fd1b","Type":"ContainerStarted","Data":"ac0fd54691e7ac01c756b3353e1bce60dee814674c8bfe376e3d0d5ebb1249e6"} Jul 05 07:51:25.163811 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:25.163786 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5l4kr" event={"ID":"4ba7f0b4-f809-44d0-b929-556bf4c91b69","Type":"ContainerStarted","Data":"fa9bbf312b083f28822cd72bea98b1e1f0600687ab95e04ad37f9daa943bfd46"} Jul 05 07:51:25.165082 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:25.165060 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5784d6d4d7-svngg" event={"ID":"7492730d-f99c-4db1-a9fc-64487b00364e","Type":"ContainerStarted","Data":"3ea748419afaf338115b9ec2db029fc229a75a6d9912bc4edab926e1eb4385ab"} Jul 05 07:51:25.166745 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:25.166720 2566 generic.go:356] "Generic (PLEG): container finished" podID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerID="2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901" exitCode=0 Jul 05 07:51:25.166835 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:25.166748 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"968b0b3a-3acb-4cde-8343-55e85bebbe2c","Type":"ContainerDied","Data":"2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901"} Jul 05 07:51:25.166835 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:25.166815 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"968b0b3a-3acb-4cde-8343-55e85bebbe2c","Type":"ContainerStarted","Data":"c9675a325621b5aa53ee0a08ac4325e171e970790a59203995bdcc9802ff42e6"} Jul 05 07:51:25.187717 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:25.187679 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.624937718 podStartE2EDuration="6.18766533s" totalImagesPullingTime="3.545172953s" totalInitContainerRuntime="17.554659ms" isStatefulPod=false podCreationTimestamp="2026-07-05 07:51:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:51:25.186406354 +0000 UTC m=+300.606139410" watchObservedRunningTime="2026-07-05 07:51:25.18766533 +0000 UTC m=+300.607398384" Jul 05 07:51:25.202699 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:25.202653 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5784d6d4d7-svngg" podStartSLOduration=1.46631074 podStartE2EDuration="3.20263509s" totalImagesPullingTime="1.73632435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 07:51:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:51:25.202371121 +0000 UTC m=+300.622104178" watchObservedRunningTime="2026-07-05 07:51:25.20263509 +0000 UTC m=+300.622368146" Jul 05 07:51:25.221892 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:25.221708 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:25.322613 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:25.322575 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:27.177562 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:27.177519 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5l4kr" event={"ID":"4ba7f0b4-f809-44d0-b929-556bf4c91b69","Type":"ContainerStarted","Data":"635c7064b4a46bcb74a5e100fcc5f487d748a3d4170166edc6282fd93a969c2e"} Jul 05 07:51:27.178061 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:27.177835 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5l4kr" Jul 05 07:51:27.183368 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:27.183348 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5l4kr" Jul 05 07:51:27.192207 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:27.192168 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5l4kr" podStartSLOduration=3.842552373 podStartE2EDuration="5.192151974s" totalImagesPullingTime="1.349599601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 07:51:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:51:27.191045119 +0000 UTC m=+302.610778177" watchObservedRunningTime="2026-07-05 07:51:27.192151974 +0000 UTC m=+302.611885029" Jul 05 07:51:28.597807 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:28.597785 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 07:51:29.188946 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:29.188909 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"968b0b3a-3acb-4cde-8343-55e85bebbe2c","Type":"ContainerStarted","Data":"460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9"} Jul 05 07:51:29.189128 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:29.188993 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"968b0b3a-3acb-4cde-8343-55e85bebbe2c","Type":"ContainerStarted","Data":"2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610"} Jul 05 07:51:30.119833 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:30.119795 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:51:30.446188 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:30.446159 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:30.546273 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:30.546247 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:31.198327 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:31.198296 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"968b0b3a-3acb-4cde-8343-55e85bebbe2c","Type":"ContainerStarted","Data":"e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c"} Jul 05 07:51:31.198686 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:31.198353 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"968b0b3a-3acb-4cde-8343-55e85bebbe2c","Type":"ContainerStarted","Data":"c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963"} Jul 05 07:51:31.198686 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:31.198383 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"968b0b3a-3acb-4cde-8343-55e85bebbe2c","Type":"ContainerStarted","Data":"3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757"} Jul 05 07:51:31.198686 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:31.198408 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"968b0b3a-3acb-4cde-8343-55e85bebbe2c","Type":"ContainerStarted","Data":"d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8"} Jul 05 07:51:31.225592 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:31.225540 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.299504425 podStartE2EDuration="7.225524926s" totalImagesPullingTime="4.90767572s" totalInitContainerRuntime="18.344781ms" isStatefulPod=false podCreationTimestamp="2026-07-05 07:51:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:51:31.223400863 +0000 UTC m=+306.643133924" watchObservedRunningTime="2026-07-05 07:51:31.225524926 +0000 UTC m=+306.645257980" Jul 05 07:51:32.102633 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:32.102602 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:32.203267 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:32.203238 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:32.304338 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:32.304309 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:34.193793 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:34.193756 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bdfd4677f-6zc6s"] Jul 05 07:51:34.287435 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:34.287397 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:34.388571 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:34.388547 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:34.488539 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:34.488478 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:34.735229 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:34.735198 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:51:39.556032 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:39.556001 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:39.657084 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:39.657052 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:42.528476 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:42.528441 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:42.576665 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:42.576635 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:42.936024 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:42.935928 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5784d6d4d7-svngg" Jul 05 07:51:42.936024 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:42.935997 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5784d6d4d7-svngg" Jul 05 07:51:52.256829 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:52.256795 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:57.532725 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:57.532693 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:57.629931 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:57.629903 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:51:59.215368 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:59.215331 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-bdfd4677f-6zc6s" podUID="cd99dc7c-1a82-49c1-9834-679e5f40d4f2" containerName="console" containerID="cri-o://5062ce5176f0ed1d7b3c84722253d2fa5473c05086643eb30e59b6efcdd621c3" gracePeriod=15 Jul 05 07:51:59.480059 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:59.480007 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bdfd4677f-6zc6s" Jul 05 07:51:59.632637 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:59.632603 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-trusted-ca-bundle\") pod \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\" (UID: \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\") " Jul 05 07:51:59.632802 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:59.632651 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-console-oauth-config\") pod \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\" (UID: \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\") " Jul 05 07:51:59.632802 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:59.632687 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6crrt\" (UniqueName: \"kubernetes.io/projected/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-kube-api-access-6crrt\") pod \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\" (UID: \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\") " Jul 05 07:51:59.632923 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:59.632803 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-oauth-serving-cert\") pod \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\" (UID: \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\") " Jul 05 07:51:59.632923 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:59.632842 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-console-config\") pod \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\" (UID: \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\") " Jul 05 07:51:59.632923 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:59.632868 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-service-ca\") pod \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\" (UID: \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\") " Jul 05 07:51:59.633061 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:59.632922 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-console-serving-cert\") pod \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\" (UID: \"cd99dc7c-1a82-49c1-9834-679e5f40d4f2\") " Jul 05 07:51:59.633116 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:59.633028 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cd99dc7c-1a82-49c1-9834-679e5f40d4f2" (UID: "cd99dc7c-1a82-49c1-9834-679e5f40d4f2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 07:51:59.633213 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:59.633166 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cd99dc7c-1a82-49c1-9834-679e5f40d4f2" (UID: "cd99dc7c-1a82-49c1-9834-679e5f40d4f2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 07:51:59.633305 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:59.633276 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-console-config" (OuterVolumeSpecName: "console-config") pod "cd99dc7c-1a82-49c1-9834-679e5f40d4f2" (UID: "cd99dc7c-1a82-49c1-9834-679e5f40d4f2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 07:51:59.633417 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:59.633326 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-service-ca" (OuterVolumeSpecName: "service-ca") pod "cd99dc7c-1a82-49c1-9834-679e5f40d4f2" (UID: "cd99dc7c-1a82-49c1-9834-679e5f40d4f2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 07:51:59.633480 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:59.633418 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-trusted-ca-bundle\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:51:59.633480 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:59.633438 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-oauth-serving-cert\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:51:59.633480 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:59.633453 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-console-config\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:51:59.633480 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:59.633467 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-service-ca\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:51:59.635007 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:59.634906 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cd99dc7c-1a82-49c1-9834-679e5f40d4f2" (UID: "cd99dc7c-1a82-49c1-9834-679e5f40d4f2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 07:51:59.635007 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:59.634962 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-kube-api-access-6crrt" (OuterVolumeSpecName: "kube-api-access-6crrt") pod "cd99dc7c-1a82-49c1-9834-679e5f40d4f2" (UID: "cd99dc7c-1a82-49c1-9834-679e5f40d4f2"). InnerVolumeSpecName "kube-api-access-6crrt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 07:51:59.635007 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:59.634978 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cd99dc7c-1a82-49c1-9834-679e5f40d4f2" (UID: "cd99dc7c-1a82-49c1-9834-679e5f40d4f2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 07:51:59.734591 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:59.734530 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-console-oauth-config\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:51:59.734591 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:59.734555 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6crrt\" (UniqueName: \"kubernetes.io/projected/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-kube-api-access-6crrt\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:51:59.734591 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:51:59.734565 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd99dc7c-1a82-49c1-9834-679e5f40d4f2-console-serving-cert\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:00.307874 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:00.307839 2566 generic.go:356] "Generic (PLEG): container finished" podID="cd99dc7c-1a82-49c1-9834-679e5f40d4f2" containerID="5062ce5176f0ed1d7b3c84722253d2fa5473c05086643eb30e59b6efcdd621c3" exitCode=0 Jul 05 07:52:00.308287 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:00.307903 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bdfd4677f-6zc6s" event={"ID":"cd99dc7c-1a82-49c1-9834-679e5f40d4f2","Type":"ContainerDied","Data":"5062ce5176f0ed1d7b3c84722253d2fa5473c05086643eb30e59b6efcdd621c3"} Jul 05 07:52:00.308287 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:00.307941 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bdfd4677f-6zc6s" event={"ID":"cd99dc7c-1a82-49c1-9834-679e5f40d4f2","Type":"ContainerDied","Data":"bc90d90c7fc1b2ff71c92e3e9467f4c8234296b4891c8ac52bb005e2fa5302c0"} Jul 05 07:52:00.308287 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:00.307961 2566 scope.go:117] "RemoveContainer" containerID="5062ce5176f0ed1d7b3c84722253d2fa5473c05086643eb30e59b6efcdd621c3" Jul 05 07:52:00.308287 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:00.307885 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bdfd4677f-6zc6s" Jul 05 07:52:00.316810 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:00.316791 2566 scope.go:117] "RemoveContainer" containerID="5062ce5176f0ed1d7b3c84722253d2fa5473c05086643eb30e59b6efcdd621c3" Jul 05 07:52:00.317092 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:52:00.317067 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5062ce5176f0ed1d7b3c84722253d2fa5473c05086643eb30e59b6efcdd621c3\": container with ID starting with 5062ce5176f0ed1d7b3c84722253d2fa5473c05086643eb30e59b6efcdd621c3 not found: ID does not exist" containerID="5062ce5176f0ed1d7b3c84722253d2fa5473c05086643eb30e59b6efcdd621c3" Jul 05 07:52:00.317207 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:00.317096 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5062ce5176f0ed1d7b3c84722253d2fa5473c05086643eb30e59b6efcdd621c3"} err="failed to get container status \"5062ce5176f0ed1d7b3c84722253d2fa5473c05086643eb30e59b6efcdd621c3\": rpc error: code = NotFound desc = could not find container \"5062ce5176f0ed1d7b3c84722253d2fa5473c05086643eb30e59b6efcdd621c3\": container with ID starting with 5062ce5176f0ed1d7b3c84722253d2fa5473c05086643eb30e59b6efcdd621c3 not found: ID does not exist" Jul 05 07:52:00.329401 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:00.329377 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bdfd4677f-6zc6s"] Jul 05 07:52:00.335789 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:00.335759 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bdfd4677f-6zc6s"] Jul 05 07:52:01.125558 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:01.125529 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd99dc7c-1a82-49c1-9834-679e5f40d4f2" path="/var/lib/kubelet/pods/cd99dc7c-1a82-49c1-9834-679e5f40d4f2/volumes" Jul 05 07:52:02.941017 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:02.940987 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5784d6d4d7-svngg" Jul 05 07:52:02.945203 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:02.945173 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5784d6d4d7-svngg" Jul 05 07:52:24.735119 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:24.735045 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:24.750286 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:24.750259 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:25.410006 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:25.409984 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:29.644725 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:29.644694 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:52:29.694341 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:29.694314 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:52:37.403040 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:37.403000 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:52:37.605230 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:37.605201 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:52:38.030419 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:38.030382 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs\") pod \"network-metrics-daemon-mt69q\" (UID: \"2b6430fa-c37c-4cc9-81ab-3feb7300273e\") " pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:52:38.032602 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:38.032573 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b6430fa-c37c-4cc9-81ab-3feb7300273e-metrics-certs\") pod \"network-metrics-daemon-mt69q\" (UID: \"2b6430fa-c37c-4cc9-81ab-3feb7300273e\") " pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:52:38.223380 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:38.223352 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rkspj\"" Jul 05 07:52:38.231537 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:38.231522 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mt69q" Jul 05 07:52:38.353697 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:38.353669 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mt69q"] Jul 05 07:52:38.356622 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:52:38.356590 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b6430fa_c37c_4cc9_81ab_3feb7300273e.slice/crio-610e37d1ecb0d8428e7f26a0dfb32932e3a120b6d56add3d28d28db528bdb1a8 WatchSource:0}: Error finding container 610e37d1ecb0d8428e7f26a0dfb32932e3a120b6d56add3d28d28db528bdb1a8: Status 404 returned error can't find the container with id 610e37d1ecb0d8428e7f26a0dfb32932e3a120b6d56add3d28d28db528bdb1a8 Jul 05 07:52:38.449707 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:38.449674 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mt69q" event={"ID":"2b6430fa-c37c-4cc9-81ab-3feb7300273e","Type":"ContainerStarted","Data":"610e37d1ecb0d8428e7f26a0dfb32932e3a120b6d56add3d28d28db528bdb1a8"} Jul 05 07:52:38.468973 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:38.468945 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 05 07:52:38.469269 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:38.469231 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerName="alertmanager" containerID="cri-o://e3dcba591eabdcd4a62b73699a1432606faf238810b7b03ecdf2f7a167d569ad" gracePeriod=120 Jul 05 07:52:38.469337 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:38.469285 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerName="kube-rbac-proxy-metric" containerID="cri-o://dd5e2300b01b612c7ae2e618a3909c2c9cfeda0209a4fc2c3ab766d3b801a31b" gracePeriod=120 Jul 05 07:52:38.469337 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:38.469313 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerName="prom-label-proxy" containerID="cri-o://ac0fd54691e7ac01c756b3353e1bce60dee814674c8bfe376e3d0d5ebb1249e6" gracePeriod=120 Jul 05 07:52:38.469439 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:38.469354 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerName="kube-rbac-proxy" containerID="cri-o://8d592f7d6b1abc579e0aafcf3bcfb463218c3e2da27061af98cf058c60d29008" gracePeriod=120 Jul 05 07:52:38.469439 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:38.469370 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerName="config-reloader" containerID="cri-o://b5c2960460b435be3fe31efe3b77f6222e1767eda338bdd040c79f3eb04ab10a" gracePeriod=120 Jul 05 07:52:38.469439 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:38.469314 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerName="kube-rbac-proxy-web" containerID="cri-o://1894e9b966609e7a3a2b265678f7e1a5acb1f8f9d5151a6952a08e80aacf5129" gracePeriod=120 Jul 05 07:52:39.455400 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.455361 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mt69q" event={"ID":"2b6430fa-c37c-4cc9-81ab-3feb7300273e","Type":"ContainerStarted","Data":"40c4419ec9ef6c696300f58cfe0d1ea0ddffa8dcc05671a5035f4089c4dccf4e"} Jul 05 07:52:39.455809 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.455414 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mt69q" event={"ID":"2b6430fa-c37c-4cc9-81ab-3feb7300273e","Type":"ContainerStarted","Data":"6419c9bd0a2c5f0d6aba15bc1cecd6795e5e7de6a19b611c17976d9b100444a1"} Jul 05 07:52:39.458632 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.458606 2566 generic.go:356] "Generic (PLEG): container finished" podID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerID="ac0fd54691e7ac01c756b3353e1bce60dee814674c8bfe376e3d0d5ebb1249e6" exitCode=0 Jul 05 07:52:39.458632 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.458631 2566 generic.go:356] "Generic (PLEG): container finished" podID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerID="8d592f7d6b1abc579e0aafcf3bcfb463218c3e2da27061af98cf058c60d29008" exitCode=0 Jul 05 07:52:39.458777 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.458640 2566 generic.go:356] "Generic (PLEG): container finished" podID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerID="b5c2960460b435be3fe31efe3b77f6222e1767eda338bdd040c79f3eb04ab10a" exitCode=0 Jul 05 07:52:39.458777 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.458645 2566 generic.go:356] "Generic (PLEG): container finished" podID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerID="e3dcba591eabdcd4a62b73699a1432606faf238810b7b03ecdf2f7a167d569ad" exitCode=0 Jul 05 07:52:39.458777 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.458687 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e80e3e02-11c4-4f94-a072-bfe95b79fd1b","Type":"ContainerDied","Data":"ac0fd54691e7ac01c756b3353e1bce60dee814674c8bfe376e3d0d5ebb1249e6"} Jul 05 07:52:39.458777 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.458761 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e80e3e02-11c4-4f94-a072-bfe95b79fd1b","Type":"ContainerDied","Data":"8d592f7d6b1abc579e0aafcf3bcfb463218c3e2da27061af98cf058c60d29008"} Jul 05 07:52:39.458903 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.458792 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e80e3e02-11c4-4f94-a072-bfe95b79fd1b","Type":"ContainerDied","Data":"b5c2960460b435be3fe31efe3b77f6222e1767eda338bdd040c79f3eb04ab10a"} Jul 05 07:52:39.458903 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.458818 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e80e3e02-11c4-4f94-a072-bfe95b79fd1b","Type":"ContainerDied","Data":"e3dcba591eabdcd4a62b73699a1432606faf238810b7b03ecdf2f7a167d569ad"} Jul 05 07:52:39.469783 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.469742 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mt69q" podStartSLOduration=373.600621656 podStartE2EDuration="6m14.469718787s" totalImagesPullingTime="869.097131ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 07:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:52:39.468986008 +0000 UTC m=+374.888719065" watchObservedRunningTime="2026-07-05 07:52:39.469718787 +0000 UTC m=+374.889451842" Jul 05 07:52:39.549808 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.549758 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:52:39.599322 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.599298 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:52:39.700230 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.700205 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:39.845866 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.845773 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-alertmanager-trusted-ca-bundle\") pod \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " Jul 05 07:52:39.845866 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.845819 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-config-out\") pod \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " Jul 05 07:52:39.845866 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.845848 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " Jul 05 07:52:39.846121 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.845878 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-secret-alertmanager-main-tls\") pod \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " Jul 05 07:52:39.846121 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.845925 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-tls-assets\") pod \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " Jul 05 07:52:39.846121 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.845953 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-secret-alertmanager-kube-rbac-proxy-web\") pod \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " Jul 05 07:52:39.846319 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.846123 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-alertmanager-main-db\") pod \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " Jul 05 07:52:39.846319 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.846204 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-cluster-tls-config\") pod \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " Jul 05 07:52:39.846319 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.846224 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e80e3e02-11c4-4f94-a072-bfe95b79fd1b" (UID: "e80e3e02-11c4-4f94-a072-bfe95b79fd1b"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 07:52:39.846319 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.846235 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-config-volume\") pod \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " Jul 05 07:52:39.846515 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.846419 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8bbv\" (UniqueName: \"kubernetes.io/projected/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-kube-api-access-r8bbv\") pod \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " Jul 05 07:52:39.846515 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.846449 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-web-config\") pod \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " Jul 05 07:52:39.846515 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.846456 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e80e3e02-11c4-4f94-a072-bfe95b79fd1b" (UID: "e80e3e02-11c4-4f94-a072-bfe95b79fd1b"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 07:52:39.846515 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.846473 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-metrics-client-ca\") pod \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " Jul 05 07:52:39.846515 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.846509 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-secret-alertmanager-kube-rbac-proxy\") pod \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\" (UID: \"e80e3e02-11c4-4f94-a072-bfe95b79fd1b\") " Jul 05 07:52:39.847030 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.846770 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-alertmanager-main-db\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:39.847030 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.846795 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:39.847251 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.847212 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e80e3e02-11c4-4f94-a072-bfe95b79fd1b" (UID: "e80e3e02-11c4-4f94-a072-bfe95b79fd1b"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 07:52:39.848821 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.848788 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e80e3e02-11c4-4f94-a072-bfe95b79fd1b" (UID: "e80e3e02-11c4-4f94-a072-bfe95b79fd1b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 07:52:39.848944 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.848828 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e80e3e02-11c4-4f94-a072-bfe95b79fd1b" (UID: "e80e3e02-11c4-4f94-a072-bfe95b79fd1b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 07:52:39.849104 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.849073 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e80e3e02-11c4-4f94-a072-bfe95b79fd1b" (UID: "e80e3e02-11c4-4f94-a072-bfe95b79fd1b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 07:52:39.849104 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.849090 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e80e3e02-11c4-4f94-a072-bfe95b79fd1b" (UID: "e80e3e02-11c4-4f94-a072-bfe95b79fd1b"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 07:52:39.849319 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.849108 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-config-volume" (OuterVolumeSpecName: "config-volume") pod "e80e3e02-11c4-4f94-a072-bfe95b79fd1b" (UID: "e80e3e02-11c4-4f94-a072-bfe95b79fd1b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 07:52:39.849356 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.849322 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-kube-api-access-r8bbv" (OuterVolumeSpecName: "kube-api-access-r8bbv") pod "e80e3e02-11c4-4f94-a072-bfe95b79fd1b" (UID: "e80e3e02-11c4-4f94-a072-bfe95b79fd1b"). InnerVolumeSpecName "kube-api-access-r8bbv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 07:52:39.849473 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.849452 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e80e3e02-11c4-4f94-a072-bfe95b79fd1b" (UID: "e80e3e02-11c4-4f94-a072-bfe95b79fd1b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 07:52:39.850689 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.850662 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-config-out" (OuterVolumeSpecName: "config-out") pod "e80e3e02-11c4-4f94-a072-bfe95b79fd1b" (UID: "e80e3e02-11c4-4f94-a072-bfe95b79fd1b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 07:52:39.853490 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.853468 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e80e3e02-11c4-4f94-a072-bfe95b79fd1b" (UID: "e80e3e02-11c4-4f94-a072-bfe95b79fd1b"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 07:52:39.859397 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.859374 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-web-config" (OuterVolumeSpecName: "web-config") pod "e80e3e02-11c4-4f94-a072-bfe95b79fd1b" (UID: "e80e3e02-11c4-4f94-a072-bfe95b79fd1b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 07:52:39.947870 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.947847 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-tls-assets\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:39.947870 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.947868 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:39.947978 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.947877 2566 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-cluster-tls-config\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:39.947978 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.947886 2566 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-config-volume\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:39.947978 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.947894 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8bbv\" (UniqueName: \"kubernetes.io/projected/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-kube-api-access-r8bbv\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:39.947978 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.947904 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-web-config\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:39.947978 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.947912 2566 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-metrics-client-ca\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:39.947978 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.947920 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:39.947978 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.947928 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-config-out\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:39.947978 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.947936 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:39.947978 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:39.947945 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e80e3e02-11c4-4f94-a072-bfe95b79fd1b-secret-alertmanager-main-tls\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:40.464604 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.464571 2566 generic.go:356] "Generic (PLEG): container finished" podID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerID="dd5e2300b01b612c7ae2e618a3909c2c9cfeda0209a4fc2c3ab766d3b801a31b" exitCode=0 Jul 05 07:52:40.464604 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.464597 2566 generic.go:356] "Generic (PLEG): container finished" podID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerID="1894e9b966609e7a3a2b265678f7e1a5acb1f8f9d5151a6952a08e80aacf5129" exitCode=0 Jul 05 07:52:40.465090 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.464656 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.465090 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.464662 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e80e3e02-11c4-4f94-a072-bfe95b79fd1b","Type":"ContainerDied","Data":"dd5e2300b01b612c7ae2e618a3909c2c9cfeda0209a4fc2c3ab766d3b801a31b"} Jul 05 07:52:40.465090 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.464760 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e80e3e02-11c4-4f94-a072-bfe95b79fd1b","Type":"ContainerDied","Data":"1894e9b966609e7a3a2b265678f7e1a5acb1f8f9d5151a6952a08e80aacf5129"} Jul 05 07:52:40.465090 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.464806 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e80e3e02-11c4-4f94-a072-bfe95b79fd1b","Type":"ContainerDied","Data":"70fa06ff1f50f554b343f0d01a92503c4715b999c7ce511d235fe04f8795a761"} Jul 05 07:52:40.465090 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.464824 2566 scope.go:117] "RemoveContainer" containerID="ac0fd54691e7ac01c756b3353e1bce60dee814674c8bfe376e3d0d5ebb1249e6" Jul 05 07:52:40.472177 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.472156 2566 scope.go:117] "RemoveContainer" containerID="dd5e2300b01b612c7ae2e618a3909c2c9cfeda0209a4fc2c3ab766d3b801a31b" Jul 05 07:52:40.478722 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.478707 2566 scope.go:117] "RemoveContainer" containerID="8d592f7d6b1abc579e0aafcf3bcfb463218c3e2da27061af98cf058c60d29008" Jul 05 07:52:40.485233 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.485195 2566 scope.go:117] "RemoveContainer" containerID="1894e9b966609e7a3a2b265678f7e1a5acb1f8f9d5151a6952a08e80aacf5129" Jul 05 07:52:40.487446 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.487419 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 05 07:52:40.493059 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.493041 2566 scope.go:117] "RemoveContainer" containerID="b5c2960460b435be3fe31efe3b77f6222e1767eda338bdd040c79f3eb04ab10a" Jul 05 07:52:40.493630 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.493608 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 05 07:52:40.499229 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.499213 2566 scope.go:117] "RemoveContainer" containerID="e3dcba591eabdcd4a62b73699a1432606faf238810b7b03ecdf2f7a167d569ad" Jul 05 07:52:40.505734 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.505718 2566 scope.go:117] "RemoveContainer" containerID="237c0b84940a2f90c5c4c4ef07b16235d1cfac68d29d8c4754dd918b3c5531ac" Jul 05 07:52:40.512299 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.512280 2566 scope.go:117] "RemoveContainer" containerID="ac0fd54691e7ac01c756b3353e1bce60dee814674c8bfe376e3d0d5ebb1249e6" Jul 05 07:52:40.512548 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:52:40.512530 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac0fd54691e7ac01c756b3353e1bce60dee814674c8bfe376e3d0d5ebb1249e6\": container with ID starting with ac0fd54691e7ac01c756b3353e1bce60dee814674c8bfe376e3d0d5ebb1249e6 not found: ID does not exist" containerID="ac0fd54691e7ac01c756b3353e1bce60dee814674c8bfe376e3d0d5ebb1249e6" Jul 05 07:52:40.512591 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.512555 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac0fd54691e7ac01c756b3353e1bce60dee814674c8bfe376e3d0d5ebb1249e6"} err="failed to get container status \"ac0fd54691e7ac01c756b3353e1bce60dee814674c8bfe376e3d0d5ebb1249e6\": rpc error: code = NotFound desc = could not find container \"ac0fd54691e7ac01c756b3353e1bce60dee814674c8bfe376e3d0d5ebb1249e6\": container with ID starting with ac0fd54691e7ac01c756b3353e1bce60dee814674c8bfe376e3d0d5ebb1249e6 not found: ID does not exist" Jul 05 07:52:40.512591 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.512572 2566 scope.go:117] "RemoveContainer" containerID="dd5e2300b01b612c7ae2e618a3909c2c9cfeda0209a4fc2c3ab766d3b801a31b" Jul 05 07:52:40.512802 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:52:40.512787 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd5e2300b01b612c7ae2e618a3909c2c9cfeda0209a4fc2c3ab766d3b801a31b\": container with ID starting with dd5e2300b01b612c7ae2e618a3909c2c9cfeda0209a4fc2c3ab766d3b801a31b not found: ID does not exist" containerID="dd5e2300b01b612c7ae2e618a3909c2c9cfeda0209a4fc2c3ab766d3b801a31b" Jul 05 07:52:40.512852 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.512806 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd5e2300b01b612c7ae2e618a3909c2c9cfeda0209a4fc2c3ab766d3b801a31b"} err="failed to get container status \"dd5e2300b01b612c7ae2e618a3909c2c9cfeda0209a4fc2c3ab766d3b801a31b\": rpc error: code = NotFound desc = could not find container \"dd5e2300b01b612c7ae2e618a3909c2c9cfeda0209a4fc2c3ab766d3b801a31b\": container with ID starting with dd5e2300b01b612c7ae2e618a3909c2c9cfeda0209a4fc2c3ab766d3b801a31b not found: ID does not exist" Jul 05 07:52:40.512852 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.512818 2566 scope.go:117] "RemoveContainer" containerID="8d592f7d6b1abc579e0aafcf3bcfb463218c3e2da27061af98cf058c60d29008" Jul 05 07:52:40.513011 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:52:40.512997 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d592f7d6b1abc579e0aafcf3bcfb463218c3e2da27061af98cf058c60d29008\": container with ID starting with 8d592f7d6b1abc579e0aafcf3bcfb463218c3e2da27061af98cf058c60d29008 not found: ID does not exist" containerID="8d592f7d6b1abc579e0aafcf3bcfb463218c3e2da27061af98cf058c60d29008" Jul 05 07:52:40.513050 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.513014 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d592f7d6b1abc579e0aafcf3bcfb463218c3e2da27061af98cf058c60d29008"} err="failed to get container status \"8d592f7d6b1abc579e0aafcf3bcfb463218c3e2da27061af98cf058c60d29008\": rpc error: code = NotFound desc = could not find container \"8d592f7d6b1abc579e0aafcf3bcfb463218c3e2da27061af98cf058c60d29008\": container with ID starting with 8d592f7d6b1abc579e0aafcf3bcfb463218c3e2da27061af98cf058c60d29008 not found: ID does not exist" Jul 05 07:52:40.513050 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.513025 2566 scope.go:117] "RemoveContainer" containerID="1894e9b966609e7a3a2b265678f7e1a5acb1f8f9d5151a6952a08e80aacf5129" Jul 05 07:52:40.513235 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:52:40.513217 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1894e9b966609e7a3a2b265678f7e1a5acb1f8f9d5151a6952a08e80aacf5129\": container with ID starting with 1894e9b966609e7a3a2b265678f7e1a5acb1f8f9d5151a6952a08e80aacf5129 not found: ID does not exist" containerID="1894e9b966609e7a3a2b265678f7e1a5acb1f8f9d5151a6952a08e80aacf5129" Jul 05 07:52:40.513276 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.513240 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1894e9b966609e7a3a2b265678f7e1a5acb1f8f9d5151a6952a08e80aacf5129"} err="failed to get container status \"1894e9b966609e7a3a2b265678f7e1a5acb1f8f9d5151a6952a08e80aacf5129\": rpc error: code = NotFound desc = could not find container \"1894e9b966609e7a3a2b265678f7e1a5acb1f8f9d5151a6952a08e80aacf5129\": container with ID starting with 1894e9b966609e7a3a2b265678f7e1a5acb1f8f9d5151a6952a08e80aacf5129 not found: ID does not exist" Jul 05 07:52:40.513276 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.513256 2566 scope.go:117] "RemoveContainer" containerID="b5c2960460b435be3fe31efe3b77f6222e1767eda338bdd040c79f3eb04ab10a" Jul 05 07:52:40.513495 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:52:40.513479 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5c2960460b435be3fe31efe3b77f6222e1767eda338bdd040c79f3eb04ab10a\": container with ID starting with b5c2960460b435be3fe31efe3b77f6222e1767eda338bdd040c79f3eb04ab10a not found: ID does not exist" containerID="b5c2960460b435be3fe31efe3b77f6222e1767eda338bdd040c79f3eb04ab10a" Jul 05 07:52:40.513543 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.513498 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5c2960460b435be3fe31efe3b77f6222e1767eda338bdd040c79f3eb04ab10a"} err="failed to get container status \"b5c2960460b435be3fe31efe3b77f6222e1767eda338bdd040c79f3eb04ab10a\": rpc error: code = NotFound desc = could not find container \"b5c2960460b435be3fe31efe3b77f6222e1767eda338bdd040c79f3eb04ab10a\": container with ID starting with b5c2960460b435be3fe31efe3b77f6222e1767eda338bdd040c79f3eb04ab10a not found: ID does not exist" Jul 05 07:52:40.513543 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.513510 2566 scope.go:117] "RemoveContainer" containerID="e3dcba591eabdcd4a62b73699a1432606faf238810b7b03ecdf2f7a167d569ad" Jul 05 07:52:40.513760 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:52:40.513742 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3dcba591eabdcd4a62b73699a1432606faf238810b7b03ecdf2f7a167d569ad\": container with ID starting with e3dcba591eabdcd4a62b73699a1432606faf238810b7b03ecdf2f7a167d569ad not found: ID does not exist" containerID="e3dcba591eabdcd4a62b73699a1432606faf238810b7b03ecdf2f7a167d569ad" Jul 05 07:52:40.513810 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.513764 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3dcba591eabdcd4a62b73699a1432606faf238810b7b03ecdf2f7a167d569ad"} err="failed to get container status \"e3dcba591eabdcd4a62b73699a1432606faf238810b7b03ecdf2f7a167d569ad\": rpc error: code = NotFound desc = could not find container \"e3dcba591eabdcd4a62b73699a1432606faf238810b7b03ecdf2f7a167d569ad\": container with ID starting with e3dcba591eabdcd4a62b73699a1432606faf238810b7b03ecdf2f7a167d569ad not found: ID does not exist" Jul 05 07:52:40.513810 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.513780 2566 scope.go:117] "RemoveContainer" containerID="237c0b84940a2f90c5c4c4ef07b16235d1cfac68d29d8c4754dd918b3c5531ac" Jul 05 07:52:40.513979 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:52:40.513964 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"237c0b84940a2f90c5c4c4ef07b16235d1cfac68d29d8c4754dd918b3c5531ac\": container with ID starting with 237c0b84940a2f90c5c4c4ef07b16235d1cfac68d29d8c4754dd918b3c5531ac not found: ID does not exist" containerID="237c0b84940a2f90c5c4c4ef07b16235d1cfac68d29d8c4754dd918b3c5531ac" Jul 05 07:52:40.514013 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.513983 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"237c0b84940a2f90c5c4c4ef07b16235d1cfac68d29d8c4754dd918b3c5531ac"} err="failed to get container status \"237c0b84940a2f90c5c4c4ef07b16235d1cfac68d29d8c4754dd918b3c5531ac\": rpc error: code = NotFound desc = could not find container \"237c0b84940a2f90c5c4c4ef07b16235d1cfac68d29d8c4754dd918b3c5531ac\": container with ID starting with 237c0b84940a2f90c5c4c4ef07b16235d1cfac68d29d8c4754dd918b3c5531ac not found: ID does not exist" Jul 05 07:52:40.514013 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.513995 2566 scope.go:117] "RemoveContainer" containerID="ac0fd54691e7ac01c756b3353e1bce60dee814674c8bfe376e3d0d5ebb1249e6" Jul 05 07:52:40.514206 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.514189 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac0fd54691e7ac01c756b3353e1bce60dee814674c8bfe376e3d0d5ebb1249e6"} err="failed to get container status \"ac0fd54691e7ac01c756b3353e1bce60dee814674c8bfe376e3d0d5ebb1249e6\": rpc error: code = NotFound desc = could not find container \"ac0fd54691e7ac01c756b3353e1bce60dee814674c8bfe376e3d0d5ebb1249e6\": container with ID starting with ac0fd54691e7ac01c756b3353e1bce60dee814674c8bfe376e3d0d5ebb1249e6 not found: ID does not exist" Jul 05 07:52:40.514257 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.514206 2566 scope.go:117] "RemoveContainer" containerID="dd5e2300b01b612c7ae2e618a3909c2c9cfeda0209a4fc2c3ab766d3b801a31b" Jul 05 07:52:40.514421 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.514403 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd5e2300b01b612c7ae2e618a3909c2c9cfeda0209a4fc2c3ab766d3b801a31b"} err="failed to get container status \"dd5e2300b01b612c7ae2e618a3909c2c9cfeda0209a4fc2c3ab766d3b801a31b\": rpc error: code = NotFound desc = could not find container \"dd5e2300b01b612c7ae2e618a3909c2c9cfeda0209a4fc2c3ab766d3b801a31b\": container with ID starting with dd5e2300b01b612c7ae2e618a3909c2c9cfeda0209a4fc2c3ab766d3b801a31b not found: ID does not exist" Jul 05 07:52:40.514469 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.514421 2566 scope.go:117] "RemoveContainer" containerID="8d592f7d6b1abc579e0aafcf3bcfb463218c3e2da27061af98cf058c60d29008" Jul 05 07:52:40.514621 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.514605 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d592f7d6b1abc579e0aafcf3bcfb463218c3e2da27061af98cf058c60d29008"} err="failed to get container status \"8d592f7d6b1abc579e0aafcf3bcfb463218c3e2da27061af98cf058c60d29008\": rpc error: code = NotFound desc = could not find container \"8d592f7d6b1abc579e0aafcf3bcfb463218c3e2da27061af98cf058c60d29008\": container with ID starting with 8d592f7d6b1abc579e0aafcf3bcfb463218c3e2da27061af98cf058c60d29008 not found: ID does not exist" Jul 05 07:52:40.514661 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.514622 2566 scope.go:117] "RemoveContainer" containerID="1894e9b966609e7a3a2b265678f7e1a5acb1f8f9d5151a6952a08e80aacf5129" Jul 05 07:52:40.514818 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.514800 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1894e9b966609e7a3a2b265678f7e1a5acb1f8f9d5151a6952a08e80aacf5129"} err="failed to get container status \"1894e9b966609e7a3a2b265678f7e1a5acb1f8f9d5151a6952a08e80aacf5129\": rpc error: code = NotFound desc = could not find container \"1894e9b966609e7a3a2b265678f7e1a5acb1f8f9d5151a6952a08e80aacf5129\": container with ID starting with 1894e9b966609e7a3a2b265678f7e1a5acb1f8f9d5151a6952a08e80aacf5129 not found: ID does not exist" Jul 05 07:52:40.514866 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.514818 2566 scope.go:117] "RemoveContainer" containerID="b5c2960460b435be3fe31efe3b77f6222e1767eda338bdd040c79f3eb04ab10a" Jul 05 07:52:40.515021 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.515005 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5c2960460b435be3fe31efe3b77f6222e1767eda338bdd040c79f3eb04ab10a"} err="failed to get container status \"b5c2960460b435be3fe31efe3b77f6222e1767eda338bdd040c79f3eb04ab10a\": rpc error: code = NotFound desc = could not find container \"b5c2960460b435be3fe31efe3b77f6222e1767eda338bdd040c79f3eb04ab10a\": container with ID starting with b5c2960460b435be3fe31efe3b77f6222e1767eda338bdd040c79f3eb04ab10a not found: ID does not exist" Jul 05 07:52:40.515069 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.515022 2566 scope.go:117] "RemoveContainer" containerID="e3dcba591eabdcd4a62b73699a1432606faf238810b7b03ecdf2f7a167d569ad" Jul 05 07:52:40.515342 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.515286 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3dcba591eabdcd4a62b73699a1432606faf238810b7b03ecdf2f7a167d569ad"} err="failed to get container status \"e3dcba591eabdcd4a62b73699a1432606faf238810b7b03ecdf2f7a167d569ad\": rpc error: code = NotFound desc = could not find container \"e3dcba591eabdcd4a62b73699a1432606faf238810b7b03ecdf2f7a167d569ad\": container with ID starting with e3dcba591eabdcd4a62b73699a1432606faf238810b7b03ecdf2f7a167d569ad not found: ID does not exist" Jul 05 07:52:40.515342 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.515312 2566 scope.go:117] "RemoveContainer" containerID="237c0b84940a2f90c5c4c4ef07b16235d1cfac68d29d8c4754dd918b3c5531ac" Jul 05 07:52:40.515864 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.515823 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"237c0b84940a2f90c5c4c4ef07b16235d1cfac68d29d8c4754dd918b3c5531ac"} err="failed to get container status \"237c0b84940a2f90c5c4c4ef07b16235d1cfac68d29d8c4754dd918b3c5531ac\": rpc error: code = NotFound desc = could not find container \"237c0b84940a2f90c5c4c4ef07b16235d1cfac68d29d8c4754dd918b3c5531ac\": container with ID starting with 237c0b84940a2f90c5c4c4ef07b16235d1cfac68d29d8c4754dd918b3c5531ac not found: ID does not exist" Jul 05 07:52:40.517359 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.517340 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 05 07:52:40.517659 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.517644 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerName="kube-rbac-proxy" Jul 05 07:52:40.517733 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.517661 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerName="kube-rbac-proxy" Jul 05 07:52:40.517733 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.517673 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerName="prom-label-proxy" Jul 05 07:52:40.517733 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.517681 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerName="prom-label-proxy" Jul 05 07:52:40.517733 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.517694 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerName="init-config-reloader" Jul 05 07:52:40.517733 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.517703 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerName="init-config-reloader" Jul 05 07:52:40.517733 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.517713 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerName="kube-rbac-proxy-metric" Jul 05 07:52:40.517733 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.517721 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerName="kube-rbac-proxy-metric" Jul 05 07:52:40.517733 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.517734 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerName="kube-rbac-proxy-web" Jul 05 07:52:40.518102 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.517743 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerName="kube-rbac-proxy-web" Jul 05 07:52:40.518102 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.517759 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerName="config-reloader" Jul 05 07:52:40.518102 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.517768 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerName="config-reloader" Jul 05 07:52:40.518102 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.517777 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd99dc7c-1a82-49c1-9834-679e5f40d4f2" containerName="console" Jul 05 07:52:40.518102 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.517786 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd99dc7c-1a82-49c1-9834-679e5f40d4f2" containerName="console" Jul 05 07:52:40.518102 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.517798 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerName="alertmanager" Jul 05 07:52:40.518102 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.517807 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerName="alertmanager" Jul 05 07:52:40.518102 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.517878 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerName="kube-rbac-proxy" Jul 05 07:52:40.518102 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.517892 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerName="config-reloader" Jul 05 07:52:40.518102 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.517902 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerName="kube-rbac-proxy-metric" Jul 05 07:52:40.518102 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.517913 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerName="alertmanager" Jul 05 07:52:40.518102 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.517922 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd99dc7c-1a82-49c1-9834-679e5f40d4f2" containerName="console" Jul 05 07:52:40.518102 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.517930 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerName="kube-rbac-proxy-web" Jul 05 07:52:40.518102 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.517938 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" containerName="prom-label-proxy" Jul 05 07:52:40.521453 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.521437 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.524048 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.524031 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 05 07:52:40.524123 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.524036 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 05 07:52:40.524256 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.524238 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 05 07:52:40.524401 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.524384 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 05 07:52:40.524484 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.524453 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 05 07:52:40.524547 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.524478 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 05 07:52:40.524598 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.524556 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 05 07:52:40.524598 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.524581 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6flsm\"" Jul 05 07:52:40.524773 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.524758 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 05 07:52:40.529587 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.529568 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 05 07:52:40.536715 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.536693 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 05 07:52:40.653884 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.653856 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba2919b5-3c50-494c-a998-9396664a65c0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.653884 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.653884 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba2919b5-3c50-494c-a998-9396664a65c0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.654091 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.653903 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba2919b5-3c50-494c-a998-9396664a65c0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.654091 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.653920 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ba2919b5-3c50-494c-a998-9396664a65c0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.654091 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.653934 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh7qv\" (UniqueName: \"kubernetes.io/projected/ba2919b5-3c50-494c-a998-9396664a65c0-kube-api-access-vh7qv\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.654091 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.653997 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ba2919b5-3c50-494c-a998-9396664a65c0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.654091 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.654048 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba2919b5-3c50-494c-a998-9396664a65c0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.654091 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.654089 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ba2919b5-3c50-494c-a998-9396664a65c0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.654343 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.654113 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba2919b5-3c50-494c-a998-9396664a65c0-config-out\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.654343 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.654156 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba2919b5-3c50-494c-a998-9396664a65c0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.654343 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.654189 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ba2919b5-3c50-494c-a998-9396664a65c0-config-volume\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.654343 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.654204 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ba2919b5-3c50-494c-a998-9396664a65c0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.654343 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.654222 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba2919b5-3c50-494c-a998-9396664a65c0-web-config\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.754905 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.754824 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ba2919b5-3c50-494c-a998-9396664a65c0-config-volume\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.754905 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.754866 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ba2919b5-3c50-494c-a998-9396664a65c0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.754905 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.754884 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba2919b5-3c50-494c-a998-9396664a65c0-web-config\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.755125 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.754922 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba2919b5-3c50-494c-a998-9396664a65c0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.755125 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.754939 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba2919b5-3c50-494c-a998-9396664a65c0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.755125 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.754953 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba2919b5-3c50-494c-a998-9396664a65c0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.755125 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.754972 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ba2919b5-3c50-494c-a998-9396664a65c0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.755125 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.754987 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh7qv\" (UniqueName: \"kubernetes.io/projected/ba2919b5-3c50-494c-a998-9396664a65c0-kube-api-access-vh7qv\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.755125 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.755007 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ba2919b5-3c50-494c-a998-9396664a65c0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.755125 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.755034 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba2919b5-3c50-494c-a998-9396664a65c0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.755125 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.755069 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ba2919b5-3c50-494c-a998-9396664a65c0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.755125 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.755097 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba2919b5-3c50-494c-a998-9396664a65c0-config-out\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.755608 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.755586 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ba2919b5-3c50-494c-a998-9396664a65c0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.756259 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.755896 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba2919b5-3c50-494c-a998-9396664a65c0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.756259 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.755949 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba2919b5-3c50-494c-a998-9396664a65c0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.756445 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.756421 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba2919b5-3c50-494c-a998-9396664a65c0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.758326 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.758302 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba2919b5-3c50-494c-a998-9396664a65c0-config-out\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.758447 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.758426 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ba2919b5-3c50-494c-a998-9396664a65c0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.758561 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.758524 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba2919b5-3c50-494c-a998-9396664a65c0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.758671 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.758627 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba2919b5-3c50-494c-a998-9396664a65c0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.758759 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.758741 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba2919b5-3c50-494c-a998-9396664a65c0-web-config\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.758950 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.758910 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ba2919b5-3c50-494c-a998-9396664a65c0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.759042 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.758917 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba2919b5-3c50-494c-a998-9396664a65c0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.759202 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.759181 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ba2919b5-3c50-494c-a998-9396664a65c0-config-volume\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.759991 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.759972 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ba2919b5-3c50-494c-a998-9396664a65c0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.764678 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.764654 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh7qv\" (UniqueName: \"kubernetes.io/projected/ba2919b5-3c50-494c-a998-9396664a65c0-kube-api-access-vh7qv\") pod \"alertmanager-main-0\" (UID: \"ba2919b5-3c50-494c-a998-9396664a65c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.830633 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.830612 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 05 07:52:40.960396 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:40.960373 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 05 07:52:40.962119 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:52:40.962096 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba2919b5_3c50_494c_a998_9396664a65c0.slice/crio-8eb15ad3cef880a35d9bc4bb5833792bb25f597e033604fe2d45e9bd816c2f6f WatchSource:0}: Error finding container 8eb15ad3cef880a35d9bc4bb5833792bb25f597e033604fe2d45e9bd816c2f6f: Status 404 returned error can't find the container with id 8eb15ad3cef880a35d9bc4bb5833792bb25f597e033604fe2d45e9bd816c2f6f Jul 05 07:52:41.124728 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:41.124700 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e80e3e02-11c4-4f94-a072-bfe95b79fd1b" path="/var/lib/kubelet/pods/e80e3e02-11c4-4f94-a072-bfe95b79fd1b/volumes" Jul 05 07:52:41.471963 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:41.471875 2566 generic.go:356] "Generic (PLEG): container finished" podID="ba2919b5-3c50-494c-a998-9396664a65c0" containerID="625d2bbdb220902ddcb03b7fe053de4878cd23835be67e3dcacdf468afcc2550" exitCode=0 Jul 05 07:52:41.471963 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:41.471949 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba2919b5-3c50-494c-a998-9396664a65c0","Type":"ContainerDied","Data":"625d2bbdb220902ddcb03b7fe053de4878cd23835be67e3dcacdf468afcc2550"} Jul 05 07:52:41.472372 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:41.472018 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba2919b5-3c50-494c-a998-9396664a65c0","Type":"ContainerStarted","Data":"8eb15ad3cef880a35d9bc4bb5833792bb25f597e033604fe2d45e9bd816c2f6f"} Jul 05 07:52:42.480032 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:42.479999 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba2919b5-3c50-494c-a998-9396664a65c0","Type":"ContainerStarted","Data":"d19420632e26fed387b28f30c3c7ca86a818b8c92cd897f77e053f051a635523"} Jul 05 07:52:42.480526 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:42.480144 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba2919b5-3c50-494c-a998-9396664a65c0","Type":"ContainerStarted","Data":"15a27065c95365e6121434c0e5399133c7ea7dd964a74a3dd6e3435c5898441b"} Jul 05 07:52:42.480526 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:42.480210 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba2919b5-3c50-494c-a998-9396664a65c0","Type":"ContainerStarted","Data":"dada251417a04ea720456eaadea6337bb227166f5b3404ef609338aa6d538c9b"} Jul 05 07:52:42.480526 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:42.480254 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba2919b5-3c50-494c-a998-9396664a65c0","Type":"ContainerStarted","Data":"829c40e17f7ee14804f650fdfc9b770744041383e5d8868257249eb1f9b839e5"} Jul 05 07:52:42.480526 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:42.480304 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba2919b5-3c50-494c-a998-9396664a65c0","Type":"ContainerStarted","Data":"def042118fe32dfc3ca98dc7a212e5b999b15e00e941f63fdfbf6c4f5553f616"} Jul 05 07:52:42.480526 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:42.480348 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba2919b5-3c50-494c-a998-9396664a65c0","Type":"ContainerStarted","Data":"edf069afb6950ed1b74fb4f22f6ce1f942e8278719c59e0df2f059a0ba4ef53d"} Jul 05 07:52:42.513628 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:42.513587 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.498483235 podStartE2EDuration="2.513571617s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.088382ms" isStatefulPod=false podCreationTimestamp="2026-07-05 07:52:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:52:42.512098394 +0000 UTC m=+377.931831477" watchObservedRunningTime="2026-07-05 07:52:42.513571617 +0000 UTC m=+377.933304671" Jul 05 07:52:42.784543 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:42.784515 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 05 07:52:42.784856 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:42.784821 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerName="kube-rbac-proxy" containerID="cri-o://c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963" gracePeriod=600 Jul 05 07:52:42.784960 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:42.784856 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerName="kube-rbac-proxy-thanos" containerID="cri-o://e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c" gracePeriod=600 Jul 05 07:52:42.784960 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:42.784844 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerName="thanos-sidecar" containerID="cri-o://d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8" gracePeriod=600 Jul 05 07:52:42.784960 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:42.784885 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerName="config-reloader" containerID="cri-o://460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9" gracePeriod=600 Jul 05 07:52:42.784960 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:42.784811 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerName="prometheus" containerID="cri-o://2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610" gracePeriod=600 Jul 05 07:52:42.785121 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:42.784864 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerName="kube-rbac-proxy-web" containerID="cri-o://3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757" gracePeriod=600 Jul 05 07:52:43.030266 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.030244 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.175186 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.175158 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/968b0b3a-3acb-4cde-8343-55e85bebbe2c-prometheus-k8s-db\") pod \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " Jul 05 07:52:43.175365 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.175202 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/968b0b3a-3acb-4cde-8343-55e85bebbe2c-config-out\") pod \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " Jul 05 07:52:43.175365 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.175230 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-thanos-prometheus-http-client-file\") pod \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " Jul 05 07:52:43.175365 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.175256 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-prometheus-trusted-ca-bundle\") pod \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " Jul 05 07:52:43.175365 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.175279 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-prometheus-k8s-rulefiles-1\") pod \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " Jul 05 07:52:43.175365 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.175306 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-configmap-kubelet-serving-ca-bundle\") pod \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " Jul 05 07:52:43.175365 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.175331 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-prometheus-k8s-rulefiles-2\") pod \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " Jul 05 07:52:43.175683 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.175587 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-config\") pod \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " Jul 05 07:52:43.175683 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.175632 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-configmap-serving-certs-ca-bundle\") pod \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " Jul 05 07:52:43.175786 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.175682 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-web-config\") pod \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " Jul 05 07:52:43.175786 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.175704 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "968b0b3a-3acb-4cde-8343-55e85bebbe2c" (UID: "968b0b3a-3acb-4cde-8343-55e85bebbe2c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 07:52:43.175786 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.175717 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "968b0b3a-3acb-4cde-8343-55e85bebbe2c" (UID: "968b0b3a-3acb-4cde-8343-55e85bebbe2c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 07:52:43.175786 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.175725 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-kube-rbac-proxy\") pod \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " Jul 05 07:52:43.175786 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.175763 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "968b0b3a-3acb-4cde-8343-55e85bebbe2c" (UID: "968b0b3a-3acb-4cde-8343-55e85bebbe2c"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 07:52:43.175786 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.175783 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-grpc-tls\") pod \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " Jul 05 07:52:43.176170 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.175824 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-metrics-client-certs\") pod \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " Jul 05 07:52:43.176170 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.175918 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxjl6\" (UniqueName: \"kubernetes.io/projected/968b0b3a-3acb-4cde-8343-55e85bebbe2c-kube-api-access-pxjl6\") pod \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " Jul 05 07:52:43.176170 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.175953 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-prometheus-k8s-rulefiles-0\") pod \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " Jul 05 07:52:43.176170 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.175980 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-prometheus-k8s-tls\") pod \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " Jul 05 07:52:43.176170 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.175996 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "968b0b3a-3acb-4cde-8343-55e85bebbe2c" (UID: "968b0b3a-3acb-4cde-8343-55e85bebbe2c"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 07:52:43.176170 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.176014 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " Jul 05 07:52:43.176170 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.176069 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "968b0b3a-3acb-4cde-8343-55e85bebbe2c" (UID: "968b0b3a-3acb-4cde-8343-55e85bebbe2c"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 07:52:43.176662 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.176633 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/968b0b3a-3acb-4cde-8343-55e85bebbe2c-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "968b0b3a-3acb-4cde-8343-55e85bebbe2c" (UID: "968b0b3a-3acb-4cde-8343-55e85bebbe2c"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 07:52:43.178435 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.178407 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-config" (OuterVolumeSpecName: "config") pod "968b0b3a-3acb-4cde-8343-55e85bebbe2c" (UID: "968b0b3a-3acb-4cde-8343-55e85bebbe2c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 07:52:43.178435 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.178418 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "968b0b3a-3acb-4cde-8343-55e85bebbe2c" (UID: "968b0b3a-3acb-4cde-8343-55e85bebbe2c"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 07:52:43.178648 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.178446 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "968b0b3a-3acb-4cde-8343-55e85bebbe2c" (UID: "968b0b3a-3acb-4cde-8343-55e85bebbe2c"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 07:52:43.178718 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.178698 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/968b0b3a-3acb-4cde-8343-55e85bebbe2c-config-out" (OuterVolumeSpecName: "config-out") pod "968b0b3a-3acb-4cde-8343-55e85bebbe2c" (UID: "968b0b3a-3acb-4cde-8343-55e85bebbe2c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 07:52:43.178779 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.178744 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-configmap-metrics-client-ca\") pod \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " Jul 05 07:52:43.178779 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.178775 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/968b0b3a-3acb-4cde-8343-55e85bebbe2c-tls-assets\") pod \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " Jul 05 07:52:43.178884 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.178814 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\" (UID: \"968b0b3a-3acb-4cde-8343-55e85bebbe2c\") " Jul 05 07:52:43.179075 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.179054 2566 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:43.179181 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.179081 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:43.179181 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.179097 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:43.179181 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.179110 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:43.179181 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.179123 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:43.179181 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.179159 2566 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-config\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:43.179181 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.179162 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "968b0b3a-3acb-4cde-8343-55e85bebbe2c" (UID: "968b0b3a-3acb-4cde-8343-55e85bebbe2c"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 07:52:43.179181 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.179173 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:43.179533 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.179188 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:43.179533 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.179202 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/968b0b3a-3acb-4cde-8343-55e85bebbe2c-prometheus-k8s-db\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:43.179533 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.179218 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/968b0b3a-3acb-4cde-8343-55e85bebbe2c-config-out\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:43.179533 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.179434 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/968b0b3a-3acb-4cde-8343-55e85bebbe2c-kube-api-access-pxjl6" (OuterVolumeSpecName: "kube-api-access-pxjl6") pod "968b0b3a-3acb-4cde-8343-55e85bebbe2c" (UID: "968b0b3a-3acb-4cde-8343-55e85bebbe2c"). InnerVolumeSpecName "kube-api-access-pxjl6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 07:52:43.179812 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.179791 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "968b0b3a-3acb-4cde-8343-55e85bebbe2c" (UID: "968b0b3a-3acb-4cde-8343-55e85bebbe2c"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 07:52:43.180054 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.180019 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "968b0b3a-3acb-4cde-8343-55e85bebbe2c" (UID: "968b0b3a-3acb-4cde-8343-55e85bebbe2c"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 07:52:43.180583 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.180557 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "968b0b3a-3acb-4cde-8343-55e85bebbe2c" (UID: "968b0b3a-3acb-4cde-8343-55e85bebbe2c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 07:52:43.180666 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.180600 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "968b0b3a-3acb-4cde-8343-55e85bebbe2c" (UID: "968b0b3a-3acb-4cde-8343-55e85bebbe2c"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 07:52:43.180801 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.180776 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "968b0b3a-3acb-4cde-8343-55e85bebbe2c" (UID: "968b0b3a-3acb-4cde-8343-55e85bebbe2c"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 07:52:43.181250 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.181223 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "968b0b3a-3acb-4cde-8343-55e85bebbe2c" (UID: "968b0b3a-3acb-4cde-8343-55e85bebbe2c"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 07:52:43.181616 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.181596 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/968b0b3a-3acb-4cde-8343-55e85bebbe2c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "968b0b3a-3acb-4cde-8343-55e85bebbe2c" (UID: "968b0b3a-3acb-4cde-8343-55e85bebbe2c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 07:52:43.188457 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.188438 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-web-config" (OuterVolumeSpecName: "web-config") pod "968b0b3a-3acb-4cde-8343-55e85bebbe2c" (UID: "968b0b3a-3acb-4cde-8343-55e85bebbe2c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 07:52:43.280043 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.280020 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:43.280043 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.280040 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:43.280178 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.280050 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/968b0b3a-3acb-4cde-8343-55e85bebbe2c-configmap-metrics-client-ca\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:43.280178 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.280058 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/968b0b3a-3acb-4cde-8343-55e85bebbe2c-tls-assets\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:43.280178 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.280067 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:43.280178 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.280075 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-web-config\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:43.280178 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.280083 2566 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-kube-rbac-proxy\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:43.280178 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.280091 2566 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-grpc-tls\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:43.280178 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.280098 2566 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/968b0b3a-3acb-4cde-8343-55e85bebbe2c-secret-metrics-client-certs\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:43.280178 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.280106 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxjl6\" (UniqueName: \"kubernetes.io/projected/968b0b3a-3acb-4cde-8343-55e85bebbe2c-kube-api-access-pxjl6\") on node \"ip-10-0-142-31.ec2.internal\" DevicePath \"\"" Jul 05 07:52:43.490565 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.490494 2566 generic.go:356] "Generic (PLEG): container finished" podID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerID="e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c" exitCode=0 Jul 05 07:52:43.490565 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.490518 2566 generic.go:356] "Generic (PLEG): container finished" podID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerID="c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963" exitCode=0 Jul 05 07:52:43.490565 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.490526 2566 generic.go:356] "Generic (PLEG): container finished" podID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerID="3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757" exitCode=0 Jul 05 07:52:43.490565 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.490533 2566 generic.go:356] "Generic (PLEG): container finished" podID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerID="d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8" exitCode=0 Jul 05 07:52:43.490565 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.490540 2566 generic.go:356] "Generic (PLEG): container finished" podID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerID="460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9" exitCode=0 Jul 05 07:52:43.490565 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.490547 2566 generic.go:356] "Generic (PLEG): container finished" podID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerID="2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610" exitCode=0 Jul 05 07:52:43.491208 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.490573 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.491208 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.490581 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"968b0b3a-3acb-4cde-8343-55e85bebbe2c","Type":"ContainerDied","Data":"e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c"} Jul 05 07:52:43.491208 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.490674 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"968b0b3a-3acb-4cde-8343-55e85bebbe2c","Type":"ContainerDied","Data":"c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963"} Jul 05 07:52:43.491208 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.490721 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"968b0b3a-3acb-4cde-8343-55e85bebbe2c","Type":"ContainerDied","Data":"3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757"} Jul 05 07:52:43.491208 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.490739 2566 scope.go:117] "RemoveContainer" containerID="e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c" Jul 05 07:52:43.491208 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.490765 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"968b0b3a-3acb-4cde-8343-55e85bebbe2c","Type":"ContainerDied","Data":"d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8"} Jul 05 07:52:43.491208 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.490806 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"968b0b3a-3acb-4cde-8343-55e85bebbe2c","Type":"ContainerDied","Data":"460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9"} Jul 05 07:52:43.491208 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.490848 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"968b0b3a-3acb-4cde-8343-55e85bebbe2c","Type":"ContainerDied","Data":"2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610"} Jul 05 07:52:43.491208 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.490887 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"968b0b3a-3acb-4cde-8343-55e85bebbe2c","Type":"ContainerDied","Data":"c9675a325621b5aa53ee0a08ac4325e171e970790a59203995bdcc9802ff42e6"} Jul 05 07:52:43.499657 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.499476 2566 scope.go:117] "RemoveContainer" containerID="c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963" Jul 05 07:52:43.507057 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.507036 2566 scope.go:117] "RemoveContainer" containerID="3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757" Jul 05 07:52:43.514237 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.514215 2566 scope.go:117] "RemoveContainer" containerID="d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8" Jul 05 07:52:43.516423 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.516405 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 05 07:52:43.522625 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.522610 2566 scope.go:117] "RemoveContainer" containerID="460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9" Jul 05 07:52:43.523731 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.523709 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 05 07:52:43.529068 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.529048 2566 scope.go:117] "RemoveContainer" containerID="2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610" Jul 05 07:52:43.535616 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.535600 2566 scope.go:117] "RemoveContainer" containerID="2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901" Jul 05 07:52:43.541972 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.541955 2566 scope.go:117] "RemoveContainer" containerID="e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c" Jul 05 07:52:43.542205 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:52:43.542188 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c\": container with ID starting with e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c not found: ID does not exist" containerID="e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c" Jul 05 07:52:43.542255 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.542212 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c"} err="failed to get container status \"e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c\": rpc error: code = NotFound desc = could not find container \"e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c\": container with ID starting with e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c not found: ID does not exist" Jul 05 07:52:43.542255 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.542238 2566 scope.go:117] "RemoveContainer" containerID="c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963" Jul 05 07:52:43.542459 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:52:43.542443 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963\": container with ID starting with c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963 not found: ID does not exist" containerID="c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963" Jul 05 07:52:43.542499 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.542462 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963"} err="failed to get container status \"c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963\": rpc error: code = NotFound desc = could not find container \"c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963\": container with ID starting with c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963 not found: ID does not exist" Jul 05 07:52:43.542499 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.542474 2566 scope.go:117] "RemoveContainer" containerID="3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757" Jul 05 07:52:43.542695 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:52:43.542680 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757\": container with ID starting with 3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757 not found: ID does not exist" containerID="3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757" Jul 05 07:52:43.542735 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.542698 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757"} err="failed to get container status \"3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757\": rpc error: code = NotFound desc = could not find container \"3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757\": container with ID starting with 3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757 not found: ID does not exist" Jul 05 07:52:43.542735 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.542711 2566 scope.go:117] "RemoveContainer" containerID="d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8" Jul 05 07:52:43.542915 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:52:43.542898 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8\": container with ID starting with d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8 not found: ID does not exist" containerID="d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8" Jul 05 07:52:43.542956 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.542919 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8"} err="failed to get container status \"d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8\": rpc error: code = NotFound desc = could not find container \"d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8\": container with ID starting with d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8 not found: ID does not exist" Jul 05 07:52:43.542956 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.542931 2566 scope.go:117] "RemoveContainer" containerID="460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9" Jul 05 07:52:43.543117 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:52:43.543100 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9\": container with ID starting with 460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9 not found: ID does not exist" containerID="460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9" Jul 05 07:52:43.543162 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.543120 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9"} err="failed to get container status \"460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9\": rpc error: code = NotFound desc = could not find container \"460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9\": container with ID starting with 460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9 not found: ID does not exist" Jul 05 07:52:43.543162 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.543149 2566 scope.go:117] "RemoveContainer" containerID="2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610" Jul 05 07:52:43.543333 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:52:43.543317 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610\": container with ID starting with 2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610 not found: ID does not exist" containerID="2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610" Jul 05 07:52:43.543371 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.543337 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610"} err="failed to get container status \"2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610\": rpc error: code = NotFound desc = could not find container \"2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610\": container with ID starting with 2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610 not found: ID does not exist" Jul 05 07:52:43.543371 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.543348 2566 scope.go:117] "RemoveContainer" containerID="2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901" Jul 05 07:52:43.543551 ip-10-0-142-31 kubenswrapper[2566]: E0705 07:52:43.543538 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901\": container with ID starting with 2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901 not found: ID does not exist" containerID="2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901" Jul 05 07:52:43.543598 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.543554 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901"} err="failed to get container status \"2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901\": rpc error: code = NotFound desc = could not find container \"2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901\": container with ID starting with 2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901 not found: ID does not exist" Jul 05 07:52:43.543598 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.543565 2566 scope.go:117] "RemoveContainer" containerID="e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c" Jul 05 07:52:43.543793 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.543775 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c"} err="failed to get container status \"e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c\": rpc error: code = NotFound desc = could not find container \"e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c\": container with ID starting with e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c not found: ID does not exist" Jul 05 07:52:43.543851 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.543795 2566 scope.go:117] "RemoveContainer" containerID="c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963" Jul 05 07:52:43.544043 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.544025 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963"} err="failed to get container status \"c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963\": rpc error: code = NotFound desc = could not find container \"c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963\": container with ID starting with c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963 not found: ID does not exist" Jul 05 07:52:43.544085 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.544045 2566 scope.go:117] "RemoveContainer" containerID="3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757" Jul 05 07:52:43.544284 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.544264 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757"} err="failed to get container status \"3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757\": rpc error: code = NotFound desc = could not find container \"3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757\": container with ID starting with 3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757 not found: ID does not exist" Jul 05 07:52:43.544284 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.544283 2566 scope.go:117] "RemoveContainer" containerID="d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8" Jul 05 07:52:43.544507 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.544489 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8"} err="failed to get container status \"d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8\": rpc error: code = NotFound desc = could not find container \"d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8\": container with ID starting with d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8 not found: ID does not exist" Jul 05 07:52:43.544548 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.544508 2566 scope.go:117] "RemoveContainer" containerID="460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9" Jul 05 07:52:43.544717 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.544699 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9"} err="failed to get container status \"460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9\": rpc error: code = NotFound desc = could not find container \"460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9\": container with ID starting with 460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9 not found: ID does not exist" Jul 05 07:52:43.544760 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.544717 2566 scope.go:117] "RemoveContainer" containerID="2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610" Jul 05 07:52:43.544926 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.544898 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610"} err="failed to get container status \"2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610\": rpc error: code = NotFound desc = could not find container \"2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610\": container with ID starting with 2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610 not found: ID does not exist" Jul 05 07:52:43.544975 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.544927 2566 scope.go:117] "RemoveContainer" containerID="2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901" Jul 05 07:52:43.545149 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.545109 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901"} err="failed to get container status \"2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901\": rpc error: code = NotFound desc = could not find container \"2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901\": container with ID starting with 2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901 not found: ID does not exist" Jul 05 07:52:43.545203 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.545152 2566 scope.go:117] "RemoveContainer" containerID="e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c" Jul 05 07:52:43.545414 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.545396 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c"} err="failed to get container status \"e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c\": rpc error: code = NotFound desc = could not find container \"e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c\": container with ID starting with e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c not found: ID does not exist" Jul 05 07:52:43.545468 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.545414 2566 scope.go:117] "RemoveContainer" containerID="c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963" Jul 05 07:52:43.545632 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.545615 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963"} err="failed to get container status \"c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963\": rpc error: code = NotFound desc = could not find container \"c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963\": container with ID starting with c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963 not found: ID does not exist" Jul 05 07:52:43.545674 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.545633 2566 scope.go:117] "RemoveContainer" containerID="3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757" Jul 05 07:52:43.545828 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.545814 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757"} err="failed to get container status \"3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757\": rpc error: code = NotFound desc = could not find container \"3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757\": container with ID starting with 3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757 not found: ID does not exist" Jul 05 07:52:43.545867 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.545829 2566 scope.go:117] "RemoveContainer" containerID="d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8" Jul 05 07:52:43.546040 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.546023 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8"} err="failed to get container status \"d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8\": rpc error: code = NotFound desc = could not find container \"d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8\": container with ID starting with d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8 not found: ID does not exist" Jul 05 07:52:43.546040 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.546039 2566 scope.go:117] "RemoveContainer" containerID="460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9" Jul 05 07:52:43.546304 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.546286 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9"} err="failed to get container status \"460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9\": rpc error: code = NotFound desc = could not find container \"460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9\": container with ID starting with 460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9 not found: ID does not exist" Jul 05 07:52:43.546351 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.546305 2566 scope.go:117] "RemoveContainer" containerID="2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610" Jul 05 07:52:43.546520 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.546501 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610"} err="failed to get container status \"2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610\": rpc error: code = NotFound desc = could not find container \"2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610\": container with ID starting with 2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610 not found: ID does not exist" Jul 05 07:52:43.546562 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.546521 2566 scope.go:117] "RemoveContainer" containerID="2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901" Jul 05 07:52:43.546731 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.546710 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901"} err="failed to get container status \"2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901\": rpc error: code = NotFound desc = could not find container \"2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901\": container with ID starting with 2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901 not found: ID does not exist" Jul 05 07:52:43.546814 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.546731 2566 scope.go:117] "RemoveContainer" containerID="e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c" Jul 05 07:52:43.546935 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.546917 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c"} err="failed to get container status \"e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c\": rpc error: code = NotFound desc = could not find container \"e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c\": container with ID starting with e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c not found: ID does not exist" Jul 05 07:52:43.546977 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.546937 2566 scope.go:117] "RemoveContainer" containerID="c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963" Jul 05 07:52:43.547117 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.547098 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963"} err="failed to get container status \"c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963\": rpc error: code = NotFound desc = could not find container \"c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963\": container with ID starting with c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963 not found: ID does not exist" Jul 05 07:52:43.547196 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.547118 2566 scope.go:117] "RemoveContainer" containerID="3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757" Jul 05 07:52:43.547366 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.547347 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757"} err="failed to get container status \"3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757\": rpc error: code = NotFound desc = could not find container \"3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757\": container with ID starting with 3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757 not found: ID does not exist" Jul 05 07:52:43.547416 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.547367 2566 scope.go:117] "RemoveContainer" containerID="d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8" Jul 05 07:52:43.547587 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.547560 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8"} err="failed to get container status \"d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8\": rpc error: code = NotFound desc = could not find container \"d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8\": container with ID starting with d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8 not found: ID does not exist" Jul 05 07:52:43.547587 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.547587 2566 scope.go:117] "RemoveContainer" containerID="460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9" Jul 05 07:52:43.548032 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.547901 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9"} err="failed to get container status \"460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9\": rpc error: code = NotFound desc = could not find container \"460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9\": container with ID starting with 460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9 not found: ID does not exist" Jul 05 07:52:43.548032 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.547923 2566 scope.go:117] "RemoveContainer" containerID="2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610" Jul 05 07:52:43.548214 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.548191 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610"} err="failed to get container status \"2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610\": rpc error: code = NotFound desc = could not find container \"2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610\": container with ID starting with 2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610 not found: ID does not exist" Jul 05 07:52:43.548282 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.548216 2566 scope.go:117] "RemoveContainer" containerID="2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901" Jul 05 07:52:43.548494 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.548478 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901"} err="failed to get container status \"2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901\": rpc error: code = NotFound desc = could not find container \"2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901\": container with ID starting with 2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901 not found: ID does not exist" Jul 05 07:52:43.548549 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.548496 2566 scope.go:117] "RemoveContainer" containerID="e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c" Jul 05 07:52:43.548754 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.548738 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c"} err="failed to get container status \"e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c\": rpc error: code = NotFound desc = could not find container \"e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c\": container with ID starting with e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c not found: ID does not exist" Jul 05 07:52:43.548807 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.548755 2566 scope.go:117] "RemoveContainer" containerID="c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963" Jul 05 07:52:43.548985 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.548967 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963"} err="failed to get container status \"c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963\": rpc error: code = NotFound desc = could not find container \"c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963\": container with ID starting with c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963 not found: ID does not exist" Jul 05 07:52:43.549036 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.548986 2566 scope.go:117] "RemoveContainer" containerID="3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757" Jul 05 07:52:43.549243 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.549218 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757"} err="failed to get container status \"3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757\": rpc error: code = NotFound desc = could not find container \"3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757\": container with ID starting with 3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757 not found: ID does not exist" Jul 05 07:52:43.549243 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.549242 2566 scope.go:117] "RemoveContainer" containerID="d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8" Jul 05 07:52:43.549449 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.549434 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 05 07:52:43.549484 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.549443 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8"} err="failed to get container status \"d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8\": rpc error: code = NotFound desc = could not find container \"d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8\": container with ID starting with d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8 not found: ID does not exist" Jul 05 07:52:43.549484 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.549467 2566 scope.go:117] "RemoveContainer" containerID="460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9" Jul 05 07:52:43.549692 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.549675 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9"} err="failed to get container status \"460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9\": rpc error: code = NotFound desc = could not find container \"460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9\": container with ID starting with 460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9 not found: ID does not exist" Jul 05 07:52:43.549740 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.549700 2566 scope.go:117] "RemoveContainer" containerID="2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610" Jul 05 07:52:43.549740 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.549701 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerName="init-config-reloader" Jul 05 07:52:43.549801 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.549747 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerName="init-config-reloader" Jul 05 07:52:43.549801 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.549766 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerName="kube-rbac-proxy-web" Jul 05 07:52:43.549801 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.549773 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerName="kube-rbac-proxy-web" Jul 05 07:52:43.549801 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.549785 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerName="thanos-sidecar" Jul 05 07:52:43.549801 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.549791 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerName="thanos-sidecar" Jul 05 07:52:43.549801 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.549800 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerName="kube-rbac-proxy-thanos" Jul 05 07:52:43.549985 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.549806 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerName="kube-rbac-proxy-thanos" Jul 05 07:52:43.549985 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.549813 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerName="prometheus" Jul 05 07:52:43.549985 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.549819 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerName="prometheus" Jul 05 07:52:43.549985 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.549825 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerName="config-reloader" Jul 05 07:52:43.549985 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.549833 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerName="config-reloader" Jul 05 07:52:43.549985 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.549842 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerName="kube-rbac-proxy" Jul 05 07:52:43.549985 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.549850 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerName="kube-rbac-proxy" Jul 05 07:52:43.549985 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.549917 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerName="thanos-sidecar" Jul 05 07:52:43.549985 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.549926 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerName="kube-rbac-proxy-web" Jul 05 07:52:43.549985 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.549931 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerName="kube-rbac-proxy" Jul 05 07:52:43.549985 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.549936 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerName="kube-rbac-proxy-thanos" Jul 05 07:52:43.549985 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.549944 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerName="config-reloader" Jul 05 07:52:43.549985 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.549942 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610"} err="failed to get container status \"2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610\": rpc error: code = NotFound desc = could not find container \"2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610\": container with ID starting with 2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610 not found: ID does not exist" Jul 05 07:52:43.549985 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.549965 2566 scope.go:117] "RemoveContainer" containerID="2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901" Jul 05 07:52:43.550479 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.549951 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" containerName="prometheus" Jul 05 07:52:43.550706 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.550674 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901"} err="failed to get container status \"2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901\": rpc error: code = NotFound desc = could not find container \"2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901\": container with ID starting with 2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901 not found: ID does not exist" Jul 05 07:52:43.550777 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.550709 2566 scope.go:117] "RemoveContainer" containerID="e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c" Jul 05 07:52:43.551061 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.551029 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c"} err="failed to get container status \"e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c\": rpc error: code = NotFound desc = could not find container \"e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c\": container with ID starting with e15dec66b7c98279761eea4621aa473b90469fc0e0c542056c50a48532f34f2c not found: ID does not exist" Jul 05 07:52:43.551174 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.551069 2566 scope.go:117] "RemoveContainer" containerID="c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963" Jul 05 07:52:43.551536 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.551508 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963"} err="failed to get container status \"c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963\": rpc error: code = NotFound desc = could not find container \"c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963\": container with ID starting with c5f3edcf0316814680e64132f6a71e15295b1e480ba2ffa2b4174fbddd4bf963 not found: ID does not exist" Jul 05 07:52:43.551622 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.551537 2566 scope.go:117] "RemoveContainer" containerID="3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757" Jul 05 07:52:43.555961 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.555938 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757"} err="failed to get container status \"3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757\": rpc error: code = NotFound desc = could not find container \"3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757\": container with ID starting with 3077e017d6cf96b36228c8dd062a83c9ef97f3a088c2abc150df96cd93451757 not found: ID does not exist" Jul 05 07:52:43.556186 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.555960 2566 scope.go:117] "RemoveContainer" containerID="d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8" Jul 05 07:52:43.556441 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.556416 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8"} err="failed to get container status \"d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8\": rpc error: code = NotFound desc = could not find container \"d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8\": container with ID starting with d7200482d3a88ac96ec1ad1163d6defad9f287d8b946832b955bf5bd728405f8 not found: ID does not exist" Jul 05 07:52:43.556441 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.556440 2566 scope.go:117] "RemoveContainer" containerID="460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9" Jul 05 07:52:43.556696 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.556677 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9"} err="failed to get container status \"460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9\": rpc error: code = NotFound desc = could not find container \"460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9\": container with ID starting with 460421501c60f9d561ca9798d085e46b4f071f2da07f4510f837e7a90db689c9 not found: ID does not exist" Jul 05 07:52:43.556751 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.556696 2566 scope.go:117] "RemoveContainer" containerID="2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610" Jul 05 07:52:43.556927 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.556909 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610"} err="failed to get container status \"2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610\": rpc error: code = NotFound desc = could not find container \"2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610\": container with ID starting with 2611b7cd6d18f21759c19d587251ef8c66217326ec19a41ba29c5510dc6e8610 not found: ID does not exist" Jul 05 07:52:43.556999 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.556929 2566 scope.go:117] "RemoveContainer" containerID="2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901" Jul 05 07:52:43.557035 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.556998 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.557497 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.557164 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901"} err="failed to get container status \"2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901\": rpc error: code = NotFound desc = could not find container \"2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901\": container with ID starting with 2eb5d4a3e308cdd614eb3d511a0a621d7dfd1a05e164274ea125283f5b4ba901 not found: ID does not exist" Jul 05 07:52:43.559938 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.559922 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 05 07:52:43.560167 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.560152 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ff0m27ipikg1g\"" Jul 05 07:52:43.560564 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.560360 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 05 07:52:43.560564 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.560411 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 05 07:52:43.560564 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.560421 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 05 07:52:43.560564 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.560424 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 05 07:52:43.560564 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.560456 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 05 07:52:43.560564 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.560461 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 05 07:52:43.560833 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.560688 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 05 07:52:43.560833 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.560754 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 05 07:52:43.560911 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.560851 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 05 07:52:43.560911 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.560876 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hjbkh\"" Jul 05 07:52:43.561216 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.561202 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 05 07:52:43.561628 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.561611 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 05 07:52:43.564217 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.564196 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 05 07:52:43.567517 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.567501 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 05 07:52:43.571071 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.571052 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 05 07:52:43.682295 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.682264 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3b395caa-28d6-46bf-8195-0cf266df676a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.682295 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.682299 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b395caa-28d6-46bf-8195-0cf266df676a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.682488 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.682316 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3b395caa-28d6-46bf-8195-0cf266df676a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.682488 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.682335 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3b395caa-28d6-46bf-8195-0cf266df676a-config\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.682488 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.682378 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3b395caa-28d6-46bf-8195-0cf266df676a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.682488 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.682409 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b395caa-28d6-46bf-8195-0cf266df676a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.682488 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.682429 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3b395caa-28d6-46bf-8195-0cf266df676a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.682488 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.682454 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3b395caa-28d6-46bf-8195-0cf266df676a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.682488 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.682469 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3b395caa-28d6-46bf-8195-0cf266df676a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.682699 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.682549 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw6t4\" (UniqueName: \"kubernetes.io/projected/3b395caa-28d6-46bf-8195-0cf266df676a-kube-api-access-hw6t4\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.682699 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.682603 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b395caa-28d6-46bf-8195-0cf266df676a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.682699 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.682623 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3b395caa-28d6-46bf-8195-0cf266df676a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.682699 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.682638 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b395caa-28d6-46bf-8195-0cf266df676a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.682699 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.682661 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3b395caa-28d6-46bf-8195-0cf266df676a-config-out\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.682854 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.682730 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3b395caa-28d6-46bf-8195-0cf266df676a-web-config\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.682854 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.682753 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3b395caa-28d6-46bf-8195-0cf266df676a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.682854 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.682772 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3b395caa-28d6-46bf-8195-0cf266df676a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.682854 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.682800 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3b395caa-28d6-46bf-8195-0cf266df676a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.682854 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.682830 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3b395caa-28d6-46bf-8195-0cf266df676a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.682854 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.682847 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3b395caa-28d6-46bf-8195-0cf266df676a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.783460 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.783420 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3b395caa-28d6-46bf-8195-0cf266df676a-web-config\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.783460 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.783468 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3b395caa-28d6-46bf-8195-0cf266df676a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.783608 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.783487 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3b395caa-28d6-46bf-8195-0cf266df676a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.783652 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.783598 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3b395caa-28d6-46bf-8195-0cf266df676a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.783652 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.783634 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3b395caa-28d6-46bf-8195-0cf266df676a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.783728 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.783660 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3b395caa-28d6-46bf-8195-0cf266df676a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.783816 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.783791 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3b395caa-28d6-46bf-8195-0cf266df676a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.783949 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.783841 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b395caa-28d6-46bf-8195-0cf266df676a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.783949 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.783867 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3b395caa-28d6-46bf-8195-0cf266df676a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.783949 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.783900 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3b395caa-28d6-46bf-8195-0cf266df676a-config\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.783949 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.783925 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3b395caa-28d6-46bf-8195-0cf266df676a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.784181 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.783955 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b395caa-28d6-46bf-8195-0cf266df676a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.784181 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.783989 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3b395caa-28d6-46bf-8195-0cf266df676a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.784181 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.784032 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3b395caa-28d6-46bf-8195-0cf266df676a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.784181 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.784060 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3b395caa-28d6-46bf-8195-0cf266df676a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.784181 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.784101 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw6t4\" (UniqueName: \"kubernetes.io/projected/3b395caa-28d6-46bf-8195-0cf266df676a-kube-api-access-hw6t4\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.784181 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.784173 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b395caa-28d6-46bf-8195-0cf266df676a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.784463 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.784200 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3b395caa-28d6-46bf-8195-0cf266df676a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.784463 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.784223 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b395caa-28d6-46bf-8195-0cf266df676a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.784463 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.784249 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3b395caa-28d6-46bf-8195-0cf266df676a-config-out\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.785231 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.785209 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3b395caa-28d6-46bf-8195-0cf266df676a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.785854 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.785832 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3b395caa-28d6-46bf-8195-0cf266df676a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.787559 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.786241 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3b395caa-28d6-46bf-8195-0cf266df676a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.787559 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.786386 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b395caa-28d6-46bf-8195-0cf266df676a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.787559 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.786719 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3b395caa-28d6-46bf-8195-0cf266df676a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.787559 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.786781 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b395caa-28d6-46bf-8195-0cf266df676a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.787559 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.786924 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3b395caa-28d6-46bf-8195-0cf266df676a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.787559 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.787399 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b395caa-28d6-46bf-8195-0cf266df676a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.787972 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.787744 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3b395caa-28d6-46bf-8195-0cf266df676a-config-out\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.787972 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.787940 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3b395caa-28d6-46bf-8195-0cf266df676a-web-config\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.787972 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.787964 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b395caa-28d6-46bf-8195-0cf266df676a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.788807 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.788782 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3b395caa-28d6-46bf-8195-0cf266df676a-config\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.788999 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.788959 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3b395caa-28d6-46bf-8195-0cf266df676a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.789246 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.789224 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3b395caa-28d6-46bf-8195-0cf266df676a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.789360 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.789338 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3b395caa-28d6-46bf-8195-0cf266df676a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.789427 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.789396 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3b395caa-28d6-46bf-8195-0cf266df676a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.789530 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.789510 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3b395caa-28d6-46bf-8195-0cf266df676a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.789771 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.789752 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3b395caa-28d6-46bf-8195-0cf266df676a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.790165 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.790126 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3b395caa-28d6-46bf-8195-0cf266df676a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.793430 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.793404 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw6t4\" (UniqueName: \"kubernetes.io/projected/3b395caa-28d6-46bf-8195-0cf266df676a-kube-api-access-hw6t4\") pod \"prometheus-k8s-0\" (UID: \"3b395caa-28d6-46bf-8195-0cf266df676a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.867568 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.867543 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:43.998474 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:43.998443 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 05 07:52:44.001312 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:52:44.001281 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b395caa_28d6_46bf_8195_0cf266df676a.slice/crio-3cb4d12798e27140f690b22128a45c7601d30984c40025f2e782788e0a4876df WatchSource:0}: Error finding container 3cb4d12798e27140f690b22128a45c7601d30984c40025f2e782788e0a4876df: Status 404 returned error can't find the container with id 3cb4d12798e27140f690b22128a45c7601d30984c40025f2e782788e0a4876df Jul 05 07:52:44.495111 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:44.495034 2566 generic.go:356] "Generic (PLEG): container finished" podID="3b395caa-28d6-46bf-8195-0cf266df676a" containerID="585601fa67877fe39a7dbccbce76471c6b4690769cdb9fc40653c4ea4f29f8f4" exitCode=0 Jul 05 07:52:44.495492 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:44.495122 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3b395caa-28d6-46bf-8195-0cf266df676a","Type":"ContainerDied","Data":"585601fa67877fe39a7dbccbce76471c6b4690769cdb9fc40653c4ea4f29f8f4"} Jul 05 07:52:44.495492 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:44.495212 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3b395caa-28d6-46bf-8195-0cf266df676a","Type":"ContainerStarted","Data":"3cb4d12798e27140f690b22128a45c7601d30984c40025f2e782788e0a4876df"} Jul 05 07:52:45.126398 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:45.126365 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="968b0b3a-3acb-4cde-8343-55e85bebbe2c" path="/var/lib/kubelet/pods/968b0b3a-3acb-4cde-8343-55e85bebbe2c/volumes" Jul 05 07:52:45.503443 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:45.503354 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3b395caa-28d6-46bf-8195-0cf266df676a","Type":"ContainerStarted","Data":"b9308e53e33ee30dd0a114e5dcb0d94f60666abea6f450321667e57a772914f0"} Jul 05 07:52:45.503762 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:45.503472 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3b395caa-28d6-46bf-8195-0cf266df676a","Type":"ContainerStarted","Data":"9db436c54decde176f045779f41d0dc0b03a8cb8e1fa1b29dd763eb3095400c2"} Jul 05 07:52:45.503762 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:45.503515 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3b395caa-28d6-46bf-8195-0cf266df676a","Type":"ContainerStarted","Data":"5fad22797775ddf3ca55f99037e32b46d1f115943dffe497cdbcdf860b071356"} Jul 05 07:52:45.503762 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:45.503550 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3b395caa-28d6-46bf-8195-0cf266df676a","Type":"ContainerStarted","Data":"9aa372b0ca9ecffa2d98ce150605c0ee20593ab34be0f036b360a4d52fd9224f"} Jul 05 07:52:45.503762 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:45.503586 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3b395caa-28d6-46bf-8195-0cf266df676a","Type":"ContainerStarted","Data":"c9a471fd7f8ddb7d38f380a5eaf2c65d8d5342bf6645457bdacedf43e2d71653"} Jul 05 07:52:45.503762 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:45.503621 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3b395caa-28d6-46bf-8195-0cf266df676a","Type":"ContainerStarted","Data":"41f71aee592a481dc4ada694a5753f8d3ed4fcc86865e1182d1187d7c3c8fba5"} Jul 05 07:52:45.531881 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:45.531829 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.511365799 podStartE2EDuration="2.531813554s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.447755ms" isStatefulPod=false podCreationTimestamp="2026-07-05 07:52:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:52:45.529609381 +0000 UTC m=+380.949342436" watchObservedRunningTime="2026-07-05 07:52:45.531813554 +0000 UTC m=+380.951546610" Jul 05 07:52:47.267279 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:47.267247 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:52:47.313832 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:47.313802 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:52:47.416002 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:47.415977 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:52:48.013434 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:48.013399 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:52:48.059888 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:48.059861 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:52:48.868420 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:48.868370 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:52:58.593429 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:58.593394 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:52:58.648158 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:58.648112 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:52:58.696306 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:52:58.696279 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:53:20.166954 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:53:20.166918 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:53:20.216373 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:53:20.216342 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:53:43.868103 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:53:43.868073 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:53:43.883096 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:53:43.883073 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:53:44.738003 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:53:44.737976 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 05 07:53:52.638414 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:53:52.638321 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:53:52.687054 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:53:52.687010 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:53:56.377885 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:53:56.377851 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:53:56.429472 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:53:56.429443 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:53:56.511195 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:53:56.511171 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:53:57.328887 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:53:57.328853 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:53:57.374177 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:53:57.374122 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:54:03.231637 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:54:03.231603 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:54:04.664205 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:54:04.664090 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:54:04.711700 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:54:04.711665 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:54:06.843735 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:54:06.843675 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:54:06.889756 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:54:06.889729 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:54:06.944573 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:54:06.944546 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:54:06.991502 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:54:06.991480 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:54:10.661540 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:54:10.661505 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:54:12.540662 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:54:12.540623 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:54:12.639887 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:54:12.639850 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:54:12.698071 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:54:12.698047 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:54:27.088546 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:54:27.088499 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:54:37.241675 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:54:37.241640 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:55:01.287166 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:01.287111 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:55:01.388811 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:01.388778 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" limit=1024 Jul 05 07:55:03.952009 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:03.951975 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qmlxc_9eda60f4-0409-4ba2-882a-0fc06614194b/global-pull-secret-syncer/0.log" Jul 05 07:55:04.050822 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:04.050794 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6s2tr_13a9ecf4-ffb1-4611-99bc-e629936bab5d/konnectivity-agent/0.log" Jul 05 07:55:04.178313 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:04.178283 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-31.ec2.internal_4da58462e79ad0d87f76c33f35ac75ff/haproxy/0.log" Jul 05 07:55:07.175201 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:07.175172 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba2919b5-3c50-494c-a998-9396664a65c0/alertmanager/0.log" Jul 05 07:55:07.201231 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:07.201200 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba2919b5-3c50-494c-a998-9396664a65c0/config-reloader/0.log" Jul 05 07:55:07.229325 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:07.229302 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba2919b5-3c50-494c-a998-9396664a65c0/kube-rbac-proxy-web/0.log" Jul 05 07:55:07.263922 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:07.263893 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba2919b5-3c50-494c-a998-9396664a65c0/kube-rbac-proxy/0.log" Jul 05 07:55:07.294818 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:07.294789 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba2919b5-3c50-494c-a998-9396664a65c0/kube-rbac-proxy-metric/0.log" Jul 05 07:55:07.326991 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:07.326961 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba2919b5-3c50-494c-a998-9396664a65c0/prom-label-proxy/0.log" Jul 05 07:55:07.358816 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:07.358791 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba2919b5-3c50-494c-a998-9396664a65c0/init-config-reloader/0.log" Jul 05 07:55:07.532871 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:07.532847 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5784d6d4d7-svngg_7492730d-f99c-4db1-a9fc-64487b00364e/metrics-server/0.log" Jul 05 07:55:07.566788 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:07.566766 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-5l4kr_4ba7f0b4-f809-44d0-b929-556bf4c91b69/monitoring-plugin/0.log" Jul 05 07:55:07.611086 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:07.611060 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4v2v2_15708bce-9fc3-44a1-bf40-4878591db45c/node-exporter/0.log" Jul 05 07:55:07.638556 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:07.638533 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4v2v2_15708bce-9fc3-44a1-bf40-4878591db45c/kube-rbac-proxy/0.log" Jul 05 07:55:07.679646 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:07.679622 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4v2v2_15708bce-9fc3-44a1-bf40-4878591db45c/init-textfile/0.log" Jul 05 07:55:07.995343 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:07.995317 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3b395caa-28d6-46bf-8195-0cf266df676a/prometheus/0.log" Jul 05 07:55:08.021128 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:08.021104 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3b395caa-28d6-46bf-8195-0cf266df676a/config-reloader/0.log" Jul 05 07:55:08.047655 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:08.047633 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3b395caa-28d6-46bf-8195-0cf266df676a/thanos-sidecar/0.log" Jul 05 07:55:08.075744 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:08.075724 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3b395caa-28d6-46bf-8195-0cf266df676a/kube-rbac-proxy-web/0.log" Jul 05 07:55:08.102094 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:08.102060 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3b395caa-28d6-46bf-8195-0cf266df676a/kube-rbac-proxy/0.log" Jul 05 07:55:08.124613 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:08.124585 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3b395caa-28d6-46bf-8195-0cf266df676a/kube-rbac-proxy-thanos/0.log" Jul 05 07:55:08.149035 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:08.149018 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3b395caa-28d6-46bf-8195-0cf266df676a/init-config-reloader/0.log" Jul 05 07:55:08.234339 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:08.234267 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-pv4gb_2b9a6d5d-914e-42f4-b709-6644bbbf58ef/prometheus-operator-admission-webhook/0.log" Jul 05 07:55:11.924108 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:11.924073 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-49wj7/perf-node-gather-daemonset-cssvc"] Jul 05 07:55:11.927451 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:11.927432 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-49wj7/perf-node-gather-daemonset-cssvc" Jul 05 07:55:11.930267 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:11.930244 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-49wj7\"/\"openshift-service-ca.crt\"" Jul 05 07:55:11.930376 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:11.930343 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-49wj7\"/\"kube-root-ca.crt\"" Jul 05 07:55:11.931674 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:11.931645 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-49wj7\"/\"default-dockercfg-twd9b\"" Jul 05 07:55:11.938868 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:11.938851 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-49wj7/perf-node-gather-daemonset-cssvc"] Jul 05 07:55:11.972010 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:11.971983 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/13f16e34-1586-4cae-b82d-2f0d8babf5fc-proc\") pod \"perf-node-gather-daemonset-cssvc\" (UID: \"13f16e34-1586-4cae-b82d-2f0d8babf5fc\") " pod="openshift-must-gather-49wj7/perf-node-gather-daemonset-cssvc" Jul 05 07:55:11.972104 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:11.972023 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13f16e34-1586-4cae-b82d-2f0d8babf5fc-lib-modules\") pod \"perf-node-gather-daemonset-cssvc\" (UID: \"13f16e34-1586-4cae-b82d-2f0d8babf5fc\") " pod="openshift-must-gather-49wj7/perf-node-gather-daemonset-cssvc" Jul 05 07:55:11.972104 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:11.972081 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/13f16e34-1586-4cae-b82d-2f0d8babf5fc-podres\") pod \"perf-node-gather-daemonset-cssvc\" (UID: \"13f16e34-1586-4cae-b82d-2f0d8babf5fc\") " pod="openshift-must-gather-49wj7/perf-node-gather-daemonset-cssvc" Jul 05 07:55:11.972222 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:11.972109 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13f16e34-1586-4cae-b82d-2f0d8babf5fc-sys\") pod \"perf-node-gather-daemonset-cssvc\" (UID: \"13f16e34-1586-4cae-b82d-2f0d8babf5fc\") " pod="openshift-must-gather-49wj7/perf-node-gather-daemonset-cssvc" Jul 05 07:55:11.972222 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:11.972187 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gdpm\" (UniqueName: \"kubernetes.io/projected/13f16e34-1586-4cae-b82d-2f0d8babf5fc-kube-api-access-6gdpm\") pod \"perf-node-gather-daemonset-cssvc\" (UID: \"13f16e34-1586-4cae-b82d-2f0d8babf5fc\") " pod="openshift-must-gather-49wj7/perf-node-gather-daemonset-cssvc" Jul 05 07:55:12.073252 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:12.073219 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gdpm\" (UniqueName: \"kubernetes.io/projected/13f16e34-1586-4cae-b82d-2f0d8babf5fc-kube-api-access-6gdpm\") pod \"perf-node-gather-daemonset-cssvc\" (UID: \"13f16e34-1586-4cae-b82d-2f0d8babf5fc\") " pod="openshift-must-gather-49wj7/perf-node-gather-daemonset-cssvc" Jul 05 07:55:12.073367 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:12.073268 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/13f16e34-1586-4cae-b82d-2f0d8babf5fc-proc\") pod \"perf-node-gather-daemonset-cssvc\" (UID: \"13f16e34-1586-4cae-b82d-2f0d8babf5fc\") " pod="openshift-must-gather-49wj7/perf-node-gather-daemonset-cssvc" Jul 05 07:55:12.073367 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:12.073295 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13f16e34-1586-4cae-b82d-2f0d8babf5fc-lib-modules\") pod \"perf-node-gather-daemonset-cssvc\" (UID: \"13f16e34-1586-4cae-b82d-2f0d8babf5fc\") " pod="openshift-must-gather-49wj7/perf-node-gather-daemonset-cssvc" Jul 05 07:55:12.073367 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:12.073320 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/13f16e34-1586-4cae-b82d-2f0d8babf5fc-podres\") pod \"perf-node-gather-daemonset-cssvc\" (UID: \"13f16e34-1586-4cae-b82d-2f0d8babf5fc\") " pod="openshift-must-gather-49wj7/perf-node-gather-daemonset-cssvc" Jul 05 07:55:12.073367 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:12.073336 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13f16e34-1586-4cae-b82d-2f0d8babf5fc-sys\") pod \"perf-node-gather-daemonset-cssvc\" (UID: \"13f16e34-1586-4cae-b82d-2f0d8babf5fc\") " pod="openshift-must-gather-49wj7/perf-node-gather-daemonset-cssvc" Jul 05 07:55:12.073551 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:12.073417 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/13f16e34-1586-4cae-b82d-2f0d8babf5fc-proc\") pod \"perf-node-gather-daemonset-cssvc\" (UID: \"13f16e34-1586-4cae-b82d-2f0d8babf5fc\") " pod="openshift-must-gather-49wj7/perf-node-gather-daemonset-cssvc" Jul 05 07:55:12.073551 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:12.073436 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13f16e34-1586-4cae-b82d-2f0d8babf5fc-sys\") pod \"perf-node-gather-daemonset-cssvc\" (UID: \"13f16e34-1586-4cae-b82d-2f0d8babf5fc\") " pod="openshift-must-gather-49wj7/perf-node-gather-daemonset-cssvc" Jul 05 07:55:12.073551 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:12.073465 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13f16e34-1586-4cae-b82d-2f0d8babf5fc-lib-modules\") pod \"perf-node-gather-daemonset-cssvc\" (UID: \"13f16e34-1586-4cae-b82d-2f0d8babf5fc\") " pod="openshift-must-gather-49wj7/perf-node-gather-daemonset-cssvc" Jul 05 07:55:12.073551 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:12.073490 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/13f16e34-1586-4cae-b82d-2f0d8babf5fc-podres\") pod \"perf-node-gather-daemonset-cssvc\" (UID: \"13f16e34-1586-4cae-b82d-2f0d8babf5fc\") " pod="openshift-must-gather-49wj7/perf-node-gather-daemonset-cssvc" Jul 05 07:55:12.083003 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:12.082986 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gdpm\" (UniqueName: \"kubernetes.io/projected/13f16e34-1586-4cae-b82d-2f0d8babf5fc-kube-api-access-6gdpm\") pod \"perf-node-gather-daemonset-cssvc\" (UID: \"13f16e34-1586-4cae-b82d-2f0d8babf5fc\") " pod="openshift-must-gather-49wj7/perf-node-gather-daemonset-cssvc" Jul 05 07:55:12.215661 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:12.215609 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pndsb_a6fc0e8f-0a92-40af-8e70-40e4dc38504c/dns/0.log" Jul 05 07:55:12.236915 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:12.236898 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-49wj7/perf-node-gather-daemonset-cssvc" Jul 05 07:55:12.237629 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:12.237613 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pndsb_a6fc0e8f-0a92-40af-8e70-40e4dc38504c/kube-rbac-proxy/0.log" Jul 05 07:55:12.361448 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:12.361419 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-49wj7/perf-node-gather-daemonset-cssvc"] Jul 05 07:55:12.364472 ip-10-0-142-31 kubenswrapper[2566]: W0705 07:55:12.364439 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod13f16e34_1586_4cae_b82d_2f0d8babf5fc.slice/crio-62de085c3bb2e54b09b6e659193d37c293f9bf8c50cbe496975b4e52f91974a5 WatchSource:0}: Error finding container 62de085c3bb2e54b09b6e659193d37c293f9bf8c50cbe496975b4e52f91974a5: Status 404 returned error can't find the container with id 62de085c3bb2e54b09b6e659193d37c293f9bf8c50cbe496975b4e52f91974a5 Jul 05 07:55:12.447252 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:12.447228 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q7zq5_a50d8e5b-1a7b-4028-846e-73a293b0e9e2/dns-node-resolver/0.log" Jul 05 07:55:12.839100 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:12.839079 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-79d66dc46b-vv59p_988967a8-61a6-424f-a248-5102c8c259ef/registry/0.log" Jul 05 07:55:12.885423 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:12.885400 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z2h2b_0a695ef6-9710-4847-bde7-ae627055ffab/node-ca/0.log" Jul 05 07:55:13.034848 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:13.034812 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-49wj7/perf-node-gather-daemonset-cssvc" event={"ID":"13f16e34-1586-4cae-b82d-2f0d8babf5fc","Type":"ContainerStarted","Data":"d5ab1349d2d8c15a36c9b39fd90e779d3ed576f67fbaff1027cb09cffae61671"} Jul 05 07:55:13.035210 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:13.034857 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-49wj7/perf-node-gather-daemonset-cssvc" event={"ID":"13f16e34-1586-4cae-b82d-2f0d8babf5fc","Type":"ContainerStarted","Data":"62de085c3bb2e54b09b6e659193d37c293f9bf8c50cbe496975b4e52f91974a5"} Jul 05 07:55:13.035210 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:13.034941 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-49wj7/perf-node-gather-daemonset-cssvc" Jul 05 07:55:13.055069 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:13.055030 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-49wj7/perf-node-gather-daemonset-cssvc" podStartSLOduration=2.055017644 podStartE2EDuration="2.055017644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 07:55:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 07:55:13.054526474 +0000 UTC m=+528.474259528" watchObservedRunningTime="2026-07-05 07:55:13.055017644 +0000 UTC m=+528.474750699" Jul 05 07:55:13.634084 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:13.634048 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bf4ff6889-zjz47_d924fc46-4762-4449-a1b6-bec710c87473/router/0.log" Jul 05 07:55:13.964234 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:13.964109 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6d2v5_ab7d905e-50ca-4fc8-861b-97c9a87c22c1/serve-healthcheck-canary/0.log" Jul 05 07:55:14.445334 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:14.445311 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f24dc_aca8f321-4806-4a75-8598-c6b0a6494cf1/kube-rbac-proxy/0.log" Jul 05 07:55:14.465541 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:14.465517 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f24dc_aca8f321-4806-4a75-8598-c6b0a6494cf1/exporter/0.log" Jul 05 07:55:14.485363 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:14.485342 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f24dc_aca8f321-4806-4a75-8598-c6b0a6494cf1/extractor/0.log" Jul 05 07:55:19.047306 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:19.047239 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-49wj7/perf-node-gather-daemonset-cssvc" Jul 05 07:55:19.827653 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:19.827626 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9dnrn_b9bcc734-1c69-432f-bcb6-f2e88175856c/kube-multus-additional-cni-plugins/0.log" Jul 05 07:55:19.848902 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:19.848879 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9dnrn_b9bcc734-1c69-432f-bcb6-f2e88175856c/egress-router-binary-copy/0.log" Jul 05 07:55:19.868959 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:19.868938 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9dnrn_b9bcc734-1c69-432f-bcb6-f2e88175856c/cni-plugins/0.log" Jul 05 07:55:19.888057 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:19.888039 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9dnrn_b9bcc734-1c69-432f-bcb6-f2e88175856c/bond-cni-plugin/0.log" Jul 05 07:55:19.907468 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:19.907449 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9dnrn_b9bcc734-1c69-432f-bcb6-f2e88175856c/routeoverride-cni/0.log" Jul 05 07:55:19.927299 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:19.927278 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9dnrn_b9bcc734-1c69-432f-bcb6-f2e88175856c/whereabouts-cni-bincopy/0.log" Jul 05 07:55:19.948381 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:19.948358 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9dnrn_b9bcc734-1c69-432f-bcb6-f2e88175856c/whereabouts-cni/0.log" Jul 05 07:55:20.142208 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:20.142121 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zgccj_cbab082f-f8ce-41bc-8e3b-eee2fe0c1ece/kube-multus/0.log" Jul 05 07:55:20.205286 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:20.205260 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mt69q_2b6430fa-c37c-4cc9-81ab-3feb7300273e/network-metrics-daemon/0.log" Jul 05 07:55:20.226544 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:20.226521 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mt69q_2b6430fa-c37c-4cc9-81ab-3feb7300273e/kube-rbac-proxy/0.log" Jul 05 07:55:21.112083 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:21.112056 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hzvp7_7f4e258c-e3e6-48d8-a144-0a7fcb20bd00/ovn-controller/0.log" Jul 05 07:55:21.130870 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:21.130847 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hzvp7_7f4e258c-e3e6-48d8-a144-0a7fcb20bd00/ovn-acl-logging/0.log" Jul 05 07:55:21.161680 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:21.161653 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hzvp7_7f4e258c-e3e6-48d8-a144-0a7fcb20bd00/kube-rbac-proxy-node/0.log" Jul 05 07:55:21.182814 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:21.182796 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hzvp7_7f4e258c-e3e6-48d8-a144-0a7fcb20bd00/kube-rbac-proxy-ovn-metrics/0.log" Jul 05 07:55:21.200324 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:21.200304 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hzvp7_7f4e258c-e3e6-48d8-a144-0a7fcb20bd00/northd/0.log" Jul 05 07:55:21.232403 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:21.232354 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hzvp7_7f4e258c-e3e6-48d8-a144-0a7fcb20bd00/nbdb/0.log" Jul 05 07:55:21.279597 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:21.279577 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hzvp7_7f4e258c-e3e6-48d8-a144-0a7fcb20bd00/sbdb/0.log" Jul 05 07:55:21.313889 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:21.313865 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hzvp7_7f4e258c-e3e6-48d8-a144-0a7fcb20bd00/ovnkube-controller/0.log" Jul 05 07:55:22.675935 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:22.675907 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-2wssl_8a151452-12d5-4a93-bffb-e93ee92e8e14/network-check-target-container/0.log" Jul 05 07:55:23.575807 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:23.575783 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-wnrk5_917e3b12-6478-4463-a3e1-b63829bf2c84/iptables-alerter/0.log" Jul 05 07:55:24.254268 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:24.254242 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-thrp6_505f6ad2-0909-4ed9-b4d8-eb54ea52d0da/tuned/0.log" Jul 05 07:55:25.915227 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:25.915194 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-56fcf86bf-wpsxf_119ae6c1-756b-4255-bf55-1eaa15f9e400/cluster-samples-operator/0.log" Jul 05 07:55:25.931679 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:25.931651 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-56fcf86bf-wpsxf_119ae6c1-756b-4255-bf55-1eaa15f9e400/cluster-samples-operator-watch/0.log" Jul 05 07:55:27.451775 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:27.451743 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-kc6pw_2eb183c3-5aec-4b47-827c-5cd3d1185bdf/csi-driver/0.log" Jul 05 07:55:27.470720 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:27.470696 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-kc6pw_2eb183c3-5aec-4b47-827c-5cd3d1185bdf/csi-node-driver-registrar/0.log" Jul 05 07:55:27.491472 ip-10-0-142-31 kubenswrapper[2566]: I0705 07:55:27.491449 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-kc6pw_2eb183c3-5aec-4b47-827c-5cd3d1185bdf/csi-liveness-probe/0.log"