Jul 06 15:23:33.737742 ip-10-0-143-129 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 06 15:23:33.737756 ip-10-0-143-129 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 06 15:23:33.737765 ip-10-0-143-129 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 06 15:23:33.738114 ip-10-0-143-129 systemd[1]: Failed to start Kubernetes Kubelet. Jul 06 15:23:43.909622 ip-10-0-143-129 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 06 15:23:43.909641 ip-10-0-143-129 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 3463a87513c24e3da9b3bd436306f783 -- Jul 06 15:25:37.500681 ip-10-0-143-129 systemd[1]: Starting Kubernetes Kubelet... Jul 06 15:25:38.116136 ip-10-0-143-129 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 15:25:38.116136 ip-10-0-143-129 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 15:25:38.116136 ip-10-0-143-129 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 15:25:38.116136 ip-10-0-143-129 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 15:25:38.116136 ip-10-0-143-129 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 15:25:38.116136 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:37.988881 2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 15:25:38.116136 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001249 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 15:25:38.116136 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001267 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 15:25:38.116136 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001270 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 15:25:38.116136 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001274 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 15:25:38.116136 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001278 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 15:25:38.116136 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001281 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 15:25:38.116136 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001284 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 15:25:38.116136 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001287 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 15:25:38.084216 ip-10-0-143-129 systemd[1]: Started Kubernetes Kubelet. Jul 06 15:25:38.117274 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001289 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 15:25:38.117274 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001292 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 15:25:38.117274 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001295 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 15:25:38.117274 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001297 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 15:25:38.117274 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001300 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 15:25:38.117274 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001303 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 15:25:38.117274 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001306 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 15:25:38.117274 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001309 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 15:25:38.117274 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001311 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 15:25:38.117274 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001314 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 15:25:38.117274 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001316 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 15:25:38.117274 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001319 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 15:25:38.117274 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001322 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 15:25:38.117274 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001324 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 15:25:38.117274 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001327 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 06 15:25:38.117274 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001330 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 15:25:38.117274 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001333 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 15:25:38.117274 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001335 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 15:25:38.117274 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001338 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 15:25:38.117899 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001342 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 15:25:38.117899 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001346 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 15:25:38.117899 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001350 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 15:25:38.117899 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001353 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 15:25:38.117899 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001355 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 15:25:38.117899 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001358 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 15:25:38.117899 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001360 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 15:25:38.117899 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001363 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 15:25:38.117899 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001366 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 15:25:38.117899 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001368 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 15:25:38.117899 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001371 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 15:25:38.117899 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001373 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 15:25:38.117899 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001376 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 15:25:38.117899 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001378 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 15:25:38.117899 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001381 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 15:25:38.117899 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001383 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 15:25:38.117899 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001385 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 15:25:38.117899 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001388 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 15:25:38.117899 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001391 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 15:25:38.117899 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001394 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 15:25:38.118985 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001398 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 15:25:38.118985 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001400 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 15:25:38.118985 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001404 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 15:25:38.118985 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001407 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 15:25:38.118985 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001409 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 15:25:38.118985 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001414 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 15:25:38.118985 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001436 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 15:25:38.118985 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001441 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 15:25:38.118985 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001446 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 15:25:38.118985 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001451 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 15:25:38.118985 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001455 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 15:25:38.118985 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001458 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 15:25:38.118985 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001461 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 15:25:38.118985 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001463 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 15:25:38.118985 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001466 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 15:25:38.118985 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001469 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 15:25:38.118985 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001471 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 15:25:38.118985 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001475 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 15:25:38.118985 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001477 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 15:25:38.119752 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001480 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 15:25:38.119752 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001483 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 15:25:38.119752 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001486 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 15:25:38.119752 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001488 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 15:25:38.119752 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001490 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 15:25:38.119752 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001493 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 15:25:38.119752 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001496 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 15:25:38.119752 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001498 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 15:25:38.119752 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001500 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 15:25:38.119752 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001503 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 15:25:38.119752 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001505 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 15:25:38.119752 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001509 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 15:25:38.119752 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001511 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 15:25:38.119752 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001515 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 15:25:38.119752 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001517 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 15:25:38.119752 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001520 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 15:25:38.119752 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001522 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 15:25:38.119752 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001526 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 15:25:38.119752 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001529 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 15:25:38.119752 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001531 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 15:25:38.120614 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001533 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 15:25:38.120614 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001536 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 15:25:38.120614 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001539 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 15:25:38.120614 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001542 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 15:25:38.120614 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001545 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 15:25:38.120614 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001549 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 15:25:38.120614 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001552 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 15:25:38.120614 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001556 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 15:25:38.120614 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001558 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 15:25:38.120614 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001561 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 15:25:38.120614 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001564 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 15:25:38.120614 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001567 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 15:25:38.120614 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.001569 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 15:25:38.120614 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002305 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 15:25:38.120614 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002312 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 15:25:38.120614 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002315 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 15:25:38.120614 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002318 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 15:25:38.120614 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002320 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 15:25:38.120614 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002323 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 15:25:38.121655 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002326 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 15:25:38.121655 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002328 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 06 15:25:38.121655 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002331 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 15:25:38.121655 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002333 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 15:25:38.121655 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002336 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 15:25:38.121655 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002338 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 15:25:38.121655 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002341 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 15:25:38.121655 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002344 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 15:25:38.121655 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002347 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 15:25:38.121655 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002349 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 15:25:38.121655 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002352 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 15:25:38.121655 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002355 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 15:25:38.121655 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002357 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 15:25:38.121655 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002360 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 15:25:38.121655 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002363 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 15:25:38.121655 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002366 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 15:25:38.121655 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002369 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 15:25:38.121655 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002372 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 15:25:38.121655 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002374 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 15:25:38.121655 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002377 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 15:25:38.122865 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002380 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 15:25:38.122865 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002383 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 15:25:38.122865 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002385 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 15:25:38.122865 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002388 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 15:25:38.122865 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002391 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 15:25:38.122865 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002393 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 15:25:38.122865 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002396 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 15:25:38.122865 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002398 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 15:25:38.122865 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002401 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 15:25:38.122865 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002404 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 15:25:38.122865 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002406 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 15:25:38.122865 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002408 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 15:25:38.122865 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002411 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 15:25:38.122865 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002413 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 15:25:38.122865 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002416 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 15:25:38.122865 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002433 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 15:25:38.122865 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002436 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 15:25:38.122865 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002439 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 15:25:38.122865 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002441 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 15:25:38.122865 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002444 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 15:25:39.550777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002447 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 15:25:39.550777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002450 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 15:25:39.550777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002453 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 15:25:39.550777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002456 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 15:25:39.550777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002460 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 15:25:39.550777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002465 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 15:25:39.550777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002469 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 15:25:39.550777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002471 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 15:25:39.550777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002474 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 15:25:39.550777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002477 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 15:25:39.550777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002480 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 15:25:39.550777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002483 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 15:25:39.550777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002485 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 15:25:39.550777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002487 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 15:25:39.550777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002490 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 15:25:39.550777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002493 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 15:25:39.550777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002495 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 15:25:39.550777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002498 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 15:25:39.550777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002500 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 15:25:39.567819 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002502 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 15:25:39.567819 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002505 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 15:25:39.567819 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002507 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 15:25:39.567819 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002510 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 15:25:39.567819 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002512 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 15:25:39.567819 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002516 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 15:25:39.567819 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002518 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 15:25:39.567819 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002521 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 15:25:39.567819 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002524 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 15:25:39.567819 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002526 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 15:25:39.567819 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002529 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 15:25:39.567819 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002531 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 15:25:39.567819 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002534 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 15:25:39.567819 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002537 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 15:25:39.567819 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002539 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 15:25:39.567819 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002542 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 15:25:39.567819 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002545 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 15:25:39.567819 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002548 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 15:25:39.567819 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002551 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 15:25:39.567819 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002554 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 15:25:39.568613 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002558 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 15:25:39.568613 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002562 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 15:25:39.568613 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002565 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 15:25:39.568613 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002568 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 15:25:39.568613 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002570 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 15:25:39.568613 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002572 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 15:25:39.568613 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002574 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 15:25:39.568613 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002577 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 15:25:39.568613 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002579 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 15:25:39.568613 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002583 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 15:25:39.568613 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002586 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 15:25:39.568613 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002589 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 15:25:39.568613 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002593 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 15:25:39.568613 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002596 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 15:25:39.568613 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002979 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 15:25:39.568613 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002983 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 15:25:39.568613 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002987 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 15:25:39.568613 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002990 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 15:25:39.568613 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002993 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 15:25:39.569520 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002995 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 15:25:39.569520 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.002998 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 15:25:39.569520 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003000 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 15:25:39.569520 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003003 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 15:25:39.569520 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003006 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 15:25:39.569520 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003009 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 15:25:39.569520 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003011 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 15:25:39.569520 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003015 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 15:25:39.569520 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003018 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 15:25:39.569520 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003020 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 15:25:39.569520 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003023 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 15:25:39.569520 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003027 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 15:25:39.569520 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003029 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 15:25:39.569520 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003033 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 15:25:39.569520 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003036 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 15:25:39.569520 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003038 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 15:25:39.569520 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003041 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 15:25:39.569520 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003044 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 15:25:39.569520 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003046 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 15:25:39.569520 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003049 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 15:25:39.569520 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003051 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 15:25:39.570237 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003054 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 15:25:39.570237 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003056 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 15:25:39.570237 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003059 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 15:25:39.570237 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003061 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 15:25:39.570237 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003064 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 15:25:39.570237 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003066 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 15:25:39.570237 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003069 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 15:25:39.570237 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003072 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 15:25:39.570237 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003074 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 15:25:39.570237 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003077 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 15:25:39.570237 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003079 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 15:25:39.570237 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003082 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 15:25:39.570237 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003085 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 15:25:39.570237 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003087 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 15:25:39.570237 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003090 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 15:25:39.570237 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003093 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 15:25:39.570237 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003095 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 15:25:39.570237 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003098 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 15:25:39.570237 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003101 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 15:25:39.570777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003103 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 15:25:39.570777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003106 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 15:25:39.570777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003109 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 15:25:39.570777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003111 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 15:25:39.570777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003114 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 15:25:39.570777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003117 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 15:25:39.570777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003119 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 15:25:39.570777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003122 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 15:25:39.570777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003124 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 15:25:39.570777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003126 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 15:25:39.570777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003129 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 15:25:39.570777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003131 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 15:25:39.570777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003135 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 15:25:39.570777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003137 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 15:25:39.570777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003139 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 15:25:39.570777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003142 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 15:25:39.570777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003144 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 15:25:39.570777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003147 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 15:25:39.570777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003149 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 15:25:39.570777 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003151 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 15:25:39.571499 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003154 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 06 15:25:39.571499 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003157 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 15:25:39.571499 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003159 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 15:25:39.571499 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003161 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 15:25:39.571499 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003164 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 15:25:39.571499 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003167 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 15:25:39.571499 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003169 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 15:25:39.571499 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003174 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 15:25:39.571499 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003177 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 15:25:39.571499 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003180 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 15:25:39.571499 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003182 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 15:25:39.571499 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003185 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 15:25:39.571499 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003189 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 15:25:39.571499 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003193 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 15:25:39.571499 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003196 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 15:25:39.571499 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003199 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 15:25:39.571499 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003203 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 15:25:39.571499 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003207 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 15:25:39.571499 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003210 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 15:25:39.572130 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003215 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 15:25:39.572130 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003218 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 15:25:39.572130 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003222 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 15:25:39.572130 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003225 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 15:25:39.572130 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003228 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 15:25:39.572130 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003231 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 15:25:39.572130 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003234 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 15:25:39.572130 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003236 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 15:25:39.572130 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003238 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 15:25:39.572130 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003241 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 15:25:39.572130 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003244 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 15:25:39.572130 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003246 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 15:25:39.572130 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003248 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 15:25:39.572130 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003250 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 15:25:39.572130 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003253 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 15:25:39.572130 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003324 2573 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 15:25:39.572130 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003331 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 15:25:39.572130 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003338 2573 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 15:25:39.572130 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003342 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 15:25:39.572130 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003346 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 15:25:39.572130 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003353 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 15:25:39.572773 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003358 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 15:25:39.572773 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003363 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 15:25:39.572773 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003366 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 15:25:39.572773 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003369 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 15:25:39.572773 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003372 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 15:25:39.572773 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003375 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 15:25:39.572773 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003378 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 15:25:39.572773 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003381 2573 flags.go:64] FLAG: --cgroup-root="" Jul 06 15:25:39.572773 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003384 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 15:25:39.572773 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003387 2573 flags.go:64] FLAG: --client-ca-file="" Jul 06 15:25:39.572773 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003391 2573 flags.go:64] FLAG: --cloud-provider="external" Jul 06 15:25:39.572773 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003393 2573 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 15:25:39.572773 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003398 2573 flags.go:64] FLAG: --cluster-domain="" Jul 06 15:25:39.572773 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003401 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 15:25:39.572773 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003404 2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 15:25:39.572773 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003408 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 15:25:39.572773 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003411 2573 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 15:25:39.572773 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003414 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 15:25:39.572773 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003430 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 15:25:39.572773 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003434 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 15:25:39.572773 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003437 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 15:25:39.572773 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003440 2573 flags.go:64] FLAG: --contention-profiling="false" Jul 06 15:25:39.572773 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003443 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 15:25:39.572773 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003446 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 15:25:39.573447 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003449 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 15:25:39.573447 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003452 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 15:25:39.573447 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003456 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 15:25:39.573447 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003460 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 15:25:39.573447 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003462 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 15:25:39.573447 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003466 2573 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 15:25:39.573447 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003469 2573 flags.go:64] FLAG: --enable-server="true" Jul 06 15:25:39.573447 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003473 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 15:25:39.573447 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003478 2573 flags.go:64] FLAG: --event-burst="100" Jul 06 15:25:39.573447 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003481 2573 flags.go:64] FLAG: --event-qps="50" Jul 06 15:25:39.573447 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003484 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 15:25:39.573447 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003487 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 15:25:39.573447 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003490 2573 flags.go:64] FLAG: --eviction-hard="" Jul 06 15:25:39.573447 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003494 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 15:25:39.573447 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003497 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 15:25:39.573447 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003500 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 15:25:39.573447 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003503 2573 flags.go:64] FLAG: --eviction-soft="" Jul 06 15:25:39.573447 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003506 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 15:25:39.573447 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003509 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 15:25:39.573447 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003512 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 15:25:39.573447 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003515 2573 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 15:25:39.573447 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003518 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 15:25:39.573447 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003521 2573 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 15:25:39.573447 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003523 2573 flags.go:64] FLAG: --feature-gates="" Jul 06 15:25:39.573447 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003530 2573 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 15:25:39.574274 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003533 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 15:25:39.574274 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003536 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 15:25:39.574274 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003539 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 15:25:39.574274 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003542 2573 flags.go:64] FLAG: --healthz-port="10248" Jul 06 15:25:39.574274 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003545 2573 flags.go:64] FLAG: --help="false" Jul 06 15:25:39.574274 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003548 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-143-129.ec2.internal" Jul 06 15:25:39.574274 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003551 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 15:25:39.574274 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003554 2573 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 15:25:39.574274 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003557 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 15:25:39.574274 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003560 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 15:25:39.574274 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003564 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 15:25:39.574274 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003567 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 15:25:39.574274 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003570 2573 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 15:25:39.574274 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003572 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 15:25:39.574274 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003577 2573 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 15:25:39.574274 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003584 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 15:25:39.574274 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003587 2573 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 15:25:39.574274 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003590 2573 flags.go:64] FLAG: --kube-reserved="" Jul 06 15:25:39.574274 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003593 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 15:25:39.574274 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003596 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 15:25:39.574274 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003600 2573 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 15:25:39.574274 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003603 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 15:25:39.574274 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003605 2573 flags.go:64] FLAG: --lock-file="" Jul 06 15:25:39.574274 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003608 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 15:25:39.574961 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003611 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 15:25:39.574961 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003614 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 15:25:39.574961 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003619 2573 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 15:25:39.574961 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003623 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 15:25:39.574961 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003626 2573 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 15:25:39.574961 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003629 2573 flags.go:64] FLAG: --logging-format="text" Jul 06 15:25:39.574961 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003632 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 15:25:39.574961 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003635 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 15:25:39.574961 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003637 2573 flags.go:64] FLAG: --manifest-url="" Jul 06 15:25:39.574961 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003640 2573 flags.go:64] FLAG: --manifest-url-header="" Jul 06 15:25:39.574961 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003645 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 15:25:39.574961 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003648 2573 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 15:25:39.574961 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003652 2573 flags.go:64] FLAG: --max-pods="110" Jul 06 15:25:39.574961 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003655 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 15:25:39.574961 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003658 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 15:25:39.574961 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003661 2573 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 15:25:39.574961 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003663 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 15:25:39.574961 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003666 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 15:25:39.574961 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003669 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 15:25:39.574961 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003672 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 15:25:39.574961 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003679 2573 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 15:25:39.574961 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003682 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 15:25:39.574961 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003686 2573 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 15:25:39.574961 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003691 2573 flags.go:64] FLAG: --pod-cidr="" Jul 06 15:25:39.575609 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003694 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 15:25:39.575609 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003699 2573 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 15:25:39.575609 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003702 2573 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 15:25:39.575609 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003706 2573 flags.go:64] FLAG: --pods-per-core="0" Jul 06 15:25:39.575609 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003709 2573 flags.go:64] FLAG: --port="10250" Jul 06 15:25:39.575609 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003712 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 15:25:39.575609 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003715 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0456bb1c0ca328d54" Jul 06 15:25:39.575609 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003718 2573 flags.go:64] FLAG: --qos-reserved="" Jul 06 15:25:39.575609 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003721 2573 flags.go:64] FLAG: --read-only-port="10255" Jul 06 15:25:39.575609 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003724 2573 flags.go:64] FLAG: --register-node="true" Jul 06 15:25:39.575609 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003727 2573 flags.go:64] FLAG: --register-with-taints="" Jul 06 15:25:39.575609 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003730 2573 flags.go:64] FLAG: --registry-burst="10" Jul 06 15:25:39.575609 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003733 2573 flags.go:64] FLAG: --registry-qps="5" Jul 06 15:25:39.575609 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003736 2573 flags.go:64] FLAG: --reserved-cpus="" Jul 06 15:25:39.575609 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003739 2573 flags.go:64] FLAG: --reserved-memory="" Jul 06 15:25:39.575609 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003743 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 15:25:39.575609 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003746 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 15:25:39.575609 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003749 2573 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 15:25:39.575609 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003752 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 15:25:39.575609 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003754 2573 flags.go:64] FLAG: --runonce="false" Jul 06 15:25:39.575609 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003757 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 15:25:39.575609 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003760 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 15:25:39.575609 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003763 2573 flags.go:64] FLAG: --seccomp-default="false" Jul 06 15:25:39.575609 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003766 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 15:25:39.575609 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003768 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 15:25:39.576350 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003771 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 15:25:39.576350 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003774 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 15:25:39.576350 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003777 2573 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 15:25:39.576350 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003780 2573 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 15:25:39.576350 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003783 2573 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 15:25:39.576350 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003786 2573 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 15:25:39.576350 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003791 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 15:25:39.576350 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003794 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 15:25:39.576350 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003797 2573 flags.go:64] FLAG: --system-cgroups="" Jul 06 15:25:39.576350 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003800 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 15:25:39.576350 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003805 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 15:25:39.576350 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003808 2573 flags.go:64] FLAG: --tls-cert-file="" Jul 06 15:25:39.576350 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003811 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 15:25:39.576350 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003815 2573 flags.go:64] FLAG: --tls-min-version="" Jul 06 15:25:39.576350 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003818 2573 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 15:25:39.576350 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003821 2573 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 15:25:39.576350 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003823 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 15:25:39.576350 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003826 2573 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 15:25:39.576350 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003829 2573 flags.go:64] FLAG: --v="2" Jul 06 15:25:39.576350 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003834 2573 flags.go:64] FLAG: --version="false" Jul 06 15:25:39.576350 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003838 2573 flags.go:64] FLAG: --vmodule="" Jul 06 15:25:39.576350 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003842 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 15:25:39.576350 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.003845 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 15:25:39.576350 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003954 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 15:25:39.576350 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003958 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 15:25:39.577005 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003961 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 15:25:39.577005 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003964 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 15:25:39.577005 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003967 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 15:25:39.577005 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003969 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 15:25:39.577005 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003972 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 15:25:39.577005 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003974 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 15:25:39.577005 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003977 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 15:25:39.577005 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003979 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 15:25:39.577005 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003982 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 15:25:39.577005 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003984 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 15:25:39.577005 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003987 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 15:25:39.577005 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003989 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 15:25:39.577005 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003992 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 15:25:39.577005 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.003997 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 15:25:39.577005 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004000 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 15:25:39.577005 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004002 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 15:25:39.577005 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004005 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 15:25:39.577005 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004007 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 06 15:25:39.577005 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004010 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 15:25:39.577005 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004012 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 15:25:39.577621 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004015 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 15:25:39.577621 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004017 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 15:25:39.577621 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004020 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 15:25:39.577621 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004023 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 15:25:39.577621 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004025 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 15:25:39.577621 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004028 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 15:25:39.577621 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004030 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 15:25:39.577621 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004033 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 15:25:39.577621 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004037 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 15:25:39.577621 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004040 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 15:25:39.577621 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004042 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 15:25:39.577621 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004045 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 15:25:39.577621 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004047 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 15:25:39.577621 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004050 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 15:25:39.577621 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004052 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 15:25:39.577621 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004055 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 15:25:39.577621 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004058 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 15:25:39.577621 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004060 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 15:25:39.577621 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004063 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 15:25:39.577621 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004065 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 15:25:39.578203 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004068 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 15:25:39.578203 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004070 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 15:25:39.578203 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004073 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 15:25:39.578203 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004075 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 15:25:39.578203 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004078 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 15:25:39.578203 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004083 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 15:25:39.578203 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004087 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 15:25:39.578203 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004090 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 15:25:39.578203 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004093 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 15:25:39.578203 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004095 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 15:25:39.578203 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004098 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 15:25:39.578203 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004101 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 15:25:39.578203 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004103 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 15:25:39.578203 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004106 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 15:25:39.578203 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004108 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 15:25:39.578203 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004111 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 15:25:39.578203 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004114 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 15:25:39.578203 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004118 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 15:25:39.578203 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004120 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 15:25:39.578735 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004123 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 15:25:39.578735 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004126 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 15:25:39.578735 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004129 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 15:25:39.578735 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004131 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 15:25:39.578735 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004134 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 15:25:39.578735 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004138 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 15:25:39.578735 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004141 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 15:25:39.578735 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004144 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 15:25:39.578735 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004147 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 15:25:39.578735 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004149 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 15:25:39.578735 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004152 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 15:25:39.578735 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004155 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 15:25:39.578735 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004158 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 15:25:39.578735 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004161 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 15:25:39.578735 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004163 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 15:25:39.578735 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004165 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 15:25:39.578735 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004168 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 15:25:39.578735 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004170 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 15:25:39.578735 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004175 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 15:25:39.579295 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004177 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 15:25:39.579295 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004180 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 15:25:39.579295 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004182 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 15:25:39.579295 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004185 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 15:25:39.579295 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004188 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 15:25:39.579295 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004190 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 15:25:39.579295 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004192 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 15:25:39.579295 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004195 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 15:25:39.579295 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004197 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 15:25:39.579295 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004200 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 15:25:39.579295 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004203 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 15:25:39.579295 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004206 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 15:25:39.579295 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004208 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 15:25:39.579295 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004211 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 15:25:39.579295 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004213 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 15:25:39.579295 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004216 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 15:25:39.579295 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004219 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 15:25:39.579295 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004221 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 15:25:39.579295 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.004224 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 15:25:39.579992 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.004910 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 15:25:39.579992 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.012411 2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 15:25:39.579992 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.012440 2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 15:25:39.579992 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.012464 2573 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 15:25:39.579992 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.012472 2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 15:25:39.579992 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012547 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 15:25:39.579992 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012553 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 15:25:39.579992 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012557 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 15:25:39.579992 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012561 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 15:25:39.579992 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012566 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 15:25:39.579992 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012570 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 15:25:39.579992 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012574 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 15:25:39.579992 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012580 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 15:25:39.579992 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012584 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 15:25:39.579992 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012588 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 15:25:39.580612 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012592 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 15:25:39.580612 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012599 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 15:25:39.580612 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012603 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 15:25:39.580612 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012609 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 15:25:39.580612 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012613 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 15:25:39.580612 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012617 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 15:25:39.580612 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012621 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 15:25:39.580612 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012625 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 06 15:25:39.580612 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012629 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 15:25:39.580612 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012633 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 15:25:39.580612 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012637 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 15:25:39.580612 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012641 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 15:25:39.580612 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012644 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 15:25:39.580612 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012649 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 15:25:39.580612 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012653 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 15:25:39.580612 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012657 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 15:25:39.580612 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012661 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 15:25:39.580612 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012665 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 15:25:39.580612 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012668 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 15:25:39.581427 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012672 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 15:25:39.581427 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012676 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 15:25:39.581427 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012680 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 15:25:39.581427 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012684 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 15:25:39.581427 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012688 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 15:25:39.581427 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012691 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 15:25:39.581427 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012694 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 15:25:39.581427 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012699 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 15:25:39.581427 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012702 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 15:25:39.581427 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012706 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 15:25:39.581427 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012711 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 15:25:39.581427 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012715 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 15:25:39.581427 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012719 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 15:25:39.581427 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012723 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 15:25:39.581427 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012727 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 15:25:39.581427 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012730 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 15:25:39.581427 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012734 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 15:25:39.581427 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012738 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 15:25:39.581427 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012742 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 15:25:39.581427 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012745 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 15:25:39.582635 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012749 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 15:25:39.582635 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012753 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 15:25:39.582635 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012756 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 15:25:39.582635 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012760 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 15:25:39.582635 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012765 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 15:25:39.582635 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012768 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 15:25:39.582635 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012772 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 15:25:39.582635 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012776 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 15:25:39.582635 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012780 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 15:25:39.582635 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012783 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 15:25:39.582635 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012787 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 15:25:39.582635 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012790 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 15:25:39.582635 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012794 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 15:25:39.582635 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012797 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 15:25:39.582635 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012801 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 15:25:39.582635 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012805 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 15:25:39.582635 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012808 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 15:25:39.582635 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012811 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 15:25:39.582635 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012815 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 15:25:39.582635 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012819 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 15:25:39.583210 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012823 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 15:25:39.583210 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012827 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 15:25:39.583210 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012834 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 15:25:39.583210 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012839 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 15:25:39.583210 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012843 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 15:25:39.583210 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012848 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 15:25:39.583210 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012852 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 15:25:39.583210 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012856 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 15:25:39.583210 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012860 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 15:25:39.583210 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012864 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 15:25:39.583210 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012869 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 15:25:39.583210 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012874 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 15:25:39.583210 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012878 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 15:25:39.583210 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012881 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 15:25:39.583210 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012885 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 15:25:39.583210 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012889 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 15:25:39.583210 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012893 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 15:25:39.583210 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012896 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 15:25:39.583210 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012900 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 15:25:39.785633 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012906 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 15:25:39.785633 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012910 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 15:25:39.785633 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012915 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 15:25:39.785633 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012918 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 15:25:39.785633 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012922 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 15:25:39.785633 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012926 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 15:25:39.785633 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012929 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 15:25:39.785633 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012933 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 15:25:39.785633 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012937 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 15:25:39.785633 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012940 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 15:25:39.785633 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.012944 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 15:25:39.785633 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.012951 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 15:25:39.785633 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013103 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 15:25:39.785633 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013109 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 15:25:39.786631 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013114 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 15:25:39.786631 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013126 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 15:25:39.786631 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013132 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 15:25:39.786631 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013137 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 15:25:39.786631 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013141 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 15:25:39.786631 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013145 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 15:25:39.786631 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013149 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 15:25:39.786631 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013153 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 06 15:25:39.786631 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013158 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 15:25:39.786631 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013164 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 15:25:39.786631 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013168 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 15:25:39.786631 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013172 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 15:25:39.786631 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013175 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 15:25:39.786631 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013179 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 15:25:39.786631 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013183 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 15:25:39.786631 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013187 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 15:25:39.786631 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013192 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 15:25:39.786631 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013196 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 15:25:39.786631 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013202 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 15:25:39.787290 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013206 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 15:25:39.787290 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013210 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 15:25:39.787290 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013214 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 15:25:39.787290 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013218 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 15:25:39.787290 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013222 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 15:25:39.787290 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013225 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 15:25:39.787290 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013229 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 15:25:39.787290 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013233 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 15:25:39.787290 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013236 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 15:25:39.787290 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013240 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 15:25:39.787290 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013244 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 15:25:39.787290 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013248 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 15:25:39.787290 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013253 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 15:25:39.787290 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013258 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 15:25:39.787290 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013263 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 15:25:39.787290 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013269 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 15:25:39.787290 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013273 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 15:25:39.787290 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013277 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 15:25:39.787290 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013281 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 15:25:39.787842 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013286 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 15:25:39.787842 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013289 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 15:25:39.787842 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013293 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 15:25:39.787842 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013298 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 15:25:39.787842 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013302 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 15:25:39.787842 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013306 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 15:25:39.787842 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013309 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 15:25:39.787842 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013313 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 15:25:39.787842 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013316 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 15:25:39.787842 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013320 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 15:25:39.787842 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013324 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 15:25:39.787842 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013327 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 15:25:39.787842 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013331 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 15:25:39.787842 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013335 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 15:25:39.787842 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013338 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 15:25:39.787842 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013342 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 15:25:39.787842 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013347 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 15:25:39.787842 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013350 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 15:25:39.787842 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013354 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 15:25:39.787842 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013358 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 15:25:39.788464 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013363 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 15:25:39.788464 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013367 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 15:25:39.788464 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013370 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 15:25:39.788464 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013374 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 15:25:39.788464 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013378 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 15:25:39.788464 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013382 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 15:25:39.788464 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013385 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 15:25:39.788464 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013389 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 15:25:39.788464 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013394 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 15:25:39.788464 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013398 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 15:25:39.788464 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013402 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 15:25:39.788464 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013405 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 15:25:39.788464 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013409 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 15:25:39.788464 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013413 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 15:25:39.788464 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013416 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 15:25:39.788464 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013435 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 15:25:39.788464 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013439 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 15:25:39.788464 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013443 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 15:25:39.788464 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013447 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 15:25:39.788464 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013451 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 15:25:39.788990 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013454 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 15:25:39.788990 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013458 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 15:25:39.788990 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013462 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 15:25:39.788990 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013466 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 15:25:39.788990 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013470 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 15:25:39.788990 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013474 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 15:25:39.788990 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013477 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 15:25:39.788990 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013482 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 15:25:39.788990 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013486 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 15:25:39.788990 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013490 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 15:25:39.788990 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013494 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 15:25:39.788990 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013498 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 15:25:39.788990 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013502 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 15:25:39.788990 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013506 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 15:25:39.788990 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013509 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 15:25:39.788990 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013513 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 15:25:39.788990 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013517 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 15:25:39.788990 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013521 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 15:25:39.788990 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:38.013524 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 15:25:39.789536 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.013531 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 15:25:39.789536 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.013661 2573 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 15:25:39.789536 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.018494 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 15:25:39.789536 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.020294 2573 server.go:1019] "Starting client certificate rotation" Jul 06 15:25:39.789536 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.020396 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 15:25:39.789536 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.020445 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 15:25:39.789536 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.024069 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 15:25:39.789536 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.034405 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 15:25:39.789536 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.046932 2573 log.go:25] "Validated CRI v1 runtime API" Jul 06 15:25:39.789536 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.048950 2573 log.go:25] "Validated CRI v1 image API" Jul 06 15:25:39.789536 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.049735 2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 15:25:39.789536 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.052966 2573 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9a8d3588-993c-4c66-8861-9120c200133e:/dev/nvme0n1p4 cb0f4d59-53ef-4ddd-ab7f-acf4c5497648:/dev/nvme0n1p3] Jul 06 15:25:39.789975 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.052981 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 15:25:39.790094 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.058056 2573 manager.go:216] Machine: {Timestamp:2026-07-06 15:25:38.056800237 +0000 UTC m=+0.424473745 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3092452 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fe429f6a9e2d9229459d7a4a05be7 SystemUUID:ec2fe429-f6a9-e2d9-2294-59d7a4a05be7 BootID:3463a875-13c2-4e3d-a9b3-bd436306f783 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:11:bf:52:98:23 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:11:bf:52:98:23 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:b4:23:b3:28:a4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 15:25:39.790094 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.058160 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 15:25:39.790094 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.058269 2573 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 15:25:39.790094 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.062190 2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 15:25:39.790094 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.062221 2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-129.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 15:25:39.790094 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.062898 2573 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 15:25:39.790094 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.062908 2573 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 15:25:39.790094 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.062915 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.063501 2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.064735 2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.065271 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.068313 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.068452 2573 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.068485 2573 kubelet.go:486] "Attempting to sync node with API server" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.068497 2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.068511 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.068520 2573 kubelet.go:398] "Adding apiserver pod source" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.068528 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.068872 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.068888 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.071661 2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.078915 2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.078944 2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.080049 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.080064 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.080071 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.080077 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.080087 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.080093 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.080101 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.080107 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.080114 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.080119 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.080127 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.080132 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.080155 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.080160 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:38.081389 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-129.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:38.081531 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.083360 2573 server.go:1268] "Started kubelet" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.083442 2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.083488 2573 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.083488 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.084692 2573 server.go:310] "Adding debug handlers to kubelet server" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.085065 2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:38.087785 2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 15:25:39.790373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.096014 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.096042 2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-129.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:38.096108 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-129.ec2.internal\" not found" Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.096182 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.096739 2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.096743 2573 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.096760 2573 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.096846 2573 reconstruct.go:97] "Volume reconstruction finished" Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.096865 2573 reconciler.go:29] "Reconciler: start to sync state" Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:38.095910 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-129.ec2.internal.18bfbcc6791a7680 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-129.ec2.internal,UID:ip-10-0-143-129.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-129.ec2.internal,},FirstTimestamp:2026-07-06 15:25:38.083329664 +0000 UTC m=+0.451003173,LastTimestamp:2026-07-06 15:25:38.083329664 +0000 UTC m=+0.451003173,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-129.ec2.internal,}" Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.097007 2573 factory.go:55] Registering systemd factory Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.097021 2573 factory.go:223] Registration of the systemd container factory successfully Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.097257 2573 factory.go:153] Registering CRI-O factory Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.097271 2573 factory.go:223] Registration of the crio container factory successfully Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.097318 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.097336 2573 factory.go:103] Registering Raw factory Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.097346 2573 manager.go:1196] Started watching for new ooms in manager Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.097772 2573 manager.go:349] Starting recovery of all containers Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:38.103502 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:38.103517 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-129.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.108617 2573 manager.go:354] Recovery completed Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.116816 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.118771 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-129.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.118797 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-129.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.118806 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-129.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.119319 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.119325 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.119339 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.119344 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.120126 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-129.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.120153 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-129.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.120162 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-129.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:25:39.791410 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.120646 2573 policy_none.go:49] "None policy: Start" Jul 06 15:25:39.792366 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.120662 2573 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 15:25:39.792366 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.120677 2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 15:25:39.792366 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:38.120948 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-129.ec2.internal.18bfbcc67b377637 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-129.ec2.internal,UID:ip-10-0-143-129.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-129.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-129.ec2.internal,},FirstTimestamp:2026-07-06 15:25:38.118784567 +0000 UTC m=+0.486458075,LastTimestamp:2026-07-06 15:25:38.118784567 +0000 UTC m=+0.486458075,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-129.ec2.internal,}" Jul 06 15:25:39.792366 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.125457 2573 policy_none.go:47] "Start" Jul 06 15:25:39.792366 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:38.132232 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-129.ec2.internal.18bfbcc67b37b898 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-129.ec2.internal,UID:ip-10-0-143-129.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-129.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-129.ec2.internal,},FirstTimestamp:2026-07-06 15:25:38.11880156 +0000 UTC m=+0.486475067,LastTimestamp:2026-07-06 15:25:38.11880156 +0000 UTC m=+0.486475067,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-129.ec2.internal,}" Jul 06 15:25:39.792366 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:38.144647 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-129.ec2.internal.18bfbcc67b37da6f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-129.ec2.internal,UID:ip-10-0-143-129.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-129.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-129.ec2.internal,},FirstTimestamp:2026-07-06 15:25:38.118810223 +0000 UTC m=+0.486483730,LastTimestamp:2026-07-06 15:25:38.118810223 +0000 UTC m=+0.486483730,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-129.ec2.internal,}" Jul 06 15:25:39.792366 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.148210 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vzlnx" Jul 06 15:25:39.792366 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.158951 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vzlnx" Jul 06 15:25:39.792366 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:38.160566 2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-129.ec2.internal.18bfbcc67b377637\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-129.ec2.internal.18bfbcc67b377637 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-129.ec2.internal,UID:ip-10-0-143-129.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-129.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-129.ec2.internal,},FirstTimestamp:2026-07-06 15:25:38.118784567 +0000 UTC m=+0.486458075,LastTimestamp:2026-07-06 15:25:38.12013867 +0000 UTC m=+0.487812178,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-129.ec2.internal,}" Jul 06 15:25:39.792366 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.165966 2573 manager.go:337] "Starting Device Plugin manager" Jul 06 15:25:39.792366 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:38.165991 2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 15:25:39.792366 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.166000 2573 server.go:87] "Starting device plugin registration server" Jul 06 15:25:39.792366 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.166239 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.166249 2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.166349 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.166416 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:38.166438 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:38.166941 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:38.166995 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-129.ec2.internal\" not found" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.489858 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.491065 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.491110 2573 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.491131 2573 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:39.491163 2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.497534 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.512136 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.513228 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-129.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.513260 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-129.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.513274 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-129.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.513299 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-129.ec2.internal" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.526433 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-129.ec2.internal" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:39.526450 2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-129.ec2.internal\": node \"ip-10-0-143-129.ec2.internal\" not found" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:39.569845 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-129.ec2.internal\" not found" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.591886 2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-129.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-129.ec2.internal"] Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.591943 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.592788 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-129.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.592815 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-129.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.592824 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-129.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.594736 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.594840 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-129.ec2.internal" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.594868 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.595398 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-129.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.595402 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-129.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.595423 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-129.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.595441 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-129.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.595454 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-129.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.595475 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-129.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:25:39.792780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.601003 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-129.ec2.internal" Jul 06 15:25:39.793799 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.601027 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:25:39.793799 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.601697 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-129.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:25:39.793799 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.601721 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-129.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:25:39.793799 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.601733 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-129.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:25:39.793799 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:39.620557 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-129.ec2.internal\" not found" node="ip-10-0-143-129.ec2.internal" Jul 06 15:25:39.793799 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:39.625631 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-129.ec2.internal\" not found" node="ip-10-0-143-129.ec2.internal" Jul 06 15:25:39.793799 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.640261 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7cbb15a3b59006910713defe15de5c17-config\") pod \"kube-apiserver-proxy-ip-10-0-143-129.ec2.internal\" (UID: \"7cbb15a3b59006910713defe15de5c17\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-129.ec2.internal" Jul 06 15:25:39.793799 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.640282 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/90709f330b9c67d8d7962607bcb49842-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-129.ec2.internal\" (UID: \"90709f330b9c67d8d7962607bcb49842\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-129.ec2.internal" Jul 06 15:25:39.793799 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.640305 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90709f330b9c67d8d7962607bcb49842-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-129.ec2.internal\" (UID: \"90709f330b9c67d8d7962607bcb49842\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-129.ec2.internal" Jul 06 15:25:39.793799 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:39.670565 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-129.ec2.internal\" not found" Jul 06 15:25:39.793799 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.740393 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7cbb15a3b59006910713defe15de5c17-config\") pod \"kube-apiserver-proxy-ip-10-0-143-129.ec2.internal\" (UID: \"7cbb15a3b59006910713defe15de5c17\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-129.ec2.internal" Jul 06 15:25:39.793799 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.740414 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/90709f330b9c67d8d7962607bcb49842-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-129.ec2.internal\" (UID: \"90709f330b9c67d8d7962607bcb49842\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-129.ec2.internal" Jul 06 15:25:39.793799 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.740430 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90709f330b9c67d8d7962607bcb49842-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-129.ec2.internal\" (UID: \"90709f330b9c67d8d7962607bcb49842\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-129.ec2.internal" Jul 06 15:25:39.793799 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.740454 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90709f330b9c67d8d7962607bcb49842-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-129.ec2.internal\" (UID: \"90709f330b9c67d8d7962607bcb49842\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-129.ec2.internal" Jul 06 15:25:39.793799 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.740482 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7cbb15a3b59006910713defe15de5c17-config\") pod \"kube-apiserver-proxy-ip-10-0-143-129.ec2.internal\" (UID: \"7cbb15a3b59006910713defe15de5c17\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-129.ec2.internal" Jul 06 15:25:39.793799 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.740514 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/90709f330b9c67d8d7962607bcb49842-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-129.ec2.internal\" (UID: \"90709f330b9c67d8d7962607bcb49842\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-129.ec2.internal" Jul 06 15:25:39.793799 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:39.771295 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-129.ec2.internal\" not found" Jul 06 15:25:39.888821 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:39.871493 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-129.ec2.internal\" not found" Jul 06 15:25:39.951358 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.925667 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-129.ec2.internal" Jul 06 15:25:39.951358 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:39.928830 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-129.ec2.internal" Jul 06 15:25:40.089998 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:39.972199 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-129.ec2.internal\" not found" Jul 06 15:25:40.089998 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:40.072744 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-129.ec2.internal\" not found" Jul 06 15:25:40.192180 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:40.173210 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-129.ec2.internal\" not found" Jul 06 15:25:40.383906 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.261801 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 15:25:40.383906 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.261940 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 15:25:40.383906 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:40.274066 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-129.ec2.internal\" not found" Jul 06 15:25:40.383906 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.283511 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 15:25:40.383906 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.311509 2573 apiserver.go:52] "Watching apiserver" Jul 06 15:25:40.383906 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.322015 2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 15:25:40.383906 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.324431 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-8zjj5","openshift-dns/node-resolver-s6nb2","openshift-image-registry/node-ca-wrhr9","openshift-multus/multus-additional-cni-plugins-9mdzh","openshift-multus/network-metrics-daemon-jr4kq","openshift-network-diagnostics/network-check-target-4sjhx","openshift-ovn-kubernetes/ovnkube-node-hxm84","kube-system/global-pull-secret-syncer-slsrs","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5nhz","openshift-multus/multus-w6h2h","openshift-network-operator/iptables-alerter-klk7w","kube-system/konnectivity-agent-b97pn"] Jul 06 15:25:40.383906 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.325945 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.383906 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.327309 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s6nb2" Jul 06 15:25:40.383906 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.328707 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wrhr9" Jul 06 15:25:40.383906 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.330430 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9mdzh" Jul 06 15:25:40.383906 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.330777 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zg965\"" Jul 06 15:25:40.383906 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.330878 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 15:25:40.383906 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.330958 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lnf8z\"" Jul 06 15:25:40.383906 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.331593 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 15:25:40.383906 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.331616 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 15:25:40.383906 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.331654 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 15:25:40.383906 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.331851 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:25:40.383906 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:40.331898 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jr4kq" podUID="20db46ed-b7f8-4846-993e-578a879360b4" Jul 06 15:25:40.383906 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.332587 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 15:25:40.383906 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.334855 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6vk5g\"" Jul 06 15:25:40.383906 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.335281 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 15:25:40.383906 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.335307 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 15:25:40.383906 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.335407 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-l4xzg\"" Jul 06 15:25:40.383906 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.335442 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 15:25:40.383906 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.335508 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 15:25:40.383906 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.335569 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 15:25:40.386832 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.335573 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 15:25:40.386832 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.335680 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 15:25:40.386832 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.336987 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:25:40.386832 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:40.337052 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sjhx" podUID="4a00dac0-28b8-435b-a6f5-807b0c734207" Jul 06 15:25:40.386832 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.338208 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.386832 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.339244 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 15:25:40.386832 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.339264 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-129.ec2.internal" Jul 06 15:25:40.386832 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.339395 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:25:40.386832 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:40.339541 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slsrs" podUID="914b7462-be30-4d19-99ba-80ee135acec7" Jul 06 15:25:40.386832 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.340743 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5nhz" Jul 06 15:25:40.386832 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.342243 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.386832 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.342399 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 15:25:40.386832 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.342445 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 15:25:40.386832 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.342608 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 15:25:40.386832 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.342670 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6qfr9\"" Jul 06 15:25:40.386832 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.342728 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 15:25:40.386832 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.343326 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 15:25:40.386832 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.343676 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 15:25:40.386832 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.343771 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf4mf\" (UniqueName: \"kubernetes.io/projected/b5f3d5ad-ce7e-467c-ab15-30f58cbda56c-kube-api-access-rf4mf\") pod \"node-ca-wrhr9\" (UID: \"b5f3d5ad-ce7e-467c-ab15-30f58cbda56c\") " pod="openshift-image-registry/node-ca-wrhr9" Jul 06 15:25:40.386832 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.343801 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-run-systemd\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.386832 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.343824 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-run-ovn\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.386832 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.343861 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n74vx\" (UniqueName: \"kubernetes.io/projected/869b9829-1278-4da3-b582-6364317623f7-kube-api-access-n74vx\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.386832 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.343887 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/54ff6682-60fa-41c6-a133-1dd32f237779-hosts-file\") pod \"node-resolver-s6nb2\" (UID: \"54ff6682-60fa-41c6-a133-1dd32f237779\") " pod="openshift-dns/node-resolver-s6nb2" Jul 06 15:25:40.387604 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.343924 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4831e24-ef2b-4453-8f59-9b1ba159a289-system-cni-dir\") pod \"multus-additional-cni-plugins-9mdzh\" (UID: \"f4831e24-ef2b-4453-8f59-9b1ba159a289\") " pod="openshift-multus/multus-additional-cni-plugins-9mdzh" Jul 06 15:25:40.387604 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.343953 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/97a51e37-eec1-4e70-9708-a8191629e753-sys-fs\") pod \"aws-ebs-csi-driver-node-x5nhz\" (UID: \"97a51e37-eec1-4e70-9708-a8191629e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5nhz" Jul 06 15:25:40.387604 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.343978 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-etc-kubernetes\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.387604 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344003 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-host-run-ovn-kubernetes\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.387604 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344058 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4831e24-ef2b-4453-8f59-9b1ba159a289-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9mdzh\" (UID: \"f4831e24-ef2b-4453-8f59-9b1ba159a289\") " pod="openshift-multus/multus-additional-cni-plugins-9mdzh" Jul 06 15:25:40.387604 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344082 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm6xc\" (UniqueName: \"kubernetes.io/projected/20db46ed-b7f8-4846-993e-578a879360b4-kube-api-access-hm6xc\") pod \"network-metrics-daemon-jr4kq\" (UID: \"20db46ed-b7f8-4846-993e-578a879360b4\") " pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:25:40.387604 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344104 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b5f3d5ad-ce7e-467c-ab15-30f58cbda56c-serviceca\") pod \"node-ca-wrhr9\" (UID: \"b5f3d5ad-ce7e-467c-ab15-30f58cbda56c\") " pod="openshift-image-registry/node-ca-wrhr9" Jul 06 15:25:40.387604 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344128 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/97a51e37-eec1-4e70-9708-a8191629e753-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x5nhz\" (UID: \"97a51e37-eec1-4e70-9708-a8191629e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5nhz" Jul 06 15:25:40.387604 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344165 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/97a51e37-eec1-4e70-9708-a8191629e753-registration-dir\") pod \"aws-ebs-csi-driver-node-x5nhz\" (UID: \"97a51e37-eec1-4e70-9708-a8191629e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5nhz" Jul 06 15:25:40.387604 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344228 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/97a51e37-eec1-4e70-9708-a8191629e753-etc-selinux\") pod \"aws-ebs-csi-driver-node-x5nhz\" (UID: \"97a51e37-eec1-4e70-9708-a8191629e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5nhz" Jul 06 15:25:40.387604 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344256 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-klk7w" Jul 06 15:25:40.387604 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344259 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-run-openvswitch\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.387604 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344284 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4831e24-ef2b-4453-8f59-9b1ba159a289-cni-binary-copy\") pod \"multus-additional-cni-plugins-9mdzh\" (UID: \"f4831e24-ef2b-4453-8f59-9b1ba159a289\") " pod="openshift-multus/multus-additional-cni-plugins-9mdzh" Jul 06 15:25:40.387604 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344334 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-etc-systemd\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.388240 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344374 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-run\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.388240 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344412 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b5f3d5ad-ce7e-467c-ab15-30f58cbda56c-host\") pod \"node-ca-wrhr9\" (UID: \"b5f3d5ad-ce7e-467c-ab15-30f58cbda56c\") " pod="openshift-image-registry/node-ca-wrhr9" Jul 06 15:25:40.388240 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344440 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.388240 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344478 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f4831e24-ef2b-4453-8f59-9b1ba159a289-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9mdzh\" (UID: \"f4831e24-ef2b-4453-8f59-9b1ba159a289\") " pod="openshift-multus/multus-additional-cni-plugins-9mdzh" Jul 06 15:25:40.388240 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344519 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-var-lib-openvswitch\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.388240 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344555 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/914b7462-be30-4d19-99ba-80ee135acec7-kubelet-config\") pod \"global-pull-secret-syncer-slsrs\" (UID: \"914b7462-be30-4d19-99ba-80ee135acec7\") " pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:25:40.388240 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344575 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/914b7462-be30-4d19-99ba-80ee135acec7-dbus\") pod \"global-pull-secret-syncer-slsrs\" (UID: \"914b7462-be30-4d19-99ba-80ee135acec7\") " pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:25:40.388240 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344609 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-etc-sysconfig\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.388240 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344638 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-etc-sysctl-d\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.388240 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344664 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-sys\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.388240 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344686 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-host\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.388240 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344717 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjnjm\" (UniqueName: \"kubernetes.io/projected/6aadfb29-c480-4157-95e2-e08d98c63411-kube-api-access-tjnjm\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.388240 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344736 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-node-log\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.388240 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344752 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f4831e24-ef2b-4453-8f59-9b1ba159a289-os-release\") pod \"multus-additional-cni-plugins-9mdzh\" (UID: \"f4831e24-ef2b-4453-8f59-9b1ba159a289\") " pod="openshift-multus/multus-additional-cni-plugins-9mdzh" Jul 06 15:25:40.388760 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344766 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/97a51e37-eec1-4e70-9708-a8191629e753-socket-dir\") pod \"aws-ebs-csi-driver-node-x5nhz\" (UID: \"97a51e37-eec1-4e70-9708-a8191629e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5nhz" Jul 06 15:25:40.388760 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344793 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-host-kubelet\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.388760 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344819 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/869b9829-1278-4da3-b582-6364317623f7-ovnkube-script-lib\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.388760 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344842 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f4831e24-ef2b-4453-8f59-9b1ba159a289-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9mdzh\" (UID: \"f4831e24-ef2b-4453-8f59-9b1ba159a289\") " pod="openshift-multus/multus-additional-cni-plugins-9mdzh" Jul 06 15:25:40.388760 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344864 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-systemd-units\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.388760 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344887 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/914b7462-be30-4d19-99ba-80ee135acec7-original-pull-secret\") pod \"global-pull-secret-syncer-slsrs\" (UID: \"914b7462-be30-4d19-99ba-80ee135acec7\") " pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:25:40.388760 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344912 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptvsx\" (UniqueName: \"kubernetes.io/projected/54ff6682-60fa-41c6-a133-1dd32f237779-kube-api-access-ptvsx\") pod \"node-resolver-s6nb2\" (UID: \"54ff6682-60fa-41c6-a133-1dd32f237779\") " pod="openshift-dns/node-resolver-s6nb2" Jul 06 15:25:40.388760 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344939 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20db46ed-b7f8-4846-993e-578a879360b4-metrics-certs\") pod \"network-metrics-daemon-jr4kq\" (UID: \"20db46ed-b7f8-4846-993e-578a879360b4\") " pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:25:40.388760 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344960 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6aadfb29-c480-4157-95e2-e08d98c63411-etc-tuned\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.388760 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.344997 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/869b9829-1278-4da3-b582-6364317623f7-env-overrides\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.388760 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.345022 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/869b9829-1278-4da3-b582-6364317623f7-ovn-node-metrics-cert\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.388760 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.345058 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-etc-sysctl-conf\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.388760 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.345081 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6aadfb29-c480-4157-95e2-e08d98c63411-tmp\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.389552 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.345127 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-etc-openvswitch\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.389552 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.345159 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kzq2\" (UniqueName: \"kubernetes.io/projected/f4831e24-ef2b-4453-8f59-9b1ba159a289-kube-api-access-5kzq2\") pod \"multus-additional-cni-plugins-9mdzh\" (UID: \"f4831e24-ef2b-4453-8f59-9b1ba159a289\") " pod="openshift-multus/multus-additional-cni-plugins-9mdzh" Jul 06 15:25:40.389552 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.345164 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 15:25:40.389552 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.345225 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/97a51e37-eec1-4e70-9708-a8191629e753-device-dir\") pod \"aws-ebs-csi-driver-node-x5nhz\" (UID: \"97a51e37-eec1-4e70-9708-a8191629e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5nhz" Jul 06 15:25:40.389552 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.345256 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zk49\" (UniqueName: \"kubernetes.io/projected/97a51e37-eec1-4e70-9708-a8191629e753-kube-api-access-9zk49\") pod \"aws-ebs-csi-driver-node-x5nhz\" (UID: \"97a51e37-eec1-4e70-9708-a8191629e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5nhz" Jul 06 15:25:40.389552 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.345311 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-lib-modules\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.389552 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.345335 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-host-run-netns\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.389552 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.345360 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-host-cni-bin\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.389552 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.345381 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/869b9829-1278-4da3-b582-6364317623f7-ovnkube-config\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.389552 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.345399 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8t9w\" (UniqueName: \"kubernetes.io/projected/4a00dac0-28b8-435b-a6f5-807b0c734207-kube-api-access-v8t9w\") pod \"network-check-target-4sjhx\" (UID: \"4a00dac0-28b8-435b-a6f5-807b0c734207\") " pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:25:40.389552 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.345457 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-etc-modprobe-d\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.389552 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.345461 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-thn2q\"" Jul 06 15:25:40.389552 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.345487 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-log-socket\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.389552 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.345516 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-host-slash\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.389552 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.345520 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 15:25:40.389552 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.345463 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8n44s\"" Jul 06 15:25:40.390125 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.345599 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b97pn" Jul 06 15:25:40.390125 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.345543 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-host-cni-netd\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.390125 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.345651 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54ff6682-60fa-41c6-a133-1dd32f237779-tmp-dir\") pod \"node-resolver-s6nb2\" (UID: \"54ff6682-60fa-41c6-a133-1dd32f237779\") " pod="openshift-dns/node-resolver-s6nb2" Jul 06 15:25:40.390125 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.345685 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4831e24-ef2b-4453-8f59-9b1ba159a289-cnibin\") pod \"multus-additional-cni-plugins-9mdzh\" (UID: \"f4831e24-ef2b-4453-8f59-9b1ba159a289\") " pod="openshift-multus/multus-additional-cni-plugins-9mdzh" Jul 06 15:25:40.390125 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.345718 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-var-lib-kubelet\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.390125 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.346328 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 15:25:40.390125 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.347129 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 15:25:40.390125 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.350503 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 15:25:40.390125 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.351152 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 15:25:40.390125 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.351312 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 15:25:40.390125 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.351520 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 15:25:40.390125 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.351833 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 15:25:40.390125 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.352324 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hd98q\"" Jul 06 15:25:40.390125 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.352470 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-x6ctp\"" Jul 06 15:25:40.390125 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.352559 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-129.ec2.internal"] Jul 06 15:25:40.390125 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.352822 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 15:25:40.390125 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.352866 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-129.ec2.internal" Jul 06 15:25:40.390125 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.365773 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 15:25:40.390125 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.372361 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 15:25:40.390125 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.372964 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-129.ec2.internal"] Jul 06 15:25:40.562464 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.398688 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5tzk4" Jul 06 15:25:40.562464 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.404363 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 15:20:39 +0000 UTC" deadline="2028-04-19 22:30:52.57013972 +0000 UTC" Jul 06 15:25:40.562464 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.404404 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15679h5m12.165738111s" Jul 06 15:25:40.562464 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.410677 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5tzk4" Jul 06 15:25:40.562464 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.439896 2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 15:25:40.562464 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.446464 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-etc-sysctl-conf\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.562464 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.446487 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6aadfb29-c480-4157-95e2-e08d98c63411-tmp\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.562464 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.446502 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-etc-openvswitch\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.562464 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.446536 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-system-cni-dir\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.562464 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.446560 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kzq2\" (UniqueName: \"kubernetes.io/projected/f4831e24-ef2b-4453-8f59-9b1ba159a289-kube-api-access-5kzq2\") pod \"multus-additional-cni-plugins-9mdzh\" (UID: \"f4831e24-ef2b-4453-8f59-9b1ba159a289\") " pod="openshift-multus/multus-additional-cni-plugins-9mdzh" Jul 06 15:25:40.562464 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.446584 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/97a51e37-eec1-4e70-9708-a8191629e753-device-dir\") pod \"aws-ebs-csi-driver-node-x5nhz\" (UID: \"97a51e37-eec1-4e70-9708-a8191629e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5nhz" Jul 06 15:25:40.562464 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.446592 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-etc-sysctl-conf\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.562464 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.446607 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zk49\" (UniqueName: \"kubernetes.io/projected/97a51e37-eec1-4e70-9708-a8191629e753-kube-api-access-9zk49\") pod \"aws-ebs-csi-driver-node-x5nhz\" (UID: \"97a51e37-eec1-4e70-9708-a8191629e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5nhz" Jul 06 15:25:40.562464 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.446630 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-lib-modules\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.562464 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.446641 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-etc-openvswitch\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.562464 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.446657 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-host-run-netns\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.562464 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.446659 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/97a51e37-eec1-4e70-9708-a8191629e753-device-dir\") pod \"aws-ebs-csi-driver-node-x5nhz\" (UID: \"97a51e37-eec1-4e70-9708-a8191629e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5nhz" Jul 06 15:25:40.563404 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.446684 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-host-cni-bin\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.563404 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.446709 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/869b9829-1278-4da3-b582-6364317623f7-ovnkube-config\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.563404 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.446734 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-host-run-k8s-cni-cncf-io\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.563404 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.446759 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8t9w\" (UniqueName: \"kubernetes.io/projected/4a00dac0-28b8-435b-a6f5-807b0c734207-kube-api-access-v8t9w\") pod \"network-check-target-4sjhx\" (UID: \"4a00dac0-28b8-435b-a6f5-807b0c734207\") " pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:25:40.563404 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.446772 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-lib-modules\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.563404 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.446780 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-host-cni-bin\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.563404 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.446811 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-host-run-netns\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.563404 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.446814 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 15:25:40.563404 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.446892 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-etc-modprobe-d\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.563404 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.446912 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-log-socket\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.563404 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.446929 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-host-var-lib-cni-multus\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.563404 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.446946 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-multus-conf-dir\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.563404 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.446961 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-host-run-multus-certs\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.563404 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.446969 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-log-socket\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.563404 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.446977 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/994de89b-9ff2-47f1-a1e8-f58a60970457-iptables-alerter-script\") pod \"iptables-alerter-klk7w\" (UID: \"994de89b-9ff2-47f1-a1e8-f58a60970457\") " pod="openshift-network-operator/iptables-alerter-klk7w" Jul 06 15:25:40.564048 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447003 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/de1dd724-0faf-491e-bd1d-bf08496ea967-konnectivity-ca\") pod \"konnectivity-agent-b97pn\" (UID: \"de1dd724-0faf-491e-bd1d-bf08496ea967\") " pod="kube-system/konnectivity-agent-b97pn" Jul 06 15:25:40.564048 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447046 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-host-slash\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.564048 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447071 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-host-slash\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.564048 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447077 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-etc-modprobe-d\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.564048 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447099 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-host-cni-netd\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.564048 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447121 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54ff6682-60fa-41c6-a133-1dd32f237779-tmp-dir\") pod \"node-resolver-s6nb2\" (UID: \"54ff6682-60fa-41c6-a133-1dd32f237779\") " pod="openshift-dns/node-resolver-s6nb2" Jul 06 15:25:40.564048 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447144 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4831e24-ef2b-4453-8f59-9b1ba159a289-cnibin\") pod \"multus-additional-cni-plugins-9mdzh\" (UID: \"f4831e24-ef2b-4453-8f59-9b1ba159a289\") " pod="openshift-multus/multus-additional-cni-plugins-9mdzh" Jul 06 15:25:40.564048 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447166 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-var-lib-kubelet\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.564048 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447179 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-host-cni-netd\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.564048 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447186 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf4mf\" (UniqueName: \"kubernetes.io/projected/b5f3d5ad-ce7e-467c-ab15-30f58cbda56c-kube-api-access-rf4mf\") pod \"node-ca-wrhr9\" (UID: \"b5f3d5ad-ce7e-467c-ab15-30f58cbda56c\") " pod="openshift-image-registry/node-ca-wrhr9" Jul 06 15:25:40.564048 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447217 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4831e24-ef2b-4453-8f59-9b1ba159a289-cnibin\") pod \"multus-additional-cni-plugins-9mdzh\" (UID: \"f4831e24-ef2b-4453-8f59-9b1ba159a289\") " pod="openshift-multus/multus-additional-cni-plugins-9mdzh" Jul 06 15:25:40.564048 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447227 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/869b9829-1278-4da3-b582-6364317623f7-ovnkube-config\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.564048 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447238 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-run-systemd\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.564048 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447259 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-run-ovn\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.564048 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447278 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n74vx\" (UniqueName: \"kubernetes.io/projected/869b9829-1278-4da3-b582-6364317623f7-kube-api-access-n74vx\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.564930 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447296 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/54ff6682-60fa-41c6-a133-1dd32f237779-hosts-file\") pod \"node-resolver-s6nb2\" (UID: \"54ff6682-60fa-41c6-a133-1dd32f237779\") " pod="openshift-dns/node-resolver-s6nb2" Jul 06 15:25:40.564930 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447309 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-var-lib-kubelet\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.564930 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447315 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4831e24-ef2b-4453-8f59-9b1ba159a289-system-cni-dir\") pod \"multus-additional-cni-plugins-9mdzh\" (UID: \"f4831e24-ef2b-4453-8f59-9b1ba159a289\") " pod="openshift-multus/multus-additional-cni-plugins-9mdzh" Jul 06 15:25:40.564930 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447334 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/97a51e37-eec1-4e70-9708-a8191629e753-sys-fs\") pod \"aws-ebs-csi-driver-node-x5nhz\" (UID: \"97a51e37-eec1-4e70-9708-a8191629e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5nhz" Jul 06 15:25:40.564930 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447336 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54ff6682-60fa-41c6-a133-1dd32f237779-tmp-dir\") pod \"node-resolver-s6nb2\" (UID: \"54ff6682-60fa-41c6-a133-1dd32f237779\") " pod="openshift-dns/node-resolver-s6nb2" Jul 06 15:25:40.564930 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447377 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/97a51e37-eec1-4e70-9708-a8191629e753-sys-fs\") pod \"aws-ebs-csi-driver-node-x5nhz\" (UID: \"97a51e37-eec1-4e70-9708-a8191629e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5nhz" Jul 06 15:25:40.564930 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447390 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-etc-kubernetes\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.564930 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447407 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-host-run-ovn-kubernetes\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.564930 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447409 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4831e24-ef2b-4453-8f59-9b1ba159a289-system-cni-dir\") pod \"multus-additional-cni-plugins-9mdzh\" (UID: \"f4831e24-ef2b-4453-8f59-9b1ba159a289\") " pod="openshift-multus/multus-additional-cni-plugins-9mdzh" Jul 06 15:25:40.564930 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447407 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/54ff6682-60fa-41c6-a133-1dd32f237779-hosts-file\") pod \"node-resolver-s6nb2\" (UID: \"54ff6682-60fa-41c6-a133-1dd32f237779\") " pod="openshift-dns/node-resolver-s6nb2" Jul 06 15:25:40.564930 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447434 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-multus-cni-dir\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.564930 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447280 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-run-systemd\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.564930 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447448 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-etc-kubernetes\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.564930 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447463 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-host-run-ovn-kubernetes\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.564930 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447471 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-run-ovn\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.565490 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447487 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-etc-kubernetes\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.565490 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447513 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4831e24-ef2b-4453-8f59-9b1ba159a289-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9mdzh\" (UID: \"f4831e24-ef2b-4453-8f59-9b1ba159a289\") " pod="openshift-multus/multus-additional-cni-plugins-9mdzh" Jul 06 15:25:40.565490 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447547 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm6xc\" (UniqueName: \"kubernetes.io/projected/20db46ed-b7f8-4846-993e-578a879360b4-kube-api-access-hm6xc\") pod \"network-metrics-daemon-jr4kq\" (UID: \"20db46ed-b7f8-4846-993e-578a879360b4\") " pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:25:40.565490 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447594 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b5f3d5ad-ce7e-467c-ab15-30f58cbda56c-serviceca\") pod \"node-ca-wrhr9\" (UID: \"b5f3d5ad-ce7e-467c-ab15-30f58cbda56c\") " pod="openshift-image-registry/node-ca-wrhr9" Jul 06 15:25:40.565490 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447612 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-os-release\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.565490 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447627 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74vln\" (UniqueName: \"kubernetes.io/projected/2b7e6c48-caeb-4515-8706-badbdf1d466a-kube-api-access-74vln\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.565490 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447634 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4831e24-ef2b-4453-8f59-9b1ba159a289-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9mdzh\" (UID: \"f4831e24-ef2b-4453-8f59-9b1ba159a289\") " pod="openshift-multus/multus-additional-cni-plugins-9mdzh" Jul 06 15:25:40.565490 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447642 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc67t\" (UniqueName: \"kubernetes.io/projected/994de89b-9ff2-47f1-a1e8-f58a60970457-kube-api-access-fc67t\") pod \"iptables-alerter-klk7w\" (UID: \"994de89b-9ff2-47f1-a1e8-f58a60970457\") " pod="openshift-network-operator/iptables-alerter-klk7w" Jul 06 15:25:40.565490 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447668 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/97a51e37-eec1-4e70-9708-a8191629e753-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x5nhz\" (UID: \"97a51e37-eec1-4e70-9708-a8191629e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5nhz" Jul 06 15:25:40.565490 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447689 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/97a51e37-eec1-4e70-9708-a8191629e753-registration-dir\") pod \"aws-ebs-csi-driver-node-x5nhz\" (UID: \"97a51e37-eec1-4e70-9708-a8191629e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5nhz" Jul 06 15:25:40.565490 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447715 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/97a51e37-eec1-4e70-9708-a8191629e753-etc-selinux\") pod \"aws-ebs-csi-driver-node-x5nhz\" (UID: \"97a51e37-eec1-4e70-9708-a8191629e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5nhz" Jul 06 15:25:40.565490 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447752 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/97a51e37-eec1-4e70-9708-a8191629e753-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x5nhz\" (UID: \"97a51e37-eec1-4e70-9708-a8191629e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5nhz" Jul 06 15:25:40.565490 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447763 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/97a51e37-eec1-4e70-9708-a8191629e753-registration-dir\") pod \"aws-ebs-csi-driver-node-x5nhz\" (UID: \"97a51e37-eec1-4e70-9708-a8191629e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5nhz" Jul 06 15:25:40.565490 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447785 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-run-openvswitch\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.566242 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447816 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b7e6c48-caeb-4515-8706-badbdf1d466a-cni-binary-copy\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.566242 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447823 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/97a51e37-eec1-4e70-9708-a8191629e753-etc-selinux\") pod \"aws-ebs-csi-driver-node-x5nhz\" (UID: \"97a51e37-eec1-4e70-9708-a8191629e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5nhz" Jul 06 15:25:40.566242 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447839 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-host-run-netns\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.566242 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447853 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-run-openvswitch\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.566242 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447884 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4831e24-ef2b-4453-8f59-9b1ba159a289-cni-binary-copy\") pod \"multus-additional-cni-plugins-9mdzh\" (UID: \"f4831e24-ef2b-4453-8f59-9b1ba159a289\") " pod="openshift-multus/multus-additional-cni-plugins-9mdzh" Jul 06 15:25:40.566242 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447905 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-etc-systemd\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.566242 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447926 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-run\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.566242 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447946 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b5f3d5ad-ce7e-467c-ab15-30f58cbda56c-serviceca\") pod \"node-ca-wrhr9\" (UID: \"b5f3d5ad-ce7e-467c-ab15-30f58cbda56c\") " pod="openshift-image-registry/node-ca-wrhr9" Jul 06 15:25:40.566242 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447950 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b5f3d5ad-ce7e-467c-ab15-30f58cbda56c-host\") pod \"node-ca-wrhr9\" (UID: \"b5f3d5ad-ce7e-467c-ab15-30f58cbda56c\") " pod="openshift-image-registry/node-ca-wrhr9" Jul 06 15:25:40.566242 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447950 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-etc-systemd\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.566242 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447976 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b5f3d5ad-ce7e-467c-ab15-30f58cbda56c-host\") pod \"node-ca-wrhr9\" (UID: \"b5f3d5ad-ce7e-467c-ab15-30f58cbda56c\") " pod="openshift-image-registry/node-ca-wrhr9" Jul 06 15:25:40.566242 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.447984 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.566242 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448008 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/de1dd724-0faf-491e-bd1d-bf08496ea967-agent-certs\") pod \"konnectivity-agent-b97pn\" (UID: \"de1dd724-0faf-491e-bd1d-bf08496ea967\") " pod="kube-system/konnectivity-agent-b97pn" Jul 06 15:25:40.566242 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448025 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-run\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.566725 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448049 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f4831e24-ef2b-4453-8f59-9b1ba159a289-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9mdzh\" (UID: \"f4831e24-ef2b-4453-8f59-9b1ba159a289\") " pod="openshift-multus/multus-additional-cni-plugins-9mdzh" Jul 06 15:25:40.566725 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448066 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.566725 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448074 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-var-lib-openvswitch\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.566725 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448107 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-host-var-lib-cni-bin\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.566725 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448137 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-var-lib-openvswitch\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.566725 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448162 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/994de89b-9ff2-47f1-a1e8-f58a60970457-host-slash\") pod \"iptables-alerter-klk7w\" (UID: \"994de89b-9ff2-47f1-a1e8-f58a60970457\") " pod="openshift-network-operator/iptables-alerter-klk7w" Jul 06 15:25:40.566725 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448184 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/914b7462-be30-4d19-99ba-80ee135acec7-kubelet-config\") pod \"global-pull-secret-syncer-slsrs\" (UID: \"914b7462-be30-4d19-99ba-80ee135acec7\") " pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:25:40.566725 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448199 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/914b7462-be30-4d19-99ba-80ee135acec7-dbus\") pod \"global-pull-secret-syncer-slsrs\" (UID: \"914b7462-be30-4d19-99ba-80ee135acec7\") " pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:25:40.566725 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448234 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/914b7462-be30-4d19-99ba-80ee135acec7-kubelet-config\") pod \"global-pull-secret-syncer-slsrs\" (UID: \"914b7462-be30-4d19-99ba-80ee135acec7\") " pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:25:40.566725 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448254 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-cnibin\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.566725 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448275 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-etc-sysconfig\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.566725 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448273 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/914b7462-be30-4d19-99ba-80ee135acec7-dbus\") pod \"global-pull-secret-syncer-slsrs\" (UID: \"914b7462-be30-4d19-99ba-80ee135acec7\") " pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:25:40.566725 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448291 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-etc-sysctl-d\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.566725 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448306 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-sys\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.757109 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448312 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-etc-sysconfig\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.757109 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448330 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-host\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.757109 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448345 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjnjm\" (UniqueName: \"kubernetes.io/projected/6aadfb29-c480-4157-95e2-e08d98c63411-kube-api-access-tjnjm\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.757109 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448364 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-etc-sysctl-d\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.757109 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448371 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-node-log\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.757109 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448394 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-sys\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.757109 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448389 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4831e24-ef2b-4453-8f59-9b1ba159a289-cni-binary-copy\") pod \"multus-additional-cni-plugins-9mdzh\" (UID: \"f4831e24-ef2b-4453-8f59-9b1ba159a289\") " pod="openshift-multus/multus-additional-cni-plugins-9mdzh" Jul 06 15:25:40.757109 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448434 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6aadfb29-c480-4157-95e2-e08d98c63411-host\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.757109 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448454 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-node-log\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.757109 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448399 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-host-var-lib-kubelet\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.757109 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448507 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2b7e6c48-caeb-4515-8706-badbdf1d466a-multus-daemon-config\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.757109 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448523 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f4831e24-ef2b-4453-8f59-9b1ba159a289-os-release\") pod \"multus-additional-cni-plugins-9mdzh\" (UID: \"f4831e24-ef2b-4453-8f59-9b1ba159a289\") " pod="openshift-multus/multus-additional-cni-plugins-9mdzh" Jul 06 15:25:40.757109 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448539 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/97a51e37-eec1-4e70-9708-a8191629e753-socket-dir\") pod \"aws-ebs-csi-driver-node-x5nhz\" (UID: \"97a51e37-eec1-4e70-9708-a8191629e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5nhz" Jul 06 15:25:40.757109 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448561 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-host-kubelet\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.757109 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448568 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f4831e24-ef2b-4453-8f59-9b1ba159a289-os-release\") pod \"multus-additional-cni-plugins-9mdzh\" (UID: \"f4831e24-ef2b-4453-8f59-9b1ba159a289\") " pod="openshift-multus/multus-additional-cni-plugins-9mdzh" Jul 06 15:25:40.759289 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448584 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-hostroot\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.759289 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448599 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/869b9829-1278-4da3-b582-6364317623f7-ovnkube-script-lib\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.759289 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448615 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f4831e24-ef2b-4453-8f59-9b1ba159a289-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9mdzh\" (UID: \"f4831e24-ef2b-4453-8f59-9b1ba159a289\") " pod="openshift-multus/multus-additional-cni-plugins-9mdzh" Jul 06 15:25:40.759289 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448630 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-systemd-units\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.759289 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448634 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/97a51e37-eec1-4e70-9708-a8191629e753-socket-dir\") pod \"aws-ebs-csi-driver-node-x5nhz\" (UID: \"97a51e37-eec1-4e70-9708-a8191629e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5nhz" Jul 06 15:25:40.759289 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448634 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-host-kubelet\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.759289 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448649 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/914b7462-be30-4d19-99ba-80ee135acec7-original-pull-secret\") pod \"global-pull-secret-syncer-slsrs\" (UID: \"914b7462-be30-4d19-99ba-80ee135acec7\") " pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:25:40.759289 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448664 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-multus-socket-dir-parent\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.759289 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448683 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/869b9829-1278-4da3-b582-6364317623f7-systemd-units\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.759289 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448693 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptvsx\" (UniqueName: \"kubernetes.io/projected/54ff6682-60fa-41c6-a133-1dd32f237779-kube-api-access-ptvsx\") pod \"node-resolver-s6nb2\" (UID: \"54ff6682-60fa-41c6-a133-1dd32f237779\") " pod="openshift-dns/node-resolver-s6nb2" Jul 06 15:25:40.759289 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448707 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20db46ed-b7f8-4846-993e-578a879360b4-metrics-certs\") pod \"network-metrics-daemon-jr4kq\" (UID: \"20db46ed-b7f8-4846-993e-578a879360b4\") " pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:25:40.759289 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448723 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6aadfb29-c480-4157-95e2-e08d98c63411-etc-tuned\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.759289 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448736 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/869b9829-1278-4da3-b582-6364317623f7-env-overrides\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.759289 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.448754 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/869b9829-1278-4da3-b582-6364317623f7-ovn-node-metrics-cert\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.760526 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.449122 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/869b9829-1278-4da3-b582-6364317623f7-ovnkube-script-lib\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.760526 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:40.449131 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:40.760526 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:40.449214 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/914b7462-be30-4d19-99ba-80ee135acec7-original-pull-secret podName:914b7462-be30-4d19-99ba-80ee135acec7 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:40.949184686 +0000 UTC m=+2.074246955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/914b7462-be30-4d19-99ba-80ee135acec7-original-pull-secret") pod "global-pull-secret-syncer-slsrs" (UID: "914b7462-be30-4d19-99ba-80ee135acec7") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:40.760526 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:40.449774 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:40.760526 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:40.449827 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20db46ed-b7f8-4846-993e-578a879360b4-metrics-certs podName:20db46ed-b7f8-4846-993e-578a879360b4 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:40.949814539 +0000 UTC m=+2.074876786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20db46ed-b7f8-4846-993e-578a879360b4-metrics-certs") pod "network-metrics-daemon-jr4kq" (UID: "20db46ed-b7f8-4846-993e-578a879360b4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:40.760526 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.449778 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 15:25:40.760526 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.450142 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f4831e24-ef2b-4453-8f59-9b1ba159a289-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9mdzh\" (UID: \"f4831e24-ef2b-4453-8f59-9b1ba159a289\") " pod="openshift-multus/multus-additional-cni-plugins-9mdzh" Jul 06 15:25:40.760526 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.450198 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f4831e24-ef2b-4453-8f59-9b1ba159a289-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9mdzh\" (UID: \"f4831e24-ef2b-4453-8f59-9b1ba159a289\") " pod="openshift-multus/multus-additional-cni-plugins-9mdzh" Jul 06 15:25:40.760526 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.450295 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/869b9829-1278-4da3-b582-6364317623f7-env-overrides\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.760526 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.450516 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6aadfb29-c480-4157-95e2-e08d98c63411-tmp\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.760526 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.450831 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/869b9829-1278-4da3-b582-6364317623f7-ovn-node-metrics-cert\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.760526 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.451109 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6aadfb29-c480-4157-95e2-e08d98c63411-etc-tuned\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.760526 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.463404 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptvsx\" (UniqueName: \"kubernetes.io/projected/54ff6682-60fa-41c6-a133-1dd32f237779-kube-api-access-ptvsx\") pod \"node-resolver-s6nb2\" (UID: \"54ff6682-60fa-41c6-a133-1dd32f237779\") " pod="openshift-dns/node-resolver-s6nb2" Jul 06 15:25:40.760526 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.463459 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf4mf\" (UniqueName: \"kubernetes.io/projected/b5f3d5ad-ce7e-467c-ab15-30f58cbda56c-kube-api-access-rf4mf\") pod \"node-ca-wrhr9\" (UID: \"b5f3d5ad-ce7e-467c-ab15-30f58cbda56c\") " pod="openshift-image-registry/node-ca-wrhr9" Jul 06 15:25:40.760526 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:40.465262 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:25:40.761018 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:40.465279 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:25:40.761018 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:40.465288 2573 projected.go:196] Error preparing data for projected volume kube-api-access-v8t9w for pod openshift-network-diagnostics/network-check-target-4sjhx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:40.761018 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:40.465335 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a00dac0-28b8-435b-a6f5-807b0c734207-kube-api-access-v8t9w podName:4a00dac0-28b8-435b-a6f5-807b0c734207 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:40.965323911 +0000 UTC m=+2.090386158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-v8t9w" (UniqueName: "kubernetes.io/projected/4a00dac0-28b8-435b-a6f5-807b0c734207-kube-api-access-v8t9w") pod "network-check-target-4sjhx" (UID: "4a00dac0-28b8-435b-a6f5-807b0c734207") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:40.761018 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.465761 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjnjm\" (UniqueName: \"kubernetes.io/projected/6aadfb29-c480-4157-95e2-e08d98c63411-kube-api-access-tjnjm\") pod \"tuned-8zjj5\" (UID: \"6aadfb29-c480-4157-95e2-e08d98c63411\") " pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.761018 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.465807 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n74vx\" (UniqueName: \"kubernetes.io/projected/869b9829-1278-4da3-b582-6364317623f7-kube-api-access-n74vx\") pod \"ovnkube-node-hxm84\" (UID: \"869b9829-1278-4da3-b582-6364317623f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.761018 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.466099 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kzq2\" (UniqueName: \"kubernetes.io/projected/f4831e24-ef2b-4453-8f59-9b1ba159a289-kube-api-access-5kzq2\") pod \"multus-additional-cni-plugins-9mdzh\" (UID: \"f4831e24-ef2b-4453-8f59-9b1ba159a289\") " pod="openshift-multus/multus-additional-cni-plugins-9mdzh" Jul 06 15:25:40.761018 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.467330 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm6xc\" (UniqueName: \"kubernetes.io/projected/20db46ed-b7f8-4846-993e-578a879360b4-kube-api-access-hm6xc\") pod \"network-metrics-daemon-jr4kq\" (UID: \"20db46ed-b7f8-4846-993e-578a879360b4\") " pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:25:40.761018 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.467761 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zk49\" (UniqueName: \"kubernetes.io/projected/97a51e37-eec1-4e70-9708-a8191629e753-kube-api-access-9zk49\") pod \"aws-ebs-csi-driver-node-x5nhz\" (UID: \"97a51e37-eec1-4e70-9708-a8191629e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5nhz" Jul 06 15:25:40.761018 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.505494 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 15:25:40.761018 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.549678 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-multus-cni-dir\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.761018 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.549705 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-etc-kubernetes\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.761018 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.549721 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-os-release\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.761018 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.549740 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74vln\" (UniqueName: \"kubernetes.io/projected/2b7e6c48-caeb-4515-8706-badbdf1d466a-kube-api-access-74vln\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.761018 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.549787 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc67t\" (UniqueName: \"kubernetes.io/projected/994de89b-9ff2-47f1-a1e8-f58a60970457-kube-api-access-fc67t\") pod \"iptables-alerter-klk7w\" (UID: \"994de89b-9ff2-47f1-a1e8-f58a60970457\") " pod="openshift-network-operator/iptables-alerter-klk7w" Jul 06 15:25:40.761463 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.549788 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-etc-kubernetes\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.761463 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.549794 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-multus-cni-dir\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.761463 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.549804 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b7e6c48-caeb-4515-8706-badbdf1d466a-cni-binary-copy\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.761463 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.549820 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-host-run-netns\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.761463 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.549840 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/de1dd724-0faf-491e-bd1d-bf08496ea967-agent-certs\") pod \"konnectivity-agent-b97pn\" (UID: \"de1dd724-0faf-491e-bd1d-bf08496ea967\") " pod="kube-system/konnectivity-agent-b97pn" Jul 06 15:25:40.761463 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.549862 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-host-var-lib-cni-bin\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.761463 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.549883 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-os-release\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.761463 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.549883 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-host-run-netns\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.761463 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.549931 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-host-var-lib-cni-bin\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.761463 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.549938 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/994de89b-9ff2-47f1-a1e8-f58a60970457-host-slash\") pod \"iptables-alerter-klk7w\" (UID: \"994de89b-9ff2-47f1-a1e8-f58a60970457\") " pod="openshift-network-operator/iptables-alerter-klk7w" Jul 06 15:25:40.761463 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.549886 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/994de89b-9ff2-47f1-a1e8-f58a60970457-host-slash\") pod \"iptables-alerter-klk7w\" (UID: \"994de89b-9ff2-47f1-a1e8-f58a60970457\") " pod="openshift-network-operator/iptables-alerter-klk7w" Jul 06 15:25:40.761463 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.549972 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-cnibin\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.761463 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.550009 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-host-var-lib-kubelet\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.761463 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.550050 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2b7e6c48-caeb-4515-8706-badbdf1d466a-multus-daemon-config\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.761463 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.550064 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-host-var-lib-kubelet\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.762006 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.550065 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-cnibin\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.762006 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.550078 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-hostroot\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.762006 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.550118 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-multus-socket-dir-parent\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.762006 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.550160 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-hostroot\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.762006 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.550184 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-multus-socket-dir-parent\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.762006 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.550188 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-system-cni-dir\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.762006 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.550226 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-host-run-k8s-cni-cncf-io\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.762006 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.550264 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-host-run-k8s-cni-cncf-io\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.762006 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.550272 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-host-var-lib-cni-multus\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.762006 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.550300 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-multus-conf-dir\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.762006 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.550307 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-host-var-lib-cni-multus\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.762006 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.550314 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-system-cni-dir\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.762006 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.550331 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-host-run-multus-certs\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.762006 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.550357 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/994de89b-9ff2-47f1-a1e8-f58a60970457-iptables-alerter-script\") pod \"iptables-alerter-klk7w\" (UID: \"994de89b-9ff2-47f1-a1e8-f58a60970457\") " pod="openshift-network-operator/iptables-alerter-klk7w" Jul 06 15:25:40.762006 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.550366 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-host-run-multus-certs\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.762477 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.550379 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/de1dd724-0faf-491e-bd1d-bf08496ea967-konnectivity-ca\") pod \"konnectivity-agent-b97pn\" (UID: \"de1dd724-0faf-491e-bd1d-bf08496ea967\") " pod="kube-system/konnectivity-agent-b97pn" Jul 06 15:25:40.762477 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.550366 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b7e6c48-caeb-4515-8706-badbdf1d466a-multus-conf-dir\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.762477 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.550402 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b7e6c48-caeb-4515-8706-badbdf1d466a-cni-binary-copy\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.762477 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.550478 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2b7e6c48-caeb-4515-8706-badbdf1d466a-multus-daemon-config\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.762477 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.550761 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/994de89b-9ff2-47f1-a1e8-f58a60970457-iptables-alerter-script\") pod \"iptables-alerter-klk7w\" (UID: \"994de89b-9ff2-47f1-a1e8-f58a60970457\") " pod="openshift-network-operator/iptables-alerter-klk7w" Jul 06 15:25:40.762477 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.550855 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/de1dd724-0faf-491e-bd1d-bf08496ea967-konnectivity-ca\") pod \"konnectivity-agent-b97pn\" (UID: \"de1dd724-0faf-491e-bd1d-bf08496ea967\") " pod="kube-system/konnectivity-agent-b97pn" Jul 06 15:25:40.762477 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.552255 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/de1dd724-0faf-491e-bd1d-bf08496ea967-agent-certs\") pod \"konnectivity-agent-b97pn\" (UID: \"de1dd724-0faf-491e-bd1d-bf08496ea967\") " pod="kube-system/konnectivity-agent-b97pn" Jul 06 15:25:40.762477 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.569212 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc67t\" (UniqueName: \"kubernetes.io/projected/994de89b-9ff2-47f1-a1e8-f58a60970457-kube-api-access-fc67t\") pod \"iptables-alerter-klk7w\" (UID: \"994de89b-9ff2-47f1-a1e8-f58a60970457\") " pod="openshift-network-operator/iptables-alerter-klk7w" Jul 06 15:25:40.762477 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.573337 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74vln\" (UniqueName: \"kubernetes.io/projected/2b7e6c48-caeb-4515-8706-badbdf1d466a-kube-api-access-74vln\") pod \"multus-w6h2h\" (UID: \"2b7e6c48-caeb-4515-8706-badbdf1d466a\") " pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.762477 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:40.602136 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90709f330b9c67d8d7962607bcb49842.slice/crio-c3af9abc70a1f0572f5312a8c9ba969083ab345073a1489f8d74d55c9265e704 WatchSource:0}: Error finding container c3af9abc70a1f0572f5312a8c9ba969083ab345073a1489f8d74d55c9265e704: Status 404 returned error can't find the container with id c3af9abc70a1f0572f5312a8c9ba969083ab345073a1489f8d74d55c9265e704 Jul 06 15:25:40.762477 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:40.603270 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cbb15a3b59006910713defe15de5c17.slice/crio-fce73c984eea85919a7589bb64ff5961e09cf09e8ba9129a935a1ea06ce93dd1 WatchSource:0}: Error finding container fce73c984eea85919a7589bb64ff5961e09cf09e8ba9129a935a1ea06ce93dd1: Status 404 returned error can't find the container with id fce73c984eea85919a7589bb64ff5961e09cf09e8ba9129a935a1ea06ce93dd1 Jul 06 15:25:40.762477 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.612526 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 15:25:40.762477 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.662771 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" Jul 06 15:25:40.762477 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:40.672795 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aadfb29_c480_4157_95e2_e08d98c63411.slice/crio-6b71bf87ea965d4eff9abb1c51ad2b9a9903c06c7cd59b2329ea7f359541f0e6 WatchSource:0}: Error finding container 6b71bf87ea965d4eff9abb1c51ad2b9a9903c06c7cd59b2329ea7f359541f0e6: Status 404 returned error can't find the container with id 6b71bf87ea965d4eff9abb1c51ad2b9a9903c06c7cd59b2329ea7f359541f0e6 Jul 06 15:25:40.762477 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.689763 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s6nb2" Jul 06 15:25:40.762477 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.702183 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wrhr9" Jul 06 15:25:40.763015 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.703262 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9mdzh" Jul 06 15:25:40.763015 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:40.709943 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5f3d5ad_ce7e_467c_ab15_30f58cbda56c.slice/crio-58516440c84c49822986df96830d8ae2241fcc6c38a0385975fcceffef949550 WatchSource:0}: Error finding container 58516440c84c49822986df96830d8ae2241fcc6c38a0385975fcceffef949550: Status 404 returned error can't find the container with id 58516440c84c49822986df96830d8ae2241fcc6c38a0385975fcceffef949550 Jul 06 15:25:40.763015 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:40.716386 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4831e24_ef2b_4453_8f59_9b1ba159a289.slice/crio-8b8fc049779b135182bef03702039e86fec577621f40298042b1d0bdb6c94bb5 WatchSource:0}: Error finding container 8b8fc049779b135182bef03702039e86fec577621f40298042b1d0bdb6c94bb5: Status 404 returned error can't find the container with id 8b8fc049779b135182bef03702039e86fec577621f40298042b1d0bdb6c94bb5 Jul 06 15:25:40.763015 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.737872 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:25:40.763015 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:40.749559 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod869b9829_1278_4da3_b582_6364317623f7.slice/crio-550577e083a207085169840e3021e8cd2d8c10b7ca43c19c2db901ae7dcc18d6 WatchSource:0}: Error finding container 550577e083a207085169840e3021e8cd2d8c10b7ca43c19c2db901ae7dcc18d6: Status 404 returned error can't find the container with id 550577e083a207085169840e3021e8cd2d8c10b7ca43c19c2db901ae7dcc18d6 Jul 06 15:25:40.763015 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.760532 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5nhz" Jul 06 15:25:40.932327 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:40.767894 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97a51e37_eec1_4e70_9708_a8191629e753.slice/crio-58847f82f89ae012c83ab869e1f5ee85f946a7a493d31156de108946652103fc WatchSource:0}: Error finding container 58847f82f89ae012c83ab869e1f5ee85f946a7a493d31156de108946652103fc: Status 404 returned error can't find the container with id 58847f82f89ae012c83ab869e1f5ee85f946a7a493d31156de108946652103fc Jul 06 15:25:40.932327 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.777501 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w6h2h" Jul 06 15:25:40.932327 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:40.785943 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b7e6c48_caeb_4515_8706_badbdf1d466a.slice/crio-41d8abd7de9e399a7e99378977b4e54b0286e3ce18eca5513412e555ff7c8e66 WatchSource:0}: Error finding container 41d8abd7de9e399a7e99378977b4e54b0286e3ce18eca5513412e555ff7c8e66: Status 404 returned error can't find the container with id 41d8abd7de9e399a7e99378977b4e54b0286e3ce18eca5513412e555ff7c8e66 Jul 06 15:25:40.932327 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.797140 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-klk7w" Jul 06 15:25:40.932327 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.802737 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b97pn" Jul 06 15:25:40.932327 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:40.808174 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod994de89b_9ff2_47f1_a1e8_f58a60970457.slice/crio-ee5900740696eb1ff2a1c5fb566e9ed1ab95fcafa67bf3ec09b496354c5b9748 WatchSource:0}: Error finding container ee5900740696eb1ff2a1c5fb566e9ed1ab95fcafa67bf3ec09b496354c5b9748: Status 404 returned error can't find the container with id ee5900740696eb1ff2a1c5fb566e9ed1ab95fcafa67bf3ec09b496354c5b9748 Jul 06 15:25:40.932327 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:25:40.821551 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde1dd724_0faf_491e_bd1d_bf08496ea967.slice/crio-f6f755427eade5692a9eeadbcf70d0972497f321863cd04f136377d7eed64ad4 WatchSource:0}: Error finding container f6f755427eade5692a9eeadbcf70d0972497f321863cd04f136377d7eed64ad4: Status 404 returned error can't find the container with id f6f755427eade5692a9eeadbcf70d0972497f321863cd04f136377d7eed64ad4 Jul 06 15:25:40.952830 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.952798 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/914b7462-be30-4d19-99ba-80ee135acec7-original-pull-secret\") pod \"global-pull-secret-syncer-slsrs\" (UID: \"914b7462-be30-4d19-99ba-80ee135acec7\") " pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:25:40.952926 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:40.952843 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20db46ed-b7f8-4846-993e-578a879360b4-metrics-certs\") pod \"network-metrics-daemon-jr4kq\" (UID: \"20db46ed-b7f8-4846-993e-578a879360b4\") " pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:25:40.952972 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:40.952948 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:40.952972 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:40.952967 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:40.953051 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:40.953007 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/914b7462-be30-4d19-99ba-80ee135acec7-original-pull-secret podName:914b7462-be30-4d19-99ba-80ee135acec7 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:41.952992778 +0000 UTC m=+3.078055027 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/914b7462-be30-4d19-99ba-80ee135acec7-original-pull-secret") pod "global-pull-secret-syncer-slsrs" (UID: "914b7462-be30-4d19-99ba-80ee135acec7") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:40.953051 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:40.953020 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20db46ed-b7f8-4846-993e-578a879360b4-metrics-certs podName:20db46ed-b7f8-4846-993e-578a879360b4 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:41.953014275 +0000 UTC m=+3.078076522 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20db46ed-b7f8-4846-993e-578a879360b4-metrics-certs") pod "network-metrics-daemon-jr4kq" (UID: "20db46ed-b7f8-4846-993e-578a879360b4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:41.053861 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:41.053815 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8t9w\" (UniqueName: \"kubernetes.io/projected/4a00dac0-28b8-435b-a6f5-807b0c734207-kube-api-access-v8t9w\") pod \"network-check-target-4sjhx\" (UID: \"4a00dac0-28b8-435b-a6f5-807b0c734207\") " pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:25:41.054111 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:41.054090 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:25:41.054197 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:41.054120 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:25:41.054197 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:41.054133 2573 projected.go:196] Error preparing data for projected volume kube-api-access-v8t9w for pod openshift-network-diagnostics/network-check-target-4sjhx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:41.054197 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:41.054196 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a00dac0-28b8-435b-a6f5-807b0c734207-kube-api-access-v8t9w podName:4a00dac0-28b8-435b-a6f5-807b0c734207 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:42.054177959 +0000 UTC m=+3.179240225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-v8t9w" (UniqueName: "kubernetes.io/projected/4a00dac0-28b8-435b-a6f5-807b0c734207-kube-api-access-v8t9w") pod "network-check-target-4sjhx" (UID: "4a00dac0-28b8-435b-a6f5-807b0c734207") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:41.283590 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:41.283512 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 15:25:41.413484 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:41.413422 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 15:20:40 +0000 UTC" deadline="2028-03-01 08:47:41.90074049 +0000 UTC" Jul 06 15:25:41.413484 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:41.413483 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14489h22m0.487262056s" Jul 06 15:25:41.492313 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:41.492285 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:25:41.492492 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:41.492416 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slsrs" podUID="914b7462-be30-4d19-99ba-80ee135acec7" Jul 06 15:25:41.509727 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:41.509647 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w6h2h" event={"ID":"2b7e6c48-caeb-4515-8706-badbdf1d466a","Type":"ContainerStarted","Data":"41d8abd7de9e399a7e99378977b4e54b0286e3ce18eca5513412e555ff7c8e66"} Jul 06 15:25:41.521087 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:41.521013 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5nhz" event={"ID":"97a51e37-eec1-4e70-9708-a8191629e753","Type":"ContainerStarted","Data":"58847f82f89ae012c83ab869e1f5ee85f946a7a493d31156de108946652103fc"} Jul 06 15:25:41.522629 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:41.522606 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s6nb2" event={"ID":"54ff6682-60fa-41c6-a133-1dd32f237779","Type":"ContainerStarted","Data":"2a03a9495602296606baeb33cd567781eee04b1e51ba3f9f2ca0e4061a405821"} Jul 06 15:25:41.530869 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:41.530802 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" event={"ID":"6aadfb29-c480-4157-95e2-e08d98c63411","Type":"ContainerStarted","Data":"6b71bf87ea965d4eff9abb1c51ad2b9a9903c06c7cd59b2329ea7f359541f0e6"} Jul 06 15:25:41.542676 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:41.542610 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-129.ec2.internal" event={"ID":"7cbb15a3b59006910713defe15de5c17","Type":"ContainerStarted","Data":"fce73c984eea85919a7589bb64ff5961e09cf09e8ba9129a935a1ea06ce93dd1"} Jul 06 15:25:41.554968 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:41.554861 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b97pn" event={"ID":"de1dd724-0faf-491e-bd1d-bf08496ea967","Type":"ContainerStarted","Data":"f6f755427eade5692a9eeadbcf70d0972497f321863cd04f136377d7eed64ad4"} Jul 06 15:25:41.568562 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:41.568234 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-klk7w" event={"ID":"994de89b-9ff2-47f1-a1e8-f58a60970457","Type":"ContainerStarted","Data":"ee5900740696eb1ff2a1c5fb566e9ed1ab95fcafa67bf3ec09b496354c5b9748"} Jul 06 15:25:41.570853 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:41.570828 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" event={"ID":"869b9829-1278-4da3-b582-6364317623f7","Type":"ContainerStarted","Data":"550577e083a207085169840e3021e8cd2d8c10b7ca43c19c2db901ae7dcc18d6"} Jul 06 15:25:41.577594 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:41.577568 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9mdzh" event={"ID":"f4831e24-ef2b-4453-8f59-9b1ba159a289","Type":"ContainerStarted","Data":"8b8fc049779b135182bef03702039e86fec577621f40298042b1d0bdb6c94bb5"} Jul 06 15:25:41.598181 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:41.598148 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wrhr9" event={"ID":"b5f3d5ad-ce7e-467c-ab15-30f58cbda56c","Type":"ContainerStarted","Data":"58516440c84c49822986df96830d8ae2241fcc6c38a0385975fcceffef949550"} Jul 06 15:25:41.605752 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:41.605722 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-129.ec2.internal" event={"ID":"90709f330b9c67d8d7962607bcb49842","Type":"ContainerStarted","Data":"c3af9abc70a1f0572f5312a8c9ba969083ab345073a1489f8d74d55c9265e704"} Jul 06 15:25:41.961901 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:41.961820 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/914b7462-be30-4d19-99ba-80ee135acec7-original-pull-secret\") pod \"global-pull-secret-syncer-slsrs\" (UID: \"914b7462-be30-4d19-99ba-80ee135acec7\") " pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:25:41.961901 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:41.961864 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20db46ed-b7f8-4846-993e-578a879360b4-metrics-certs\") pod \"network-metrics-daemon-jr4kq\" (UID: \"20db46ed-b7f8-4846-993e-578a879360b4\") " pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:25:41.962145 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:41.962057 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:41.962145 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:41.962116 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20db46ed-b7f8-4846-993e-578a879360b4-metrics-certs podName:20db46ed-b7f8-4846-993e-578a879360b4 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:43.962097676 +0000 UTC m=+5.087159927 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20db46ed-b7f8-4846-993e-578a879360b4-metrics-certs") pod "network-metrics-daemon-jr4kq" (UID: "20db46ed-b7f8-4846-993e-578a879360b4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:41.962508 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:41.962487 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:41.962585 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:41.962545 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/914b7462-be30-4d19-99ba-80ee135acec7-original-pull-secret podName:914b7462-be30-4d19-99ba-80ee135acec7 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:43.962529044 +0000 UTC m=+5.087591295 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/914b7462-be30-4d19-99ba-80ee135acec7-original-pull-secret") pod "global-pull-secret-syncer-slsrs" (UID: "914b7462-be30-4d19-99ba-80ee135acec7") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:42.063464 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:42.062796 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8t9w\" (UniqueName: \"kubernetes.io/projected/4a00dac0-28b8-435b-a6f5-807b0c734207-kube-api-access-v8t9w\") pod \"network-check-target-4sjhx\" (UID: \"4a00dac0-28b8-435b-a6f5-807b0c734207\") " pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:25:42.063464 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:42.063055 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:25:42.063464 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:42.063074 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:25:42.063464 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:42.063086 2573 projected.go:196] Error preparing data for projected volume kube-api-access-v8t9w for pod openshift-network-diagnostics/network-check-target-4sjhx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:42.063464 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:42.063139 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a00dac0-28b8-435b-a6f5-807b0c734207-kube-api-access-v8t9w podName:4a00dac0-28b8-435b-a6f5-807b0c734207 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:44.063121082 +0000 UTC m=+5.188183331 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-v8t9w" (UniqueName: "kubernetes.io/projected/4a00dac0-28b8-435b-a6f5-807b0c734207-kube-api-access-v8t9w") pod "network-check-target-4sjhx" (UID: "4a00dac0-28b8-435b-a6f5-807b0c734207") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:42.414094 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:42.413965 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 15:20:40 +0000 UTC" deadline="2028-04-12 22:31:56.998861954 +0000 UTC" Jul 06 15:25:42.414094 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:42.414003 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15511h6m14.584863932s" Jul 06 15:25:42.491447 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:42.491414 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:25:42.491635 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:42.491545 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sjhx" podUID="4a00dac0-28b8-435b-a6f5-807b0c734207" Jul 06 15:25:42.491987 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:42.491967 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:25:42.492145 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:42.492095 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jr4kq" podUID="20db46ed-b7f8-4846-993e-578a879360b4" Jul 06 15:25:43.497790 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:43.497715 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:25:43.498223 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:43.497851 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slsrs" podUID="914b7462-be30-4d19-99ba-80ee135acec7" Jul 06 15:25:43.978395 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:43.977586 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/914b7462-be30-4d19-99ba-80ee135acec7-original-pull-secret\") pod \"global-pull-secret-syncer-slsrs\" (UID: \"914b7462-be30-4d19-99ba-80ee135acec7\") " pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:25:43.978395 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:43.977640 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20db46ed-b7f8-4846-993e-578a879360b4-metrics-certs\") pod \"network-metrics-daemon-jr4kq\" (UID: \"20db46ed-b7f8-4846-993e-578a879360b4\") " pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:25:43.978395 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:43.977797 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:43.978395 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:43.977864 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20db46ed-b7f8-4846-993e-578a879360b4-metrics-certs podName:20db46ed-b7f8-4846-993e-578a879360b4 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:47.977845284 +0000 UTC m=+9.102907554 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20db46ed-b7f8-4846-993e-578a879360b4-metrics-certs") pod "network-metrics-daemon-jr4kq" (UID: "20db46ed-b7f8-4846-993e-578a879360b4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:43.978395 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:43.978264 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:43.978395 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:43.978314 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/914b7462-be30-4d19-99ba-80ee135acec7-original-pull-secret podName:914b7462-be30-4d19-99ba-80ee135acec7 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:47.978298604 +0000 UTC m=+9.103360859 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/914b7462-be30-4d19-99ba-80ee135acec7-original-pull-secret") pod "global-pull-secret-syncer-slsrs" (UID: "914b7462-be30-4d19-99ba-80ee135acec7") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:44.078697 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:44.078657 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8t9w\" (UniqueName: \"kubernetes.io/projected/4a00dac0-28b8-435b-a6f5-807b0c734207-kube-api-access-v8t9w\") pod \"network-check-target-4sjhx\" (UID: \"4a00dac0-28b8-435b-a6f5-807b0c734207\") " pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:25:44.078913 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:44.078894 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:25:44.078983 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:44.078924 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:25:44.078983 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:44.078978 2573 projected.go:196] Error preparing data for projected volume kube-api-access-v8t9w for pod openshift-network-diagnostics/network-check-target-4sjhx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:44.079120 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:44.079082 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a00dac0-28b8-435b-a6f5-807b0c734207-kube-api-access-v8t9w podName:4a00dac0-28b8-435b-a6f5-807b0c734207 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:48.079023406 +0000 UTC m=+9.204085672 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-v8t9w" (UniqueName: "kubernetes.io/projected/4a00dac0-28b8-435b-a6f5-807b0c734207-kube-api-access-v8t9w") pod "network-check-target-4sjhx" (UID: "4a00dac0-28b8-435b-a6f5-807b0c734207") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:44.492373 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:44.492337 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:25:44.492545 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:44.492469 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jr4kq" podUID="20db46ed-b7f8-4846-993e-578a879360b4" Jul 06 15:25:44.492937 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:44.492917 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:25:44.493119 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:44.493008 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sjhx" podUID="4a00dac0-28b8-435b-a6f5-807b0c734207" Jul 06 15:25:45.491699 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:45.491641 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:25:45.492188 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:45.491781 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slsrs" podUID="914b7462-be30-4d19-99ba-80ee135acec7" Jul 06 15:25:46.492004 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:46.491464 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:25:46.492004 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:46.491606 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sjhx" podUID="4a00dac0-28b8-435b-a6f5-807b0c734207" Jul 06 15:25:46.492004 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:46.491655 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:25:46.492004 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:46.491792 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jr4kq" podUID="20db46ed-b7f8-4846-993e-578a879360b4" Jul 06 15:25:47.491911 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:47.491841 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:25:47.492088 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:47.491965 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slsrs" podUID="914b7462-be30-4d19-99ba-80ee135acec7" Jul 06 15:25:48.012487 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:48.012446 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/914b7462-be30-4d19-99ba-80ee135acec7-original-pull-secret\") pod \"global-pull-secret-syncer-slsrs\" (UID: \"914b7462-be30-4d19-99ba-80ee135acec7\") " pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:25:48.012675 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:48.012497 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20db46ed-b7f8-4846-993e-578a879360b4-metrics-certs\") pod \"network-metrics-daemon-jr4kq\" (UID: \"20db46ed-b7f8-4846-993e-578a879360b4\") " pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:25:48.012675 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:48.012598 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:48.012787 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:48.012678 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20db46ed-b7f8-4846-993e-578a879360b4-metrics-certs podName:20db46ed-b7f8-4846-993e-578a879360b4 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:56.012657387 +0000 UTC m=+17.137719649 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20db46ed-b7f8-4846-993e-578a879360b4-metrics-certs") pod "network-metrics-daemon-jr4kq" (UID: "20db46ed-b7f8-4846-993e-578a879360b4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:48.012787 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:48.012600 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:48.012787 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:48.012758 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/914b7462-be30-4d19-99ba-80ee135acec7-original-pull-secret podName:914b7462-be30-4d19-99ba-80ee135acec7 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:56.012737969 +0000 UTC m=+17.137800225 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/914b7462-be30-4d19-99ba-80ee135acec7-original-pull-secret") pod "global-pull-secret-syncer-slsrs" (UID: "914b7462-be30-4d19-99ba-80ee135acec7") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:48.113098 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:48.113055 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8t9w\" (UniqueName: \"kubernetes.io/projected/4a00dac0-28b8-435b-a6f5-807b0c734207-kube-api-access-v8t9w\") pod \"network-check-target-4sjhx\" (UID: \"4a00dac0-28b8-435b-a6f5-807b0c734207\") " pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:25:48.113282 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:48.113240 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:25:48.113282 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:48.113267 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:25:48.113282 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:48.113281 2573 projected.go:196] Error preparing data for projected volume kube-api-access-v8t9w for pod openshift-network-diagnostics/network-check-target-4sjhx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:48.113460 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:48.113343 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a00dac0-28b8-435b-a6f5-807b0c734207-kube-api-access-v8t9w podName:4a00dac0-28b8-435b-a6f5-807b0c734207 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:56.11332341 +0000 UTC m=+17.238385660 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-v8t9w" (UniqueName: "kubernetes.io/projected/4a00dac0-28b8-435b-a6f5-807b0c734207-kube-api-access-v8t9w") pod "network-check-target-4sjhx" (UID: "4a00dac0-28b8-435b-a6f5-807b0c734207") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:48.491876 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:48.491793 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:25:48.492092 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:48.491923 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sjhx" podUID="4a00dac0-28b8-435b-a6f5-807b0c734207" Jul 06 15:25:48.492092 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:48.492074 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:25:48.492506 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:48.492198 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jr4kq" podUID="20db46ed-b7f8-4846-993e-578a879360b4" Jul 06 15:25:49.493044 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:49.492561 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:25:49.493044 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:49.492680 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slsrs" podUID="914b7462-be30-4d19-99ba-80ee135acec7" Jul 06 15:25:50.492101 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:50.491488 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:25:50.492101 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:50.491600 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sjhx" podUID="4a00dac0-28b8-435b-a6f5-807b0c734207" Jul 06 15:25:50.492101 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:50.491940 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:25:50.492101 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:50.492013 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jr4kq" podUID="20db46ed-b7f8-4846-993e-578a879360b4" Jul 06 15:25:51.491979 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:51.491942 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:25:51.492357 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:51.492099 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slsrs" podUID="914b7462-be30-4d19-99ba-80ee135acec7" Jul 06 15:25:52.491940 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:52.491857 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:25:52.492133 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:52.491966 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sjhx" podUID="4a00dac0-28b8-435b-a6f5-807b0c734207" Jul 06 15:25:52.492133 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:52.492024 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:25:52.492464 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:52.492142 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jr4kq" podUID="20db46ed-b7f8-4846-993e-578a879360b4" Jul 06 15:25:53.492251 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:53.492211 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:25:53.492693 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:53.492352 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slsrs" podUID="914b7462-be30-4d19-99ba-80ee135acec7" Jul 06 15:25:54.492228 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:54.492194 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:25:54.492228 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:54.492233 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:25:54.492709 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:54.492312 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sjhx" podUID="4a00dac0-28b8-435b-a6f5-807b0c734207" Jul 06 15:25:54.492709 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:54.492485 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jr4kq" podUID="20db46ed-b7f8-4846-993e-578a879360b4" Jul 06 15:25:55.491756 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:55.491724 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:25:55.491919 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:55.491838 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slsrs" podUID="914b7462-be30-4d19-99ba-80ee135acec7" Jul 06 15:25:56.069412 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:56.069220 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/914b7462-be30-4d19-99ba-80ee135acec7-original-pull-secret\") pod \"global-pull-secret-syncer-slsrs\" (UID: \"914b7462-be30-4d19-99ba-80ee135acec7\") " pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:25:56.069857 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:56.069432 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20db46ed-b7f8-4846-993e-578a879360b4-metrics-certs\") pod \"network-metrics-daemon-jr4kq\" (UID: \"20db46ed-b7f8-4846-993e-578a879360b4\") " pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:25:56.069857 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:56.069433 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:56.069857 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:56.069510 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/914b7462-be30-4d19-99ba-80ee135acec7-original-pull-secret podName:914b7462-be30-4d19-99ba-80ee135acec7 nodeName:}" failed. No retries permitted until 2026-07-06 15:26:12.069488683 +0000 UTC m=+33.194550933 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/914b7462-be30-4d19-99ba-80ee135acec7-original-pull-secret") pod "global-pull-secret-syncer-slsrs" (UID: "914b7462-be30-4d19-99ba-80ee135acec7") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:56.069857 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:56.069551 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:56.069857 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:56.069600 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20db46ed-b7f8-4846-993e-578a879360b4-metrics-certs podName:20db46ed-b7f8-4846-993e-578a879360b4 nodeName:}" failed. No retries permitted until 2026-07-06 15:26:12.069587978 +0000 UTC m=+33.194650225 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20db46ed-b7f8-4846-993e-578a879360b4-metrics-certs") pod "network-metrics-daemon-jr4kq" (UID: "20db46ed-b7f8-4846-993e-578a879360b4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:56.170886 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:56.170847 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8t9w\" (UniqueName: \"kubernetes.io/projected/4a00dac0-28b8-435b-a6f5-807b0c734207-kube-api-access-v8t9w\") pod \"network-check-target-4sjhx\" (UID: \"4a00dac0-28b8-435b-a6f5-807b0c734207\") " pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:25:56.171064 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:56.171021 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:25:56.171064 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:56.171056 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:25:56.171150 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:56.171069 2573 projected.go:196] Error preparing data for projected volume kube-api-access-v8t9w for pod openshift-network-diagnostics/network-check-target-4sjhx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:56.171150 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:56.171122 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a00dac0-28b8-435b-a6f5-807b0c734207-kube-api-access-v8t9w podName:4a00dac0-28b8-435b-a6f5-807b0c734207 nodeName:}" failed. No retries permitted until 2026-07-06 15:26:12.171108269 +0000 UTC m=+33.296170516 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-v8t9w" (UniqueName: "kubernetes.io/projected/4a00dac0-28b8-435b-a6f5-807b0c734207-kube-api-access-v8t9w") pod "network-check-target-4sjhx" (UID: "4a00dac0-28b8-435b-a6f5-807b0c734207") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:56.491921 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:56.491904 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:25:56.492007 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:56.491912 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:25:56.492053 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:56.491995 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sjhx" podUID="4a00dac0-28b8-435b-a6f5-807b0c734207" Jul 06 15:25:56.492133 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:56.492117 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jr4kq" podUID="20db46ed-b7f8-4846-993e-578a879360b4" Jul 06 15:25:57.491611 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:57.491576 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:25:57.492085 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:57.491727 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slsrs" podUID="914b7462-be30-4d19-99ba-80ee135acec7" Jul 06 15:25:58.491350 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:58.491320 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:25:58.491527 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:58.491320 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:25:58.491527 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:58.491433 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sjhx" podUID="4a00dac0-28b8-435b-a6f5-807b0c734207" Jul 06 15:25:58.491630 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:58.491538 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jr4kq" podUID="20db46ed-b7f8-4846-993e-578a879360b4" Jul 06 15:25:59.493107 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:25:59.493073 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:25:59.493539 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:25:59.493190 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slsrs" podUID="914b7462-be30-4d19-99ba-80ee135acec7" Jul 06 15:26:00.491440 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:00.491414 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:26:00.491573 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:00.491549 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sjhx" podUID="4a00dac0-28b8-435b-a6f5-807b0c734207" Jul 06 15:26:00.491624 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:00.491598 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:26:00.491737 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:00.491701 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jr4kq" podUID="20db46ed-b7f8-4846-993e-578a879360b4" Jul 06 15:26:01.491674 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:01.491504 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:26:01.492463 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:01.491757 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slsrs" podUID="914b7462-be30-4d19-99ba-80ee135acec7" Jul 06 15:26:01.658058 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:01.657981 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hxm84_869b9829-1278-4da3-b582-6364317623f7/ovn-acl-logging/0.log" Jul 06 15:26:01.658311 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:01.658292 2573 generic.go:356] "Generic (PLEG): container finished" podID="869b9829-1278-4da3-b582-6364317623f7" containerID="ffa8b932835d3f0c32f57fb7eaa67c7d337b53aa0c1bae3b98cd8b87e3b37e56" exitCode=1 Jul 06 15:26:01.658382 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:01.658365 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" event={"ID":"869b9829-1278-4da3-b582-6364317623f7","Type":"ContainerStarted","Data":"f96f58e4e9b9044a6e107bcb2b252a3399c15831c04accd1bb4a0e5b13599097"} Jul 06 15:26:01.658454 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:01.658435 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" event={"ID":"869b9829-1278-4da3-b582-6364317623f7","Type":"ContainerStarted","Data":"93c452bc27ed12eef1842f3bccbc1bc26ceec6e44c0accc92c223b08f0f35134"} Jul 06 15:26:01.658491 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:01.658472 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" event={"ID":"869b9829-1278-4da3-b582-6364317623f7","Type":"ContainerStarted","Data":"89686feca4ed1a0ac10d843649f3f2ea388d42ca2d6465d31b85731682cfe341"} Jul 06 15:26:01.658528 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:01.658506 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" event={"ID":"869b9829-1278-4da3-b582-6364317623f7","Type":"ContainerStarted","Data":"e1250456ed88c61cb14abc95fa99113bae1147ba39dc1f318b7db751b9068e4f"} Jul 06 15:26:01.658573 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:01.658551 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" event={"ID":"869b9829-1278-4da3-b582-6364317623f7","Type":"ContainerDied","Data":"ffa8b932835d3f0c32f57fb7eaa67c7d337b53aa0c1bae3b98cd8b87e3b37e56"} Jul 06 15:26:01.658618 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:01.658589 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" event={"ID":"869b9829-1278-4da3-b582-6364317623f7","Type":"ContainerStarted","Data":"6a5e61f67241bc0c9d4bb59ca3826485a9b48be2d9fa287cf750ff6c47237be3"} Jul 06 15:26:01.659739 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:01.659706 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w6h2h" event={"ID":"2b7e6c48-caeb-4515-8706-badbdf1d466a","Type":"ContainerStarted","Data":"c0ae2cbebd9aeacf68006d7e737b4a0901a8649af6fc850ea291d01b352dd524"} Jul 06 15:26:01.661185 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:01.661160 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" event={"ID":"6aadfb29-c480-4157-95e2-e08d98c63411","Type":"ContainerStarted","Data":"60cccefaba913462307c39991ffff271915e578ad288d16dce703eff0351141d"} Jul 06 15:26:01.662457 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:01.662439 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-129.ec2.internal" event={"ID":"7cbb15a3b59006910713defe15de5c17","Type":"ContainerStarted","Data":"052358946b2788774741d4d24cdab397490bb4431cdc949e6b3c035271c00161"} Jul 06 15:26:01.705360 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:01.705316 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-w6h2h" podStartSLOduration=2.50226989 podStartE2EDuration="22.705300136s" totalImagesPullingTime="20.203030246s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:01.684312805 +0000 UTC m=+22.809375075" watchObservedRunningTime="2026-07-06 15:26:01.705300136 +0000 UTC m=+22.830362407" Jul 06 15:26:01.729688 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:01.729647 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-129.ec2.internal" podStartSLOduration=21.729633172 podStartE2EDuration="21.729633172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:01.705553362 +0000 UTC m=+22.830615632" watchObservedRunningTime="2026-07-06 15:26:01.729633172 +0000 UTC m=+22.854695487" Jul 06 15:26:02.492135 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:02.492106 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:26:02.492135 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:02.492136 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:26:02.492838 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:02.492227 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sjhx" podUID="4a00dac0-28b8-435b-a6f5-807b0c734207" Jul 06 15:26:02.492838 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:02.492582 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jr4kq" podUID="20db46ed-b7f8-4846-993e-578a879360b4" Jul 06 15:26:02.666348 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:02.666316 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-klk7w" event={"ID":"994de89b-9ff2-47f1-a1e8-f58a60970457","Type":"ContainerStarted","Data":"e0f360792cd7c653bedfe2f823a03b272f95b38e6d9f22fd6ae9e5d67ef70edc"} Jul 06 15:26:02.667923 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:02.667898 2573 generic.go:356] "Generic (PLEG): container finished" podID="f4831e24-ef2b-4453-8f59-9b1ba159a289" containerID="e11a6ef69b634b697d91f003deecca1852c9630d6b441bd0be2b751fed18c279" exitCode=0 Jul 06 15:26:02.668072 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:02.667966 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9mdzh" event={"ID":"f4831e24-ef2b-4453-8f59-9b1ba159a289","Type":"ContainerDied","Data":"e11a6ef69b634b697d91f003deecca1852c9630d6b441bd0be2b751fed18c279"} Jul 06 15:26:02.669510 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:02.669480 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wrhr9" event={"ID":"b5f3d5ad-ce7e-467c-ab15-30f58cbda56c","Type":"ContainerStarted","Data":"0a451187fff66a7ebd629de806bae65aecf373459261845cd77275fe5819f745"} Jul 06 15:26:02.671088 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:02.671068 2573 generic.go:356] "Generic (PLEG): container finished" podID="90709f330b9c67d8d7962607bcb49842" containerID="6e144bab4642e7539588d732b2e612a165b302615bda493280e36b065dfbb839" exitCode=0 Jul 06 15:26:02.671174 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:02.671151 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-129.ec2.internal" event={"ID":"90709f330b9c67d8d7962607bcb49842","Type":"ContainerDied","Data":"6e144bab4642e7539588d732b2e612a165b302615bda493280e36b065dfbb839"} Jul 06 15:26:02.672737 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:02.672718 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5nhz" event={"ID":"97a51e37-eec1-4e70-9708-a8191629e753","Type":"ContainerStarted","Data":"974516aa56b9f62c4af0d730d03f0209803fed7c92f7c3949cf37846f990ee4e"} Jul 06 15:26:02.674237 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:02.674205 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s6nb2" event={"ID":"54ff6682-60fa-41c6-a133-1dd32f237779","Type":"ContainerStarted","Data":"d5f588c65068c460bec36f92062a2a2169d3892eac1f59de301fe196b22a7527"} Jul 06 15:26:02.675568 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:02.675541 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b97pn" event={"ID":"de1dd724-0faf-491e-bd1d-bf08496ea967","Type":"ContainerStarted","Data":"14ea4ef751ad31d8c8a7413e6a20a81cca9fddecd086e7262d099991e986c683"} Jul 06 15:26:02.691478 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:02.691441 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8zjj5" podStartSLOduration=3.87520224 podStartE2EDuration="23.691424974s" totalImagesPullingTime="19.816222734s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:01.729369044 +0000 UTC m=+22.854431313" watchObservedRunningTime="2026-07-06 15:26:02.691424974 +0000 UTC m=+23.816487246" Jul 06 15:26:02.692076 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:02.692048 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-klk7w" podStartSLOduration=4.013643752 podStartE2EDuration="23.692024102s" totalImagesPullingTime="19.67838035s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:02.691423878 +0000 UTC m=+23.816486173" watchObservedRunningTime="2026-07-06 15:26:02.692024102 +0000 UTC m=+23.817086371" Jul 06 15:26:02.711467 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:02.711431 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-b97pn" podStartSLOduration=4.045756469 podStartE2EDuration="23.711417489s" totalImagesPullingTime="19.66566102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:25:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:02.710798764 +0000 UTC m=+23.835861036" watchObservedRunningTime="2026-07-06 15:26:02.711417489 +0000 UTC m=+23.836479759" Jul 06 15:26:02.781106 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:02.781003 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-s6nb2" podStartSLOduration=3.984666098 podStartE2EDuration="23.780988361s" totalImagesPullingTime="19.796322263s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:02.761177646 +0000 UTC m=+23.886239915" watchObservedRunningTime="2026-07-06 15:26:02.780988361 +0000 UTC m=+23.906050630" Jul 06 15:26:02.781257 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:02.781095 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wrhr9" podStartSLOduration=4.078195626 podStartE2EDuration="23.781090498s" totalImagesPullingTime="19.702894872s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:02.780862716 +0000 UTC m=+23.905925012" watchObservedRunningTime="2026-07-06 15:26:02.781090498 +0000 UTC m=+23.906152768" Jul 06 15:26:03.117621 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:03.117585 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 15:26:03.423259 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:03.423060 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T15:26:03.117600764Z","UUID":"08eff853-6bb7-48be-9ae9-e7f9b9b8e81f","Handler":null,"Name":"","Endpoint":""} Jul 06 15:26:03.424724 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:03.424706 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 15:26:03.424859 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:03.424753 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 15:26:03.494967 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:03.494943 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:26:03.495350 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:03.495163 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slsrs" podUID="914b7462-be30-4d19-99ba-80ee135acec7" Jul 06 15:26:03.680910 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:03.680836 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-129.ec2.internal" event={"ID":"90709f330b9c67d8d7962607bcb49842","Type":"ContainerStarted","Data":"670e1a72b5eb95cc0c68584b93cd9a7506e239049116bc29188810a7a3fd62c7"} Jul 06 15:26:03.683306 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:03.683275 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5nhz" event={"ID":"97a51e37-eec1-4e70-9708-a8191629e753","Type":"ContainerStarted","Data":"28881211e92f41d684897b5c7672de2c6274355bbbd714195158630a7866f481"} Jul 06 15:26:03.687911 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:03.687893 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hxm84_869b9829-1278-4da3-b582-6364317623f7/ovn-acl-logging/0.log" Jul 06 15:26:03.688421 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:03.688398 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" event={"ID":"869b9829-1278-4da3-b582-6364317623f7","Type":"ContainerStarted","Data":"666e58d7b22112946fd636cc27951ea19f262c622cd85ff1c12eb321d7148acf"} Jul 06 15:26:03.702757 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:03.702719 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-129.ec2.internal" podStartSLOduration=23.702705696 podStartE2EDuration="23.702705696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:03.702574731 +0000 UTC m=+24.827637003" watchObservedRunningTime="2026-07-06 15:26:03.702705696 +0000 UTC m=+24.827767965" Jul 06 15:26:04.492121 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:04.492051 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:26:04.492281 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:04.492052 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:26:04.492281 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:04.492155 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jr4kq" podUID="20db46ed-b7f8-4846-993e-578a879360b4" Jul 06 15:26:04.492281 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:04.492249 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sjhx" podUID="4a00dac0-28b8-435b-a6f5-807b0c734207" Jul 06 15:26:04.693098 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:04.693068 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5nhz" event={"ID":"97a51e37-eec1-4e70-9708-a8191629e753","Type":"ContainerStarted","Data":"75c7715b768872af3a27ebb99e9fbeed706fd92f03528e8aaf06dbbc62c9bb5e"} Jul 06 15:26:04.715694 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:04.715639 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5nhz" podStartSLOduration=3.8286226599999997 podStartE2EDuration="25.715619357s" totalImagesPullingTime="21.886996697s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:04.714912296 +0000 UTC m=+25.839974569" watchObservedRunningTime="2026-07-06 15:26:04.715619357 +0000 UTC m=+25.840681628" Jul 06 15:26:05.491974 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:05.491942 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:26:05.492143 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:05.492093 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slsrs" podUID="914b7462-be30-4d19-99ba-80ee135acec7" Jul 06 15:26:06.492048 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:06.491865 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:26:06.492726 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:06.491931 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:26:06.492726 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:06.492127 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sjhx" podUID="4a00dac0-28b8-435b-a6f5-807b0c734207" Jul 06 15:26:06.492726 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:06.492213 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jr4kq" podUID="20db46ed-b7f8-4846-993e-578a879360b4" Jul 06 15:26:06.702208 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:06.702184 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hxm84_869b9829-1278-4da3-b582-6364317623f7/ovn-acl-logging/0.log" Jul 06 15:26:06.702660 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:06.702567 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" event={"ID":"869b9829-1278-4da3-b582-6364317623f7","Type":"ContainerStarted","Data":"b2488ed1d28254155d4225ce84cb9d550980fe7786c054cf8b3eb7ed9e936b51"} Jul 06 15:26:06.702970 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:06.702930 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:26:06.703131 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:06.703115 2573 scope.go:117] "RemoveContainer" containerID="ffa8b932835d3f0c32f57fb7eaa67c7d337b53aa0c1bae3b98cd8b87e3b37e56" Jul 06 15:26:06.719368 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:06.719344 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:26:07.492005 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:07.491981 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:26:07.492125 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:07.492101 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slsrs" podUID="914b7462-be30-4d19-99ba-80ee135acec7" Jul 06 15:26:07.621895 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:07.621867 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-b97pn" Jul 06 15:26:07.622616 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:07.622600 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-b97pn" Jul 06 15:26:07.709329 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:07.709267 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hxm84_869b9829-1278-4da3-b582-6364317623f7/ovn-acl-logging/0.log" Jul 06 15:26:07.709703 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:07.709679 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" event={"ID":"869b9829-1278-4da3-b582-6364317623f7","Type":"ContainerStarted","Data":"be36bfbff23536a38c3d533ad64f4275db3b7ffce3ac72ad57017f1282f3dd86"} Jul 06 15:26:07.710144 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:07.709951 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-b97pn" Jul 06 15:26:07.710144 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:07.709999 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:26:07.710144 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:07.710072 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:26:07.710378 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:07.710358 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-b97pn" Jul 06 15:26:07.730759 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:07.730735 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:26:07.753432 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:07.753392 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" podStartSLOduration=8.994058002 podStartE2EDuration="28.753380031s" totalImagesPullingTime="19.759322029s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:07.753119615 +0000 UTC m=+28.878181886" watchObservedRunningTime="2026-07-06 15:26:07.753380031 +0000 UTC m=+28.878442301" Jul 06 15:26:08.072240 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:08.072026 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4sjhx"] Jul 06 15:26:08.072425 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:08.072303 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:26:08.072425 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:08.072392 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sjhx" podUID="4a00dac0-28b8-435b-a6f5-807b0c734207" Jul 06 15:26:08.074678 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:08.074652 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jr4kq"] Jul 06 15:26:08.074773 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:08.074766 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:26:08.074877 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:08.074856 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jr4kq" podUID="20db46ed-b7f8-4846-993e-578a879360b4" Jul 06 15:26:08.088608 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:08.088584 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-slsrs"] Jul 06 15:26:08.088715 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:08.088673 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:26:08.088772 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:08.088752 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slsrs" podUID="914b7462-be30-4d19-99ba-80ee135acec7" Jul 06 15:26:08.713021 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:08.712986 2573 generic.go:356] "Generic (PLEG): container finished" podID="f4831e24-ef2b-4453-8f59-9b1ba159a289" containerID="dba167602e0689a25fa7ac0feb28848b08dc9b6105ac224663292f3bc5300b36" exitCode=0 Jul 06 15:26:08.713684 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:08.713064 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9mdzh" event={"ID":"f4831e24-ef2b-4453-8f59-9b1ba159a289","Type":"ContainerDied","Data":"dba167602e0689a25fa7ac0feb28848b08dc9b6105ac224663292f3bc5300b36"} Jul 06 15:26:09.104639 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:09.104607 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:09.219526 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:09.219474 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:09.493129 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:09.493102 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:26:09.493336 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:09.493211 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slsrs" podUID="914b7462-be30-4d19-99ba-80ee135acec7" Jul 06 15:26:09.493336 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:09.493247 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:26:09.493434 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:09.493366 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jr4kq" podUID="20db46ed-b7f8-4846-993e-578a879360b4" Jul 06 15:26:09.493434 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:09.493395 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:26:09.493527 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:09.493442 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sjhx" podUID="4a00dac0-28b8-435b-a6f5-807b0c734207" Jul 06 15:26:09.747497 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:09.747425 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:10.720542 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:10.720512 2573 generic.go:356] "Generic (PLEG): container finished" podID="f4831e24-ef2b-4453-8f59-9b1ba159a289" containerID="67e681cde4a83b909a0719df63a0f28dd8e008e25d1623c95744a3c343120312" exitCode=0 Jul 06 15:26:10.720681 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:10.720556 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9mdzh" event={"ID":"f4831e24-ef2b-4453-8f59-9b1ba159a289","Type":"ContainerDied","Data":"67e681cde4a83b909a0719df63a0f28dd8e008e25d1623c95744a3c343120312"} Jul 06 15:26:11.491403 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:11.491369 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:26:11.491773 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:11.491382 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:26:11.491773 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:11.491479 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slsrs" podUID="914b7462-be30-4d19-99ba-80ee135acec7" Jul 06 15:26:11.491773 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:11.491380 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:26:11.491773 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:11.491556 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jr4kq" podUID="20db46ed-b7f8-4846-993e-578a879360b4" Jul 06 15:26:11.491773 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:11.491608 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sjhx" podUID="4a00dac0-28b8-435b-a6f5-807b0c734207" Jul 06 15:26:12.094915 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:12.094831 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/914b7462-be30-4d19-99ba-80ee135acec7-original-pull-secret\") pod \"global-pull-secret-syncer-slsrs\" (UID: \"914b7462-be30-4d19-99ba-80ee135acec7\") " pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:26:12.094915 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:12.094870 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20db46ed-b7f8-4846-993e-578a879360b4-metrics-certs\") pod \"network-metrics-daemon-jr4kq\" (UID: \"20db46ed-b7f8-4846-993e-578a879360b4\") " pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:26:12.095129 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:12.094966 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:26:12.095129 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:12.095013 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20db46ed-b7f8-4846-993e-578a879360b4-metrics-certs podName:20db46ed-b7f8-4846-993e-578a879360b4 nodeName:}" failed. No retries permitted until 2026-07-06 15:26:44.09500043 +0000 UTC m=+65.220062678 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20db46ed-b7f8-4846-993e-578a879360b4-metrics-certs") pod "network-metrics-daemon-jr4kq" (UID: "20db46ed-b7f8-4846-993e-578a879360b4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:26:12.095129 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:12.094967 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:26:12.095129 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:12.095089 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/914b7462-be30-4d19-99ba-80ee135acec7-original-pull-secret podName:914b7462-be30-4d19-99ba-80ee135acec7 nodeName:}" failed. No retries permitted until 2026-07-06 15:26:44.095075704 +0000 UTC m=+65.220137953 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/914b7462-be30-4d19-99ba-80ee135acec7-original-pull-secret") pod "global-pull-secret-syncer-slsrs" (UID: "914b7462-be30-4d19-99ba-80ee135acec7") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:26:12.195687 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:12.195658 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8t9w\" (UniqueName: \"kubernetes.io/projected/4a00dac0-28b8-435b-a6f5-807b0c734207-kube-api-access-v8t9w\") pod \"network-check-target-4sjhx\" (UID: \"4a00dac0-28b8-435b-a6f5-807b0c734207\") " pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:26:12.195830 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:12.195799 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:26:12.195830 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:12.195811 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:26:12.195830 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:12.195821 2573 projected.go:196] Error preparing data for projected volume kube-api-access-v8t9w for pod openshift-network-diagnostics/network-check-target-4sjhx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:26:12.195959 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:12.195865 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a00dac0-28b8-435b-a6f5-807b0c734207-kube-api-access-v8t9w podName:4a00dac0-28b8-435b-a6f5-807b0c734207 nodeName:}" failed. No retries permitted until 2026-07-06 15:26:44.195853325 +0000 UTC m=+65.320915573 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-v8t9w" (UniqueName: "kubernetes.io/projected/4a00dac0-28b8-435b-a6f5-807b0c734207-kube-api-access-v8t9w") pod "network-check-target-4sjhx" (UID: "4a00dac0-28b8-435b-a6f5-807b0c734207") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:26:12.376978 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:12.376908 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:12.448128 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:12.448095 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:12.727423 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:12.727192 2573 generic.go:356] "Generic (PLEG): container finished" podID="f4831e24-ef2b-4453-8f59-9b1ba159a289" containerID="efa252c2015b0c319e9efa34427c8c57ce84f3ffb4d86d3306fb3428ea6cf411" exitCode=0 Jul 06 15:26:12.727423 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:12.727276 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9mdzh" event={"ID":"f4831e24-ef2b-4453-8f59-9b1ba159a289","Type":"ContainerDied","Data":"efa252c2015b0c319e9efa34427c8c57ce84f3ffb4d86d3306fb3428ea6cf411"} Jul 06 15:26:13.067312 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.067264 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:13.492227 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.492131 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:26:13.492227 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.492142 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:26:13.492227 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.492168 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:26:13.492456 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:13.492250 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sjhx" podUID="4a00dac0-28b8-435b-a6f5-807b0c734207" Jul 06 15:26:13.492456 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:13.492379 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jr4kq" podUID="20db46ed-b7f8-4846-993e-578a879360b4" Jul 06 15:26:13.492524 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:13.492472 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slsrs" podUID="914b7462-be30-4d19-99ba-80ee135acec7" Jul 06 15:26:13.663791 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.663761 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-129.ec2.internal" event="NodeReady" Jul 06 15:26:13.663952 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.663901 2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 15:26:13.711939 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.711860 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8fw8f"] Jul 06 15:26:13.730592 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.730524 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ktjtd"] Jul 06 15:26:13.731019 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.730673 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8fw8f" Jul 06 15:26:13.736133 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.736108 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 15:26:13.736339 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.736324 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 15:26:13.736415 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.736399 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wz98m\"" Jul 06 15:26:13.746893 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.746871 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8fw8f"] Jul 06 15:26:13.747027 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.746908 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ktjtd"] Jul 06 15:26:13.747027 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.746973 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ktjtd" Jul 06 15:26:13.749287 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.749269 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 15:26:13.749287 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.749283 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-np6rm\"" Jul 06 15:26:13.749463 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.749284 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 15:26:13.749658 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.749639 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 15:26:13.807901 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.807861 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kngct\" (UniqueName: \"kubernetes.io/projected/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-kube-api-access-kngct\") pod \"dns-default-8fw8f\" (UID: \"fa5d3c60-7684-45d6-aaf2-e5d6cfea0123\") " pod="openshift-dns/dns-default-8fw8f" Jul 06 15:26:13.807901 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.807911 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-config-volume\") pod \"dns-default-8fw8f\" (UID: \"fa5d3c60-7684-45d6-aaf2-e5d6cfea0123\") " pod="openshift-dns/dns-default-8fw8f" Jul 06 15:26:13.808153 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.808002 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-tmp-dir\") pod \"dns-default-8fw8f\" (UID: \"fa5d3c60-7684-45d6-aaf2-e5d6cfea0123\") " pod="openshift-dns/dns-default-8fw8f" Jul 06 15:26:13.808153 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.808093 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-metrics-tls\") pod \"dns-default-8fw8f\" (UID: \"fa5d3c60-7684-45d6-aaf2-e5d6cfea0123\") " pod="openshift-dns/dns-default-8fw8f" Jul 06 15:26:13.908697 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.908660 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kngct\" (UniqueName: \"kubernetes.io/projected/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-kube-api-access-kngct\") pod \"dns-default-8fw8f\" (UID: \"fa5d3c60-7684-45d6-aaf2-e5d6cfea0123\") " pod="openshift-dns/dns-default-8fw8f" Jul 06 15:26:13.908697 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.908703 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-config-volume\") pod \"dns-default-8fw8f\" (UID: \"fa5d3c60-7684-45d6-aaf2-e5d6cfea0123\") " pod="openshift-dns/dns-default-8fw8f" Jul 06 15:26:13.908941 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.908742 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-tmp-dir\") pod \"dns-default-8fw8f\" (UID: \"fa5d3c60-7684-45d6-aaf2-e5d6cfea0123\") " pod="openshift-dns/dns-default-8fw8f" Jul 06 15:26:13.908941 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.908782 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-metrics-tls\") pod \"dns-default-8fw8f\" (UID: \"fa5d3c60-7684-45d6-aaf2-e5d6cfea0123\") " pod="openshift-dns/dns-default-8fw8f" Jul 06 15:26:13.908941 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:13.908865 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:26:13.908941 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:13.908919 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-metrics-tls podName:fa5d3c60-7684-45d6-aaf2-e5d6cfea0123 nodeName:}" failed. No retries permitted until 2026-07-06 15:26:14.408901581 +0000 UTC m=+35.533963829 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-metrics-tls") pod "dns-default-8fw8f" (UID: "fa5d3c60-7684-45d6-aaf2-e5d6cfea0123") : secret "dns-default-metrics-tls" not found Jul 06 15:26:13.909172 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.909064 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql6r4\" (UniqueName: \"kubernetes.io/projected/8e774c49-07c6-48f4-9720-d6ebb9734b9a-kube-api-access-ql6r4\") pod \"ingress-canary-ktjtd\" (UID: \"8e774c49-07c6-48f4-9720-d6ebb9734b9a\") " pod="openshift-ingress-canary/ingress-canary-ktjtd" Jul 06 15:26:13.909172 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.909109 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e774c49-07c6-48f4-9720-d6ebb9734b9a-cert\") pod \"ingress-canary-ktjtd\" (UID: \"8e774c49-07c6-48f4-9720-d6ebb9734b9a\") " pod="openshift-ingress-canary/ingress-canary-ktjtd" Jul 06 15:26:13.909260 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.909167 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-tmp-dir\") pod \"dns-default-8fw8f\" (UID: \"fa5d3c60-7684-45d6-aaf2-e5d6cfea0123\") " pod="openshift-dns/dns-default-8fw8f" Jul 06 15:26:13.909391 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.909374 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-config-volume\") pod \"dns-default-8fw8f\" (UID: \"fa5d3c60-7684-45d6-aaf2-e5d6cfea0123\") " pod="openshift-dns/dns-default-8fw8f" Jul 06 15:26:13.910797 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.910773 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:13.921991 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:13.921968 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kngct\" (UniqueName: \"kubernetes.io/projected/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-kube-api-access-kngct\") pod \"dns-default-8fw8f\" (UID: \"fa5d3c60-7684-45d6-aaf2-e5d6cfea0123\") " pod="openshift-dns/dns-default-8fw8f" Jul 06 15:26:14.007802 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:14.007767 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:14.009661 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:14.009637 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql6r4\" (UniqueName: \"kubernetes.io/projected/8e774c49-07c6-48f4-9720-d6ebb9734b9a-kube-api-access-ql6r4\") pod \"ingress-canary-ktjtd\" (UID: \"8e774c49-07c6-48f4-9720-d6ebb9734b9a\") " pod="openshift-ingress-canary/ingress-canary-ktjtd" Jul 06 15:26:14.009661 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:14.009674 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e774c49-07c6-48f4-9720-d6ebb9734b9a-cert\") pod \"ingress-canary-ktjtd\" (UID: \"8e774c49-07c6-48f4-9720-d6ebb9734b9a\") " pod="openshift-ingress-canary/ingress-canary-ktjtd" Jul 06 15:26:14.012848 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:14.012826 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e774c49-07c6-48f4-9720-d6ebb9734b9a-cert\") pod \"ingress-canary-ktjtd\" (UID: \"8e774c49-07c6-48f4-9720-d6ebb9734b9a\") " pod="openshift-ingress-canary/ingress-canary-ktjtd" Jul 06 15:26:14.019760 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:14.019735 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql6r4\" (UniqueName: \"kubernetes.io/projected/8e774c49-07c6-48f4-9720-d6ebb9734b9a-kube-api-access-ql6r4\") pod \"ingress-canary-ktjtd\" (UID: \"8e774c49-07c6-48f4-9720-d6ebb9734b9a\") " pod="openshift-ingress-canary/ingress-canary-ktjtd" Jul 06 15:26:14.056810 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:14.056780 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ktjtd" Jul 06 15:26:14.261721 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:14.261645 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ktjtd"] Jul 06 15:26:14.266345 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:26:14.266321 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e774c49_07c6_48f4_9720_d6ebb9734b9a.slice/crio-d3d8ebe08548246deab2ea1325bdea13088a1bafd96405fc459c9cefafb13401 WatchSource:0}: Error finding container d3d8ebe08548246deab2ea1325bdea13088a1bafd96405fc459c9cefafb13401: Status 404 returned error can't find the container with id d3d8ebe08548246deab2ea1325bdea13088a1bafd96405fc459c9cefafb13401 Jul 06 15:26:14.413840 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:14.413806 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-metrics-tls\") pod \"dns-default-8fw8f\" (UID: \"fa5d3c60-7684-45d6-aaf2-e5d6cfea0123\") " pod="openshift-dns/dns-default-8fw8f" Jul 06 15:26:14.414018 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:14.413936 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:26:14.414018 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:14.414007 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-metrics-tls podName:fa5d3c60-7684-45d6-aaf2-e5d6cfea0123 nodeName:}" failed. No retries permitted until 2026-07-06 15:26:15.413984176 +0000 UTC m=+36.539046427 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-metrics-tls") pod "dns-default-8fw8f" (UID: "fa5d3c60-7684-45d6-aaf2-e5d6cfea0123") : secret "dns-default-metrics-tls" not found Jul 06 15:26:14.733919 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:14.733834 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ktjtd" event={"ID":"8e774c49-07c6-48f4-9720-d6ebb9734b9a","Type":"ContainerStarted","Data":"d3d8ebe08548246deab2ea1325bdea13088a1bafd96405fc459c9cefafb13401"} Jul 06 15:26:15.422240 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:15.422145 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-metrics-tls\") pod \"dns-default-8fw8f\" (UID: \"fa5d3c60-7684-45d6-aaf2-e5d6cfea0123\") " pod="openshift-dns/dns-default-8fw8f" Jul 06 15:26:15.422240 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:15.422240 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:26:15.422467 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:15.422313 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-metrics-tls podName:fa5d3c60-7684-45d6-aaf2-e5d6cfea0123 nodeName:}" failed. No retries permitted until 2026-07-06 15:26:17.422291895 +0000 UTC m=+38.547354181 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-metrics-tls") pod "dns-default-8fw8f" (UID: "fa5d3c60-7684-45d6-aaf2-e5d6cfea0123") : secret "dns-default-metrics-tls" not found Jul 06 15:26:15.492219 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:15.492152 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:26:15.492798 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:15.492425 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:26:15.492798 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:15.492468 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:26:15.496841 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:15.496817 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gqzv9\"" Jul 06 15:26:15.496943 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:15.496877 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 15:26:15.497542 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:15.497525 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 15:26:15.497685 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:15.497670 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 15:26:15.497941 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:15.497775 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 15:26:15.497941 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:15.497857 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cvwwb\"" Jul 06 15:26:17.403467 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:17.403292 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:17.437502 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:17.437469 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-metrics-tls\") pod \"dns-default-8fw8f\" (UID: \"fa5d3c60-7684-45d6-aaf2-e5d6cfea0123\") " pod="openshift-dns/dns-default-8fw8f" Jul 06 15:26:17.437684 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:17.437662 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:26:17.437757 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:17.437747 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-metrics-tls podName:fa5d3c60-7684-45d6-aaf2-e5d6cfea0123 nodeName:}" failed. No retries permitted until 2026-07-06 15:26:21.437725689 +0000 UTC m=+42.562787951 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-metrics-tls") pod "dns-default-8fw8f" (UID: "fa5d3c60-7684-45d6-aaf2-e5d6cfea0123") : secret "dns-default-metrics-tls" not found Jul 06 15:26:17.504394 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:17.504365 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:17.712692 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:17.712569 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:17.813476 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:17.813442 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:18.746951 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:18.746868 2573 generic.go:356] "Generic (PLEG): container finished" podID="f4831e24-ef2b-4453-8f59-9b1ba159a289" containerID="49dce26fece01c21f28a40f397d4f7e1ee3b503733e8b4144a05349b2f8436fc" exitCode=0 Jul 06 15:26:18.746951 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:18.746935 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9mdzh" event={"ID":"f4831e24-ef2b-4453-8f59-9b1ba159a289","Type":"ContainerDied","Data":"49dce26fece01c21f28a40f397d4f7e1ee3b503733e8b4144a05349b2f8436fc"} Jul 06 15:26:18.748464 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:18.748439 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ktjtd" event={"ID":"8e774c49-07c6-48f4-9720-d6ebb9734b9a","Type":"ContainerStarted","Data":"63577b8654fc6d45a4491fc964335e48f87ef4d881a50b32b21405b72d549d0d"} Jul 06 15:26:18.794271 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:18.794227 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ktjtd" podStartSLOduration=1.806007465 podStartE2EDuration="5.794209042s" totalImagesPullingTime="3.988201577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:26:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:18.793440121 +0000 UTC m=+39.918502421" watchObservedRunningTime="2026-07-06 15:26:18.794209042 +0000 UTC m=+39.919271312" Jul 06 15:26:19.095791 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:19.095715 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:19.753781 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:19.753745 2573 generic.go:356] "Generic (PLEG): container finished" podID="f4831e24-ef2b-4453-8f59-9b1ba159a289" containerID="e0457d9673ea77c8f6a06288e5b630ee747154e5e1b1f142ceec34e423cfc7a6" exitCode=0 Jul 06 15:26:19.754296 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:19.753817 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9mdzh" event={"ID":"f4831e24-ef2b-4453-8f59-9b1ba159a289","Type":"ContainerDied","Data":"e0457d9673ea77c8f6a06288e5b630ee747154e5e1b1f142ceec34e423cfc7a6"} Jul 06 15:26:20.434641 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:20.434608 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:20.501860 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:20.501827 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:20.758795 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:20.758766 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9mdzh" event={"ID":"f4831e24-ef2b-4453-8f59-9b1ba159a289","Type":"ContainerStarted","Data":"919e8052fc02f4098dac98aafc2a1e18234ca34195ccd6eb62713b3201941dc1"} Jul 06 15:26:20.803411 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:20.803360 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9mdzh" podStartSLOduration=9.340231979 podStartE2EDuration="41.803340239s" totalImagesPullingTime="32.46310826s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:20.801390313 +0000 UTC m=+41.926452583" watchObservedRunningTime="2026-07-06 15:26:20.803340239 +0000 UTC m=+41.928402509" Jul 06 15:26:20.887999 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:20.887974 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:20.989305 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:20.989274 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:21.115297 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:21.115194 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:21.464230 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:21.464143 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-metrics-tls\") pod \"dns-default-8fw8f\" (UID: \"fa5d3c60-7684-45d6-aaf2-e5d6cfea0123\") " pod="openshift-dns/dns-default-8fw8f" Jul 06 15:26:21.464368 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:21.464293 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:26:21.464368 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:21.464359 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-metrics-tls podName:fa5d3c60-7684-45d6-aaf2-e5d6cfea0123 nodeName:}" failed. No retries permitted until 2026-07-06 15:26:29.4643437 +0000 UTC m=+50.589405947 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-metrics-tls") pod "dns-default-8fw8f" (UID: "fa5d3c60-7684-45d6-aaf2-e5d6cfea0123") : secret "dns-default-metrics-tls" not found Jul 06 15:26:23.608404 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.608358 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-c4dd7c89f-stbqv"] Jul 06 15:26:23.646185 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.646158 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh"] Jul 06 15:26:23.646340 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.646272 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c4dd7c89f-stbqv" Jul 06 15:26:23.648779 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.648755 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 06 15:26:23.648913 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.648800 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 06 15:26:23.649014 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.649002 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 06 15:26:23.649073 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.649006 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 06 15:26:23.662264 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.662242 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh"] Jul 06 15:26:23.662346 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.662269 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-c4dd7c89f-stbqv"] Jul 06 15:26:23.662346 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.662343 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" Jul 06 15:26:23.664940 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.664920 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 06 15:26:23.665120 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.665088 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 06 15:26:23.665120 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.665107 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 06 15:26:23.665120 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.665116 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 06 15:26:23.780264 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.780233 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a8ed37d9-d81f-4d44-9a90-141451f9da8c-ca\") pod \"cluster-proxy-proxy-agent-5cf4f964f7-r27hh\" (UID: \"a8ed37d9-d81f-4d44-9a90-141451f9da8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" Jul 06 15:26:23.780264 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.780268 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a8ed37d9-d81f-4d44-9a90-141451f9da8c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5cf4f964f7-r27hh\" (UID: \"a8ed37d9-d81f-4d44-9a90-141451f9da8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" Jul 06 15:26:23.780463 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.780287 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a8ed37d9-d81f-4d44-9a90-141451f9da8c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5cf4f964f7-r27hh\" (UID: \"a8ed37d9-d81f-4d44-9a90-141451f9da8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" Jul 06 15:26:23.780463 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.780339 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bd4b8811-1315-4cae-838d-c8845cbf1d53-klusterlet-config\") pod \"klusterlet-addon-workmgr-c4dd7c89f-stbqv\" (UID: \"bd4b8811-1315-4cae-838d-c8845cbf1d53\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c4dd7c89f-stbqv" Jul 06 15:26:23.780463 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.780363 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8ed37d9-d81f-4d44-9a90-141451f9da8c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5cf4f964f7-r27hh\" (UID: \"a8ed37d9-d81f-4d44-9a90-141451f9da8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" Jul 06 15:26:23.780463 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.780381 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjbdj\" (UniqueName: \"kubernetes.io/projected/a8ed37d9-d81f-4d44-9a90-141451f9da8c-kube-api-access-fjbdj\") pod \"cluster-proxy-proxy-agent-5cf4f964f7-r27hh\" (UID: \"a8ed37d9-d81f-4d44-9a90-141451f9da8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" Jul 06 15:26:23.780463 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.780403 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd4b8811-1315-4cae-838d-c8845cbf1d53-tmp\") pod \"klusterlet-addon-workmgr-c4dd7c89f-stbqv\" (UID: \"bd4b8811-1315-4cae-838d-c8845cbf1d53\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c4dd7c89f-stbqv" Jul 06 15:26:23.780623 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.780488 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfdrx\" (UniqueName: \"kubernetes.io/projected/bd4b8811-1315-4cae-838d-c8845cbf1d53-kube-api-access-kfdrx\") pod \"klusterlet-addon-workmgr-c4dd7c89f-stbqv\" (UID: \"bd4b8811-1315-4cae-838d-c8845cbf1d53\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c4dd7c89f-stbqv" Jul 06 15:26:23.780623 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.780522 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a8ed37d9-d81f-4d44-9a90-141451f9da8c-hub\") pod \"cluster-proxy-proxy-agent-5cf4f964f7-r27hh\" (UID: \"a8ed37d9-d81f-4d44-9a90-141451f9da8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" Jul 06 15:26:23.882433 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.882349 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfdrx\" (UniqueName: \"kubernetes.io/projected/bd4b8811-1315-4cae-838d-c8845cbf1d53-kube-api-access-kfdrx\") pod \"klusterlet-addon-workmgr-c4dd7c89f-stbqv\" (UID: \"bd4b8811-1315-4cae-838d-c8845cbf1d53\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c4dd7c89f-stbqv" Jul 06 15:26:23.882704 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.882679 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a8ed37d9-d81f-4d44-9a90-141451f9da8c-hub\") pod \"cluster-proxy-proxy-agent-5cf4f964f7-r27hh\" (UID: \"a8ed37d9-d81f-4d44-9a90-141451f9da8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" Jul 06 15:26:23.882789 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.882734 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a8ed37d9-d81f-4d44-9a90-141451f9da8c-ca\") pod \"cluster-proxy-proxy-agent-5cf4f964f7-r27hh\" (UID: \"a8ed37d9-d81f-4d44-9a90-141451f9da8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" Jul 06 15:26:23.882789 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.882782 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a8ed37d9-d81f-4d44-9a90-141451f9da8c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5cf4f964f7-r27hh\" (UID: \"a8ed37d9-d81f-4d44-9a90-141451f9da8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" Jul 06 15:26:23.882892 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.882840 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a8ed37d9-d81f-4d44-9a90-141451f9da8c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5cf4f964f7-r27hh\" (UID: \"a8ed37d9-d81f-4d44-9a90-141451f9da8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" Jul 06 15:26:23.882892 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.882878 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bd4b8811-1315-4cae-838d-c8845cbf1d53-klusterlet-config\") pod \"klusterlet-addon-workmgr-c4dd7c89f-stbqv\" (UID: \"bd4b8811-1315-4cae-838d-c8845cbf1d53\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c4dd7c89f-stbqv" Jul 06 15:26:23.882994 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.882915 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8ed37d9-d81f-4d44-9a90-141451f9da8c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5cf4f964f7-r27hh\" (UID: \"a8ed37d9-d81f-4d44-9a90-141451f9da8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" Jul 06 15:26:23.882994 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.882944 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjbdj\" (UniqueName: \"kubernetes.io/projected/a8ed37d9-d81f-4d44-9a90-141451f9da8c-kube-api-access-fjbdj\") pod \"cluster-proxy-proxy-agent-5cf4f964f7-r27hh\" (UID: \"a8ed37d9-d81f-4d44-9a90-141451f9da8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" Jul 06 15:26:23.882994 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.882977 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd4b8811-1315-4cae-838d-c8845cbf1d53-tmp\") pod \"klusterlet-addon-workmgr-c4dd7c89f-stbqv\" (UID: \"bd4b8811-1315-4cae-838d-c8845cbf1d53\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c4dd7c89f-stbqv" Jul 06 15:26:23.883581 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.883555 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd4b8811-1315-4cae-838d-c8845cbf1d53-tmp\") pod \"klusterlet-addon-workmgr-c4dd7c89f-stbqv\" (UID: \"bd4b8811-1315-4cae-838d-c8845cbf1d53\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c4dd7c89f-stbqv" Jul 06 15:26:23.886790 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.886764 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8ed37d9-d81f-4d44-9a90-141451f9da8c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5cf4f964f7-r27hh\" (UID: \"a8ed37d9-d81f-4d44-9a90-141451f9da8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" Jul 06 15:26:23.888310 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.888287 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a8ed37d9-d81f-4d44-9a90-141451f9da8c-hub\") pod \"cluster-proxy-proxy-agent-5cf4f964f7-r27hh\" (UID: \"a8ed37d9-d81f-4d44-9a90-141451f9da8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" Jul 06 15:26:23.888383 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.888308 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a8ed37d9-d81f-4d44-9a90-141451f9da8c-ca\") pod \"cluster-proxy-proxy-agent-5cf4f964f7-r27hh\" (UID: \"a8ed37d9-d81f-4d44-9a90-141451f9da8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" Jul 06 15:26:23.888383 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.888316 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a8ed37d9-d81f-4d44-9a90-141451f9da8c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5cf4f964f7-r27hh\" (UID: \"a8ed37d9-d81f-4d44-9a90-141451f9da8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" Jul 06 15:26:23.888466 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.888447 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bd4b8811-1315-4cae-838d-c8845cbf1d53-klusterlet-config\") pod \"klusterlet-addon-workmgr-c4dd7c89f-stbqv\" (UID: \"bd4b8811-1315-4cae-838d-c8845cbf1d53\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c4dd7c89f-stbqv" Jul 06 15:26:23.888732 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.888718 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a8ed37d9-d81f-4d44-9a90-141451f9da8c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5cf4f964f7-r27hh\" (UID: \"a8ed37d9-d81f-4d44-9a90-141451f9da8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" Jul 06 15:26:23.894075 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.894055 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfdrx\" (UniqueName: \"kubernetes.io/projected/bd4b8811-1315-4cae-838d-c8845cbf1d53-kube-api-access-kfdrx\") pod \"klusterlet-addon-workmgr-c4dd7c89f-stbqv\" (UID: \"bd4b8811-1315-4cae-838d-c8845cbf1d53\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c4dd7c89f-stbqv" Jul 06 15:26:23.896378 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.896355 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjbdj\" (UniqueName: \"kubernetes.io/projected/a8ed37d9-d81f-4d44-9a90-141451f9da8c-kube-api-access-fjbdj\") pod \"cluster-proxy-proxy-agent-5cf4f964f7-r27hh\" (UID: \"a8ed37d9-d81f-4d44-9a90-141451f9da8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" Jul 06 15:26:23.955515 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.955487 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c4dd7c89f-stbqv" Jul 06 15:26:23.982698 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:23.982672 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" Jul 06 15:26:24.124070 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:24.124009 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-c4dd7c89f-stbqv"] Jul 06 15:26:24.127495 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:26:24.127468 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd4b8811_1315_4cae_838d_c8845cbf1d53.slice/crio-a26958a344d1cb6cf65f6ab843685d1e57e949cdf1adc0dc52b53592aa9f7f58 WatchSource:0}: Error finding container a26958a344d1cb6cf65f6ab843685d1e57e949cdf1adc0dc52b53592aa9f7f58: Status 404 returned error can't find the container with id a26958a344d1cb6cf65f6ab843685d1e57e949cdf1adc0dc52b53592aa9f7f58 Jul 06 15:26:24.145900 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:24.145717 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh"] Jul 06 15:26:24.148752 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:26:24.148730 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8ed37d9_d81f_4d44_9a90_141451f9da8c.slice/crio-798bcf4d77606431361e07bcc1aff90a4a3b07ef661542cb1c73c9cb32d31a2a WatchSource:0}: Error finding container 798bcf4d77606431361e07bcc1aff90a4a3b07ef661542cb1c73c9cb32d31a2a: Status 404 returned error can't find the container with id 798bcf4d77606431361e07bcc1aff90a4a3b07ef661542cb1c73c9cb32d31a2a Jul 06 15:26:24.768223 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:24.768190 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" event={"ID":"a8ed37d9-d81f-4d44-9a90-141451f9da8c","Type":"ContainerStarted","Data":"798bcf4d77606431361e07bcc1aff90a4a3b07ef661542cb1c73c9cb32d31a2a"} Jul 06 15:26:24.769220 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:24.769202 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c4dd7c89f-stbqv" event={"ID":"bd4b8811-1315-4cae-838d-c8845cbf1d53","Type":"ContainerStarted","Data":"a26958a344d1cb6cf65f6ab843685d1e57e949cdf1adc0dc52b53592aa9f7f58"} Jul 06 15:26:29.533883 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:29.533836 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-metrics-tls\") pod \"dns-default-8fw8f\" (UID: \"fa5d3c60-7684-45d6-aaf2-e5d6cfea0123\") " pod="openshift-dns/dns-default-8fw8f" Jul 06 15:26:29.534311 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:29.533993 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:26:29.534311 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:29.534062 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-metrics-tls podName:fa5d3c60-7684-45d6-aaf2-e5d6cfea0123 nodeName:}" failed. No retries permitted until 2026-07-06 15:26:45.534049508 +0000 UTC m=+66.659111755 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-metrics-tls") pod "dns-default-8fw8f" (UID: "fa5d3c60-7684-45d6-aaf2-e5d6cfea0123") : secret "dns-default-metrics-tls" not found Jul 06 15:26:30.787788 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:30.787751 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" event={"ID":"a8ed37d9-d81f-4d44-9a90-141451f9da8c","Type":"ContainerStarted","Data":"7fff35e2ecf83f15f938e86f6d367f1604f1f7c559505a28f5dbcaf78d60c1fc"} Jul 06 15:26:30.788207 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:30.787797 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" event={"ID":"a8ed37d9-d81f-4d44-9a90-141451f9da8c","Type":"ContainerStarted","Data":"a66bbe52949c733ddd819617303d02c24afb1e374333c30a1873a56eaaefbe03"} Jul 06 15:26:30.788207 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:30.787810 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" event={"ID":"a8ed37d9-d81f-4d44-9a90-141451f9da8c","Type":"ContainerStarted","Data":"0dd57efa8713b478ef956ede178afba8049f4be66fce25cdd89cf4f9ac9a8ab7"} Jul 06 15:26:30.789155 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:30.789131 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c4dd7c89f-stbqv" event={"ID":"bd4b8811-1315-4cae-838d-c8845cbf1d53","Type":"ContainerStarted","Data":"5990a0eac5c09362f2f787fbe2cc9f2a6a39387e8ebfc0705c01c04fec076e33"} Jul 06 15:26:30.789370 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:30.789349 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c4dd7c89f-stbqv" Jul 06 15:26:30.790919 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:30.790903 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c4dd7c89f-stbqv" Jul 06 15:26:30.846492 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:30.846445 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c4dd7c89f-stbqv" podStartSLOduration=2.015467993 podStartE2EDuration="7.846430818s" totalImagesPullingTime="5.830962825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:26:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:30.845508978 +0000 UTC m=+51.970571248" watchObservedRunningTime="2026-07-06 15:26:30.846430818 +0000 UTC m=+51.971493088" Jul 06 15:26:30.846663 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:30.846644 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" podStartSLOduration=2.050791424 podStartE2EDuration="7.846639561s" totalImagesPullingTime="5.795848137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:26:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:30.816176767 +0000 UTC m=+51.941239038" watchObservedRunningTime="2026-07-06 15:26:30.846639561 +0000 UTC m=+51.971701830" Jul 06 15:26:33.363051 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:33.362992 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:33.440223 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:33.440194 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:39.725920 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:39.725890 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hxm84" Jul 06 15:26:39.891452 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:39.891423 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:39.985285 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:39.985212 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:41.734436 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:41.734393 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:41.804417 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:41.804391 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:44.134644 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:44.134603 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/914b7462-be30-4d19-99ba-80ee135acec7-original-pull-secret\") pod \"global-pull-secret-syncer-slsrs\" (UID: \"914b7462-be30-4d19-99ba-80ee135acec7\") " pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:26:44.135087 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:44.134649 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20db46ed-b7f8-4846-993e-578a879360b4-metrics-certs\") pod \"network-metrics-daemon-jr4kq\" (UID: \"20db46ed-b7f8-4846-993e-578a879360b4\") " pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:26:44.137206 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:44.137188 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 15:26:44.137285 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:44.137234 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 15:26:44.145179 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:44.145159 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 15:26:44.145284 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:44.145229 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20db46ed-b7f8-4846-993e-578a879360b4-metrics-certs podName:20db46ed-b7f8-4846-993e-578a879360b4 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:48.14520706 +0000 UTC m=+129.270269312 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20db46ed-b7f8-4846-993e-578a879360b4-metrics-certs") pod "network-metrics-daemon-jr4kq" (UID: "20db46ed-b7f8-4846-993e-578a879360b4") : secret "metrics-daemon-secret" not found Jul 06 15:26:44.147203 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:44.147181 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/914b7462-be30-4d19-99ba-80ee135acec7-original-pull-secret\") pod \"global-pull-secret-syncer-slsrs\" (UID: \"914b7462-be30-4d19-99ba-80ee135acec7\") " pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:26:44.235163 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:44.235115 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8t9w\" (UniqueName: \"kubernetes.io/projected/4a00dac0-28b8-435b-a6f5-807b0c734207-kube-api-access-v8t9w\") pod \"network-check-target-4sjhx\" (UID: \"4a00dac0-28b8-435b-a6f5-807b0c734207\") " pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:26:44.237981 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:44.237962 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 15:26:44.248671 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:44.248649 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 15:26:44.258839 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:44.258822 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8t9w\" (UniqueName: \"kubernetes.io/projected/4a00dac0-28b8-435b-a6f5-807b0c734207-kube-api-access-v8t9w\") pod \"network-check-target-4sjhx\" (UID: \"4a00dac0-28b8-435b-a6f5-807b0c734207\") " pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:26:44.306881 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:44.306840 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slsrs" Jul 06 15:26:44.323212 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:44.323190 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gqzv9\"" Jul 06 15:26:44.330789 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:44.330766 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:26:44.442661 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:44.442626 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-slsrs"] Jul 06 15:26:44.445521 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:26:44.445496 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod914b7462_be30_4d19_99ba_80ee135acec7.slice/crio-8eca1c1b00d8adf2d19396fc2c1e3864b5598831546e190e23616441adf5aecc WatchSource:0}: Error finding container 8eca1c1b00d8adf2d19396fc2c1e3864b5598831546e190e23616441adf5aecc: Status 404 returned error can't find the container with id 8eca1c1b00d8adf2d19396fc2c1e3864b5598831546e190e23616441adf5aecc Jul 06 15:26:44.463315 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:44.463279 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4sjhx"] Jul 06 15:26:44.467482 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:26:44.467452 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a00dac0_28b8_435b_a6f5_807b0c734207.slice/crio-87fea3b9edce636214057589151e64110910764318a58112ac0f919a2194bd80 WatchSource:0}: Error finding container 87fea3b9edce636214057589151e64110910764318a58112ac0f919a2194bd80: Status 404 returned error can't find the container with id 87fea3b9edce636214057589151e64110910764318a58112ac0f919a2194bd80 Jul 06 15:26:44.824194 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:44.824156 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4sjhx" event={"ID":"4a00dac0-28b8-435b-a6f5-807b0c734207","Type":"ContainerStarted","Data":"87fea3b9edce636214057589151e64110910764318a58112ac0f919a2194bd80"} Jul 06 15:26:44.825444 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:44.825417 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-slsrs" event={"ID":"914b7462-be30-4d19-99ba-80ee135acec7","Type":"ContainerStarted","Data":"8eca1c1b00d8adf2d19396fc2c1e3864b5598831546e190e23616441adf5aecc"} Jul 06 15:26:45.545582 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:45.545474 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-metrics-tls\") pod \"dns-default-8fw8f\" (UID: \"fa5d3c60-7684-45d6-aaf2-e5d6cfea0123\") " pod="openshift-dns/dns-default-8fw8f" Jul 06 15:26:45.546249 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:45.545618 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:26:45.546249 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:26:45.545689 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-metrics-tls podName:fa5d3c60-7684-45d6-aaf2-e5d6cfea0123 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:17.545669801 +0000 UTC m=+98.670732053 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-metrics-tls") pod "dns-default-8fw8f" (UID: "fa5d3c60-7684-45d6-aaf2-e5d6cfea0123") : secret "dns-default-metrics-tls" not found Jul 06 15:26:49.842437 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:49.842398 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-slsrs" event={"ID":"914b7462-be30-4d19-99ba-80ee135acec7","Type":"ContainerStarted","Data":"c3d3d31914dd57634c8cbc646345fa02bf8d6fa6d8fa734ad34bc2c6b508bee6"} Jul 06 15:26:49.843746 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:49.843724 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4sjhx" event={"ID":"4a00dac0-28b8-435b-a6f5-807b0c734207","Type":"ContainerStarted","Data":"75744705913be70f76951e9887b298711fb0275b4489c0df25f91a27d8ab805b"} Jul 06 15:26:49.843906 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:49.843854 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:26:49.861458 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:49.861422 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-slsrs" podStartSLOduration=66.222775792 podStartE2EDuration="1m10.861408294s" totalImagesPullingTime="4.638632502s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:49.860988095 +0000 UTC m=+70.986050375" watchObservedRunningTime="2026-07-06 15:26:49.861408294 +0000 UTC m=+70.986470597" Jul 06 15:26:49.879206 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:26:49.879169 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4sjhx" podStartSLOduration=66.275589797 podStartE2EDuration="1m10.87915441s" totalImagesPullingTime="4.603564613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:25:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:49.878665571 +0000 UTC m=+71.003727840" watchObservedRunningTime="2026-07-06 15:26:49.87915441 +0000 UTC m=+71.004216658" Jul 06 15:27:17.565198 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:17.565160 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-metrics-tls\") pod \"dns-default-8fw8f\" (UID: \"fa5d3c60-7684-45d6-aaf2-e5d6cfea0123\") " pod="openshift-dns/dns-default-8fw8f" Jul 06 15:27:17.565680 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:27:17.565294 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:27:17.565680 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:27:17.565358 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-metrics-tls podName:fa5d3c60-7684-45d6-aaf2-e5d6cfea0123 nodeName:}" failed. No retries permitted until 2026-07-06 15:28:21.565341241 +0000 UTC m=+162.690403506 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-metrics-tls") pod "dns-default-8fw8f" (UID: "fa5d3c60-7684-45d6-aaf2-e5d6cfea0123") : secret "dns-default-metrics-tls" not found Jul 06 15:27:20.848872 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:20.848844 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4sjhx" Jul 06 15:27:39.518584 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:39.518557 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:40.833379 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:40.833346 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:41.937366 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:41.937323 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:43.767765 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:43.767732 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:43.832728 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:43.832693 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-w6hqj"] Jul 06 15:27:43.834864 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:43.834845 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w6hqj" Jul 06 15:27:43.837704 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:43.837684 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 15:27:43.837823 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:43.837700 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 15:27:43.837941 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:43.837929 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xh7vl\"" Jul 06 15:27:43.838014 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:43.837998 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 15:27:43.838502 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:43.838486 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 15:27:43.850973 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:43.850953 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w6hqj"] Jul 06 15:27:43.867323 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:43.867296 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:43.936816 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:43.936785 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:43.941750 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:43.941732 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/537918f5-ba69-4fb8-99ce-dc171dc79a4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w6hqj\" (UID: \"537918f5-ba69-4fb8-99ce-dc171dc79a4a\") " pod="openshift-insights/insights-runtime-extractor-w6hqj" Jul 06 15:27:43.941826 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:43.941760 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/537918f5-ba69-4fb8-99ce-dc171dc79a4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w6hqj\" (UID: \"537918f5-ba69-4fb8-99ce-dc171dc79a4a\") " pod="openshift-insights/insights-runtime-extractor-w6hqj" Jul 06 15:27:43.941874 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:43.941823 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/537918f5-ba69-4fb8-99ce-dc171dc79a4a-crio-socket\") pod \"insights-runtime-extractor-w6hqj\" (UID: \"537918f5-ba69-4fb8-99ce-dc171dc79a4a\") " pod="openshift-insights/insights-runtime-extractor-w6hqj" Jul 06 15:27:43.941874 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:43.941838 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/537918f5-ba69-4fb8-99ce-dc171dc79a4a-data-volume\") pod \"insights-runtime-extractor-w6hqj\" (UID: \"537918f5-ba69-4fb8-99ce-dc171dc79a4a\") " pod="openshift-insights/insights-runtime-extractor-w6hqj" Jul 06 15:27:43.941874 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:43.941856 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd68x\" (UniqueName: \"kubernetes.io/projected/537918f5-ba69-4fb8-99ce-dc171dc79a4a-kube-api-access-pd68x\") pod \"insights-runtime-extractor-w6hqj\" (UID: \"537918f5-ba69-4fb8-99ce-dc171dc79a4a\") " pod="openshift-insights/insights-runtime-extractor-w6hqj" Jul 06 15:27:44.012351 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:44.012320 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:44.042630 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:44.042550 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/537918f5-ba69-4fb8-99ce-dc171dc79a4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w6hqj\" (UID: \"537918f5-ba69-4fb8-99ce-dc171dc79a4a\") " pod="openshift-insights/insights-runtime-extractor-w6hqj" Jul 06 15:27:44.042630 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:44.042583 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/537918f5-ba69-4fb8-99ce-dc171dc79a4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w6hqj\" (UID: \"537918f5-ba69-4fb8-99ce-dc171dc79a4a\") " pod="openshift-insights/insights-runtime-extractor-w6hqj" Jul 06 15:27:44.042840 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:44.042644 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/537918f5-ba69-4fb8-99ce-dc171dc79a4a-crio-socket\") pod \"insights-runtime-extractor-w6hqj\" (UID: \"537918f5-ba69-4fb8-99ce-dc171dc79a4a\") " pod="openshift-insights/insights-runtime-extractor-w6hqj" Jul 06 15:27:44.042840 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:44.042660 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/537918f5-ba69-4fb8-99ce-dc171dc79a4a-data-volume\") pod \"insights-runtime-extractor-w6hqj\" (UID: \"537918f5-ba69-4fb8-99ce-dc171dc79a4a\") " pod="openshift-insights/insights-runtime-extractor-w6hqj" Jul 06 15:27:44.042840 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:44.042701 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd68x\" (UniqueName: \"kubernetes.io/projected/537918f5-ba69-4fb8-99ce-dc171dc79a4a-kube-api-access-pd68x\") pod \"insights-runtime-extractor-w6hqj\" (UID: \"537918f5-ba69-4fb8-99ce-dc171dc79a4a\") " pod="openshift-insights/insights-runtime-extractor-w6hqj" Jul 06 15:27:44.042840 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:27:44.042719 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 15:27:44.042840 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:27:44.042745 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 15:27:44.042840 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:44.042767 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/537918f5-ba69-4fb8-99ce-dc171dc79a4a-crio-socket\") pod \"insights-runtime-extractor-w6hqj\" (UID: \"537918f5-ba69-4fb8-99ce-dc171dc79a4a\") " pod="openshift-insights/insights-runtime-extractor-w6hqj" Jul 06 15:27:44.042840 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:27:44.042789 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/537918f5-ba69-4fb8-99ce-dc171dc79a4a-insights-runtime-extractor-tls podName:537918f5-ba69-4fb8-99ce-dc171dc79a4a nodeName:}" failed. No retries permitted until 2026-07-06 15:27:44.542769884 +0000 UTC m=+125.667832136 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/537918f5-ba69-4fb8-99ce-dc171dc79a4a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w6hqj" (UID: "537918f5-ba69-4fb8-99ce-dc171dc79a4a") : secret "insights-runtime-extractor-tls" not found Jul 06 15:27:44.042840 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:27:44.042816 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/537918f5-ba69-4fb8-99ce-dc171dc79a4a-kube-rbac-proxy-cm podName:537918f5-ba69-4fb8-99ce-dc171dc79a4a nodeName:}" failed. No retries permitted until 2026-07-06 15:27:44.542800699 +0000 UTC m=+125.667862961 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/537918f5-ba69-4fb8-99ce-dc171dc79a4a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w6hqj" (UID: "537918f5-ba69-4fb8-99ce-dc171dc79a4a") : configmap "kube-rbac-proxy" not found Jul 06 15:27:44.043190 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:44.043022 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/537918f5-ba69-4fb8-99ce-dc171dc79a4a-data-volume\") pod \"insights-runtime-extractor-w6hqj\" (UID: \"537918f5-ba69-4fb8-99ce-dc171dc79a4a\") " pod="openshift-insights/insights-runtime-extractor-w6hqj" Jul 06 15:27:44.071719 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:44.071694 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd68x\" (UniqueName: \"kubernetes.io/projected/537918f5-ba69-4fb8-99ce-dc171dc79a4a-kube-api-access-pd68x\") pod \"insights-runtime-extractor-w6hqj\" (UID: \"537918f5-ba69-4fb8-99ce-dc171dc79a4a\") " pod="openshift-insights/insights-runtime-extractor-w6hqj" Jul 06 15:27:44.480071 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:44.479987 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:44.547020 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:44.546989 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/537918f5-ba69-4fb8-99ce-dc171dc79a4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w6hqj\" (UID: \"537918f5-ba69-4fb8-99ce-dc171dc79a4a\") " pod="openshift-insights/insights-runtime-extractor-w6hqj" Jul 06 15:27:44.547020 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:44.547023 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/537918f5-ba69-4fb8-99ce-dc171dc79a4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w6hqj\" (UID: \"537918f5-ba69-4fb8-99ce-dc171dc79a4a\") " pod="openshift-insights/insights-runtime-extractor-w6hqj" Jul 06 15:27:44.547216 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:27:44.547122 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 15:27:44.547216 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:27:44.547131 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 15:27:44.547216 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:27:44.547173 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/537918f5-ba69-4fb8-99ce-dc171dc79a4a-kube-rbac-proxy-cm podName:537918f5-ba69-4fb8-99ce-dc171dc79a4a nodeName:}" failed. No retries permitted until 2026-07-06 15:27:45.54715946 +0000 UTC m=+126.672221708 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/537918f5-ba69-4fb8-99ce-dc171dc79a4a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w6hqj" (UID: "537918f5-ba69-4fb8-99ce-dc171dc79a4a") : configmap "kube-rbac-proxy" not found Jul 06 15:27:44.547216 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:27:44.547185 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/537918f5-ba69-4fb8-99ce-dc171dc79a4a-insights-runtime-extractor-tls podName:537918f5-ba69-4fb8-99ce-dc171dc79a4a nodeName:}" failed. No retries permitted until 2026-07-06 15:27:45.547179495 +0000 UTC m=+126.672241743 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/537918f5-ba69-4fb8-99ce-dc171dc79a4a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w6hqj" (UID: "537918f5-ba69-4fb8-99ce-dc171dc79a4a") : secret "insights-runtime-extractor-tls" not found Jul 06 15:27:44.586194 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:44.586170 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:45.102907 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:45.102876 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:45.226211 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:45.226173 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:45.380515 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:45.380454 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:45.554592 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:45.554546 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/537918f5-ba69-4fb8-99ce-dc171dc79a4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w6hqj\" (UID: \"537918f5-ba69-4fb8-99ce-dc171dc79a4a\") " pod="openshift-insights/insights-runtime-extractor-w6hqj" Jul 06 15:27:45.554592 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:45.554592 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/537918f5-ba69-4fb8-99ce-dc171dc79a4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w6hqj\" (UID: \"537918f5-ba69-4fb8-99ce-dc171dc79a4a\") " pod="openshift-insights/insights-runtime-extractor-w6hqj" Jul 06 15:27:45.554785 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:27:45.554655 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 15:27:45.554785 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:27:45.554684 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 15:27:45.554785 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:27:45.554719 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/537918f5-ba69-4fb8-99ce-dc171dc79a4a-kube-rbac-proxy-cm podName:537918f5-ba69-4fb8-99ce-dc171dc79a4a nodeName:}" failed. No retries permitted until 2026-07-06 15:27:47.554701657 +0000 UTC m=+128.679763905 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/537918f5-ba69-4fb8-99ce-dc171dc79a4a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w6hqj" (UID: "537918f5-ba69-4fb8-99ce-dc171dc79a4a") : configmap "kube-rbac-proxy" not found Jul 06 15:27:45.554785 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:27:45.554782 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/537918f5-ba69-4fb8-99ce-dc171dc79a4a-insights-runtime-extractor-tls podName:537918f5-ba69-4fb8-99ce-dc171dc79a4a nodeName:}" failed. No retries permitted until 2026-07-06 15:27:47.55476666 +0000 UTC m=+128.679828912 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/537918f5-ba69-4fb8-99ce-dc171dc79a4a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w6hqj" (UID: "537918f5-ba69-4fb8-99ce-dc171dc79a4a") : secret "insights-runtime-extractor-tls" not found Jul 06 15:27:46.002238 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:46.002210 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s6nb2_54ff6682-60fa-41c6-a133-1dd32f237779/dns-node-resolver/0.log" Jul 06 15:27:46.183573 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:46.183544 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:46.275940 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:46.275865 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:46.601735 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:46.601665 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wrhr9_b5f3d5ad-ce7e-467c-ab15-30f58cbda56c/node-ca/0.log" Jul 06 15:27:47.402261 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:47.402236 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ktjtd_8e774c49-07c6-48f4-9720-d6ebb9734b9a/serve-healthcheck-canary/0.log" Jul 06 15:27:47.468255 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:47.468224 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:47.568568 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:47.568543 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/537918f5-ba69-4fb8-99ce-dc171dc79a4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w6hqj\" (UID: \"537918f5-ba69-4fb8-99ce-dc171dc79a4a\") " pod="openshift-insights/insights-runtime-extractor-w6hqj" Jul 06 15:27:47.568751 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:47.568626 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/537918f5-ba69-4fb8-99ce-dc171dc79a4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w6hqj\" (UID: \"537918f5-ba69-4fb8-99ce-dc171dc79a4a\") " pod="openshift-insights/insights-runtime-extractor-w6hqj" Jul 06 15:27:47.568751 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:27:47.568663 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 15:27:47.568751 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:27:47.568716 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 15:27:47.568751 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:27:47.568742 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/537918f5-ba69-4fb8-99ce-dc171dc79a4a-kube-rbac-proxy-cm podName:537918f5-ba69-4fb8-99ce-dc171dc79a4a nodeName:}" failed. No retries permitted until 2026-07-06 15:27:51.568723023 +0000 UTC m=+132.693785284 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/537918f5-ba69-4fb8-99ce-dc171dc79a4a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w6hqj" (UID: "537918f5-ba69-4fb8-99ce-dc171dc79a4a") : configmap "kube-rbac-proxy" not found Jul 06 15:27:47.568888 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:27:47.568764 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/537918f5-ba69-4fb8-99ce-dc171dc79a4a-insights-runtime-extractor-tls podName:537918f5-ba69-4fb8-99ce-dc171dc79a4a nodeName:}" failed. No retries permitted until 2026-07-06 15:27:51.56875249 +0000 UTC m=+132.693814737 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/537918f5-ba69-4fb8-99ce-dc171dc79a4a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w6hqj" (UID: "537918f5-ba69-4fb8-99ce-dc171dc79a4a") : secret "insights-runtime-extractor-tls" not found Jul 06 15:27:48.172837 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:48.172802 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20db46ed-b7f8-4846-993e-578a879360b4-metrics-certs\") pod \"network-metrics-daemon-jr4kq\" (UID: \"20db46ed-b7f8-4846-993e-578a879360b4\") " pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:27:48.173008 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:27:48.172948 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 15:27:48.173074 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:27:48.173014 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20db46ed-b7f8-4846-993e-578a879360b4-metrics-certs podName:20db46ed-b7f8-4846-993e-578a879360b4 nodeName:}" failed. No retries permitted until 2026-07-06 15:29:50.172997146 +0000 UTC m=+251.298059397 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20db46ed-b7f8-4846-993e-578a879360b4-metrics-certs") pod "network-metrics-daemon-jr4kq" (UID: "20db46ed-b7f8-4846-993e-578a879360b4") : secret "metrics-daemon-secret" not found Jul 06 15:27:49.903701 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:49.903671 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:50.020807 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:50.020776 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:50.216081 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:50.215988 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:50.311800 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:50.311772 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:50.414156 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:50.414129 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:50.665913 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:50.665882 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:51.371473 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:51.371442 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:51.598420 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:51.598379 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/537918f5-ba69-4fb8-99ce-dc171dc79a4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w6hqj\" (UID: \"537918f5-ba69-4fb8-99ce-dc171dc79a4a\") " pod="openshift-insights/insights-runtime-extractor-w6hqj" Jul 06 15:27:51.598420 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:51.598424 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/537918f5-ba69-4fb8-99ce-dc171dc79a4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w6hqj\" (UID: \"537918f5-ba69-4fb8-99ce-dc171dc79a4a\") " pod="openshift-insights/insights-runtime-extractor-w6hqj" Jul 06 15:27:51.598659 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:27:51.598517 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 15:27:51.598659 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:27:51.598537 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 15:27:51.598659 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:27:51.598577 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/537918f5-ba69-4fb8-99ce-dc171dc79a4a-insights-runtime-extractor-tls podName:537918f5-ba69-4fb8-99ce-dc171dc79a4a nodeName:}" failed. No retries permitted until 2026-07-06 15:27:59.598562884 +0000 UTC m=+140.723625132 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/537918f5-ba69-4fb8-99ce-dc171dc79a4a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w6hqj" (UID: "537918f5-ba69-4fb8-99ce-dc171dc79a4a") : secret "insights-runtime-extractor-tls" not found Jul 06 15:27:51.598659 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:27:51.598592 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/537918f5-ba69-4fb8-99ce-dc171dc79a4a-kube-rbac-proxy-cm podName:537918f5-ba69-4fb8-99ce-dc171dc79a4a nodeName:}" failed. No retries permitted until 2026-07-06 15:27:59.59858571 +0000 UTC m=+140.723647958 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/537918f5-ba69-4fb8-99ce-dc171dc79a4a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w6hqj" (UID: "537918f5-ba69-4fb8-99ce-dc171dc79a4a") : configmap "kube-rbac-proxy" not found Jul 06 15:27:51.969634 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:51.969596 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:52.166932 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:52.166884 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:52.369378 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:52.369330 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:52.565080 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:52.565049 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:53.414616 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:53.414588 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:53.657113 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:53.657081 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:53.777474 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:53.777446 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:53.904981 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:53.904946 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:54.016275 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:54.016245 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:54.185668 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:54.185544 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:54.392495 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:54.392466 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:54.512239 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:54.512212 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:54.684194 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:54.684154 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:55.628581 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:55.628527 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:55.846079 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:55.846029 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:55.992017 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:55.991990 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:56.151627 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:56.151585 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:56.397014 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:56.396886 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:56.968087 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:56.968018 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:57.066325 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:57.066294 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:57.365577 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:57.365545 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:57.771026 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:57.770999 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:57.969859 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:57.969830 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:58.562258 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:58.562229 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:58.764805 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:58.764771 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:59.169018 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:59.168984 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:59.658974 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:59.658936 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/537918f5-ba69-4fb8-99ce-dc171dc79a4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w6hqj\" (UID: \"537918f5-ba69-4fb8-99ce-dc171dc79a4a\") " pod="openshift-insights/insights-runtime-extractor-w6hqj" Jul 06 15:27:59.658974 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:59.658974 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/537918f5-ba69-4fb8-99ce-dc171dc79a4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w6hqj\" (UID: \"537918f5-ba69-4fb8-99ce-dc171dc79a4a\") " pod="openshift-insights/insights-runtime-extractor-w6hqj" Jul 06 15:27:59.659192 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:27:59.659095 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 15:27:59.659192 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:27:59.659154 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/537918f5-ba69-4fb8-99ce-dc171dc79a4a-insights-runtime-extractor-tls podName:537918f5-ba69-4fb8-99ce-dc171dc79a4a nodeName:}" failed. No retries permitted until 2026-07-06 15:28:15.659139171 +0000 UTC m=+156.784201419 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/537918f5-ba69-4fb8-99ce-dc171dc79a4a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w6hqj" (UID: "537918f5-ba69-4fb8-99ce-dc171dc79a4a") : secret "insights-runtime-extractor-tls" not found Jul 06 15:27:59.659446 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:59.659430 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/537918f5-ba69-4fb8-99ce-dc171dc79a4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w6hqj\" (UID: \"537918f5-ba69-4fb8-99ce-dc171dc79a4a\") " pod="openshift-insights/insights-runtime-extractor-w6hqj" Jul 06 15:27:59.762829 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:27:59.762795 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:00.168667 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:00.168635 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:00.365732 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:00.365702 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:00.562940 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:00.562911 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:02.630985 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:02.630948 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:02.731152 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:02.731118 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:02.831082 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:02.831054 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:02.932090 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:02.931979 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:03.079224 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:03.079193 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:03.143415 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:03.143384 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:03.278804 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:03.278732 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:03.353185 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:03.353154 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:03.673730 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:03.673632 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:03.736088 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:03.736059 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:04.517812 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:04.517782 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:04.695214 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:04.695175 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:04.795830 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:04.795751 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:05.317582 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:05.317554 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:07.699074 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:07.699022 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-pchvh"] Jul 06 15:28:07.700967 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:07.700952 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-pchvh" Jul 06 15:28:07.704308 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:07.704289 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xxn7n\"" Jul 06 15:28:07.704406 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:07.704288 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 06 15:28:07.704406 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:07.704288 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 06 15:28:07.713811 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:07.713793 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-pchvh"] Jul 06 15:28:07.815467 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:07.815440 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/97bfc3e0-3330-40eb-b2f0-6eddd1adbbe9-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-pchvh\" (UID: \"97bfc3e0-3330-40eb-b2f0-6eddd1adbbe9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-pchvh" Jul 06 15:28:07.815650 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:07.815550 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/97bfc3e0-3330-40eb-b2f0-6eddd1adbbe9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-pchvh\" (UID: \"97bfc3e0-3330-40eb-b2f0-6eddd1adbbe9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-pchvh" Jul 06 15:28:07.829408 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:07.829377 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77475c64fc-knd7h"] Jul 06 15:28:07.831500 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:07.831486 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77475c64fc-knd7h" Jul 06 15:28:07.833360 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:07.833333 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:07.834728 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:07.834704 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cp2vf\"" Jul 06 15:28:07.834821 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:07.834804 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 15:28:07.835077 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:07.835064 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 15:28:07.835573 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:07.835559 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 15:28:07.841767 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:07.841749 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 15:28:07.848161 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:07.848142 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77475c64fc-knd7h"] Jul 06 15:28:07.916455 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:07.916427 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/97bfc3e0-3330-40eb-b2f0-6eddd1adbbe9-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-pchvh\" (UID: \"97bfc3e0-3330-40eb-b2f0-6eddd1adbbe9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-pchvh" Jul 06 15:28:07.916608 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:07.916497 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/97bfc3e0-3330-40eb-b2f0-6eddd1adbbe9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-pchvh\" (UID: \"97bfc3e0-3330-40eb-b2f0-6eddd1adbbe9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-pchvh" Jul 06 15:28:07.917106 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:07.917083 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/97bfc3e0-3330-40eb-b2f0-6eddd1adbbe9-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-pchvh\" (UID: \"97bfc3e0-3330-40eb-b2f0-6eddd1adbbe9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-pchvh" Jul 06 15:28:07.918815 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:07.918798 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/97bfc3e0-3330-40eb-b2f0-6eddd1adbbe9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-pchvh\" (UID: \"97bfc3e0-3330-40eb-b2f0-6eddd1adbbe9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-pchvh" Jul 06 15:28:07.933855 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:07.933827 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:08.009605 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:08.009578 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-pchvh" Jul 06 15:28:08.017707 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:08.017686 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2eadc45-cd82-4d24-94a3-4f6ee4383779-registry-certificates\") pod \"image-registry-77475c64fc-knd7h\" (UID: \"e2eadc45-cd82-4d24-94a3-4f6ee4383779\") " pod="openshift-image-registry/image-registry-77475c64fc-knd7h" Jul 06 15:28:08.017777 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:08.017721 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2eadc45-cd82-4d24-94a3-4f6ee4383779-ca-trust-extracted\") pod \"image-registry-77475c64fc-knd7h\" (UID: \"e2eadc45-cd82-4d24-94a3-4f6ee4383779\") " pod="openshift-image-registry/image-registry-77475c64fc-knd7h" Jul 06 15:28:08.017777 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:08.017740 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2eadc45-cd82-4d24-94a3-4f6ee4383779-installation-pull-secrets\") pod \"image-registry-77475c64fc-knd7h\" (UID: \"e2eadc45-cd82-4d24-94a3-4f6ee4383779\") " pod="openshift-image-registry/image-registry-77475c64fc-knd7h" Jul 06 15:28:08.017777 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:08.017767 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2eadc45-cd82-4d24-94a3-4f6ee4383779-image-registry-private-configuration\") pod \"image-registry-77475c64fc-knd7h\" (UID: \"e2eadc45-cd82-4d24-94a3-4f6ee4383779\") " pod="openshift-image-registry/image-registry-77475c64fc-knd7h" Jul 06 15:28:08.017919 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:08.017855 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2eadc45-cd82-4d24-94a3-4f6ee4383779-bound-sa-token\") pod \"image-registry-77475c64fc-knd7h\" (UID: \"e2eadc45-cd82-4d24-94a3-4f6ee4383779\") " pod="openshift-image-registry/image-registry-77475c64fc-knd7h" Jul 06 15:28:08.017919 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:08.017884 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dcwf\" (UniqueName: \"kubernetes.io/projected/e2eadc45-cd82-4d24-94a3-4f6ee4383779-kube-api-access-4dcwf\") pod \"image-registry-77475c64fc-knd7h\" (UID: \"e2eadc45-cd82-4d24-94a3-4f6ee4383779\") " pod="openshift-image-registry/image-registry-77475c64fc-knd7h" Jul 06 15:28:08.017919 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:08.017908 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2eadc45-cd82-4d24-94a3-4f6ee4383779-registry-tls\") pod \"image-registry-77475c64fc-knd7h\" (UID: \"e2eadc45-cd82-4d24-94a3-4f6ee4383779\") " pod="openshift-image-registry/image-registry-77475c64fc-knd7h" Jul 06 15:28:08.018093 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:08.017982 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2eadc45-cd82-4d24-94a3-4f6ee4383779-trusted-ca\") pod \"image-registry-77475c64fc-knd7h\" (UID: \"e2eadc45-cd82-4d24-94a3-4f6ee4383779\") " pod="openshift-image-registry/image-registry-77475c64fc-knd7h" Jul 06 15:28:08.118539 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:08.118510 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2eadc45-cd82-4d24-94a3-4f6ee4383779-registry-certificates\") pod \"image-registry-77475c64fc-knd7h\" (UID: \"e2eadc45-cd82-4d24-94a3-4f6ee4383779\") " pod="openshift-image-registry/image-registry-77475c64fc-knd7h" Jul 06 15:28:08.118679 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:08.118552 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2eadc45-cd82-4d24-94a3-4f6ee4383779-ca-trust-extracted\") pod \"image-registry-77475c64fc-knd7h\" (UID: \"e2eadc45-cd82-4d24-94a3-4f6ee4383779\") " pod="openshift-image-registry/image-registry-77475c64fc-knd7h" Jul 06 15:28:08.118679 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:08.118569 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2eadc45-cd82-4d24-94a3-4f6ee4383779-installation-pull-secrets\") pod \"image-registry-77475c64fc-knd7h\" (UID: \"e2eadc45-cd82-4d24-94a3-4f6ee4383779\") " pod="openshift-image-registry/image-registry-77475c64fc-knd7h" Jul 06 15:28:08.118679 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:08.118590 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2eadc45-cd82-4d24-94a3-4f6ee4383779-image-registry-private-configuration\") pod \"image-registry-77475c64fc-knd7h\" (UID: \"e2eadc45-cd82-4d24-94a3-4f6ee4383779\") " pod="openshift-image-registry/image-registry-77475c64fc-knd7h" Jul 06 15:28:08.118794 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:08.118771 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2eadc45-cd82-4d24-94a3-4f6ee4383779-bound-sa-token\") pod \"image-registry-77475c64fc-knd7h\" (UID: \"e2eadc45-cd82-4d24-94a3-4f6ee4383779\") " pod="openshift-image-registry/image-registry-77475c64fc-knd7h" Jul 06 15:28:08.118844 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:08.118830 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dcwf\" (UniqueName: \"kubernetes.io/projected/e2eadc45-cd82-4d24-94a3-4f6ee4383779-kube-api-access-4dcwf\") pod \"image-registry-77475c64fc-knd7h\" (UID: \"e2eadc45-cd82-4d24-94a3-4f6ee4383779\") " pod="openshift-image-registry/image-registry-77475c64fc-knd7h" Jul 06 15:28:08.118896 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:08.118872 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2eadc45-cd82-4d24-94a3-4f6ee4383779-registry-tls\") pod \"image-registry-77475c64fc-knd7h\" (UID: \"e2eadc45-cd82-4d24-94a3-4f6ee4383779\") " pod="openshift-image-registry/image-registry-77475c64fc-knd7h" Jul 06 15:28:08.118942 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:08.118929 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2eadc45-cd82-4d24-94a3-4f6ee4383779-trusted-ca\") pod \"image-registry-77475c64fc-knd7h\" (UID: \"e2eadc45-cd82-4d24-94a3-4f6ee4383779\") " pod="openshift-image-registry/image-registry-77475c64fc-knd7h" Jul 06 15:28:08.118987 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:08.118939 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2eadc45-cd82-4d24-94a3-4f6ee4383779-ca-trust-extracted\") pod \"image-registry-77475c64fc-knd7h\" (UID: \"e2eadc45-cd82-4d24-94a3-4f6ee4383779\") " pod="openshift-image-registry/image-registry-77475c64fc-knd7h" Jul 06 15:28:08.119448 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:08.119426 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2eadc45-cd82-4d24-94a3-4f6ee4383779-registry-certificates\") pod \"image-registry-77475c64fc-knd7h\" (UID: \"e2eadc45-cd82-4d24-94a3-4f6ee4383779\") " pod="openshift-image-registry/image-registry-77475c64fc-knd7h" Jul 06 15:28:08.119752 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:08.119734 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2eadc45-cd82-4d24-94a3-4f6ee4383779-trusted-ca\") pod \"image-registry-77475c64fc-knd7h\" (UID: \"e2eadc45-cd82-4d24-94a3-4f6ee4383779\") " pod="openshift-image-registry/image-registry-77475c64fc-knd7h" Jul 06 15:28:08.121231 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:08.121210 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2eadc45-cd82-4d24-94a3-4f6ee4383779-registry-tls\") pod \"image-registry-77475c64fc-knd7h\" (UID: \"e2eadc45-cd82-4d24-94a3-4f6ee4383779\") " pod="openshift-image-registry/image-registry-77475c64fc-knd7h" Jul 06 15:28:08.121535 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:08.121512 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2eadc45-cd82-4d24-94a3-4f6ee4383779-image-registry-private-configuration\") pod \"image-registry-77475c64fc-knd7h\" (UID: \"e2eadc45-cd82-4d24-94a3-4f6ee4383779\") " pod="openshift-image-registry/image-registry-77475c64fc-knd7h" Jul 06 15:28:08.121577 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:08.121545 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2eadc45-cd82-4d24-94a3-4f6ee4383779-installation-pull-secrets\") pod \"image-registry-77475c64fc-knd7h\" (UID: \"e2eadc45-cd82-4d24-94a3-4f6ee4383779\") " pod="openshift-image-registry/image-registry-77475c64fc-knd7h" Jul 06 15:28:08.130603 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:08.130560 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2eadc45-cd82-4d24-94a3-4f6ee4383779-bound-sa-token\") pod \"image-registry-77475c64fc-knd7h\" (UID: \"e2eadc45-cd82-4d24-94a3-4f6ee4383779\") " pod="openshift-image-registry/image-registry-77475c64fc-knd7h" Jul 06 15:28:08.131744 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:08.131721 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-pchvh"] Jul 06 15:28:08.135552 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:08.135531 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dcwf\" (UniqueName: \"kubernetes.io/projected/e2eadc45-cd82-4d24-94a3-4f6ee4383779-kube-api-access-4dcwf\") pod \"image-registry-77475c64fc-knd7h\" (UID: \"e2eadc45-cd82-4d24-94a3-4f6ee4383779\") " pod="openshift-image-registry/image-registry-77475c64fc-knd7h" Jul 06 15:28:08.135793 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:28:08.135774 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97bfc3e0_3330_40eb_b2f0_6eddd1adbbe9.slice/crio-a08db8208647bef4b783969cdf56d7773ffa24478312205e0e0606542a7af02a WatchSource:0}: Error finding container a08db8208647bef4b783969cdf56d7773ffa24478312205e0e0606542a7af02a: Status 404 returned error can't find the container with id a08db8208647bef4b783969cdf56d7773ffa24478312205e0e0606542a7af02a Jul 06 15:28:08.140226 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:08.140166 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77475c64fc-knd7h" Jul 06 15:28:08.269975 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:08.269906 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77475c64fc-knd7h"] Jul 06 15:28:08.274483 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:28:08.274456 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2eadc45_cd82_4d24_94a3_4f6ee4383779.slice/crio-c66a70cf4569d3917718c9a2a40edaa6965de290af8eae093452c57df5aa8a9e WatchSource:0}: Error finding container c66a70cf4569d3917718c9a2a40edaa6965de290af8eae093452c57df5aa8a9e: Status 404 returned error can't find the container with id c66a70cf4569d3917718c9a2a40edaa6965de290af8eae093452c57df5aa8a9e Jul 06 15:28:09.066229 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:09.066187 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-pchvh" event={"ID":"97bfc3e0-3330-40eb-b2f0-6eddd1adbbe9","Type":"ContainerStarted","Data":"a08db8208647bef4b783969cdf56d7773ffa24478312205e0e0606542a7af02a"} Jul 06 15:28:09.067802 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:09.067770 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77475c64fc-knd7h" event={"ID":"e2eadc45-cd82-4d24-94a3-4f6ee4383779","Type":"ContainerStarted","Data":"8ef141b6850c00688aeeead9603baeee857c77455be4e041a62f73e6a7e633d6"} Jul 06 15:28:09.067950 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:09.067824 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77475c64fc-knd7h" event={"ID":"e2eadc45-cd82-4d24-94a3-4f6ee4383779","Type":"ContainerStarted","Data":"c66a70cf4569d3917718c9a2a40edaa6965de290af8eae093452c57df5aa8a9e"} Jul 06 15:28:09.067950 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:09.067924 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77475c64fc-knd7h" Jul 06 15:28:10.072087 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:10.072027 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-pchvh" event={"ID":"97bfc3e0-3330-40eb-b2f0-6eddd1adbbe9","Type":"ContainerStarted","Data":"27da49faa3b6f997a93b8cbd48f88fc6f5821f75ac8376a435221a450f0239e4"} Jul 06 15:28:10.090703 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:10.090646 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77475c64fc-knd7h" podStartSLOduration=3.090625392 podStartE2EDuration="3.090625392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:28:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:28:09.101249873 +0000 UTC m=+150.226312145" watchObservedRunningTime="2026-07-06 15:28:10.090625392 +0000 UTC m=+151.215687666" Jul 06 15:28:10.230907 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:10.230877 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:10.331086 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:10.331006 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:11.146567 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:11.146536 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:11.223973 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:11.223946 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:14.386189 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:14.386150 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:14.483360 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:14.483328 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:14.573104 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:14.573074 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:14.908571 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:14.908530 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:15.674278 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:15.674229 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/537918f5-ba69-4fb8-99ce-dc171dc79a4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w6hqj\" (UID: \"537918f5-ba69-4fb8-99ce-dc171dc79a4a\") " pod="openshift-insights/insights-runtime-extractor-w6hqj" Jul 06 15:28:15.676564 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:15.676540 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/537918f5-ba69-4fb8-99ce-dc171dc79a4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w6hqj\" (UID: \"537918f5-ba69-4fb8-99ce-dc171dc79a4a\") " pod="openshift-insights/insights-runtime-extractor-w6hqj" Jul 06 15:28:15.723003 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:15.722971 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:15.943991 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:15.943889 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w6hqj" Jul 06 15:28:16.078806 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:16.078753 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-pchvh" podStartSLOduration=8.060854757 podStartE2EDuration="9.07873224s" totalImagesPullingTime="1.017877483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:28:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:28:10.090626764 +0000 UTC m=+151.215689052" watchObservedRunningTime="2026-07-06 15:28:16.07873224 +0000 UTC m=+157.203794512" Jul 06 15:28:16.079146 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:16.079127 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w6hqj"] Jul 06 15:28:16.082727 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:28:16.082703 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod537918f5_ba69_4fb8_99ce_dc171dc79a4a.slice/crio-72ad93fcabc10280b96137a4b005d067b6a82fbd7e9f7212109d5912fdf4fbdf WatchSource:0}: Error finding container 72ad93fcabc10280b96137a4b005d067b6a82fbd7e9f7212109d5912fdf4fbdf: Status 404 returned error can't find the container with id 72ad93fcabc10280b96137a4b005d067b6a82fbd7e9f7212109d5912fdf4fbdf Jul 06 15:28:16.090392 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:16.090371 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w6hqj" event={"ID":"537918f5-ba69-4fb8-99ce-dc171dc79a4a","Type":"ContainerStarted","Data":"72ad93fcabc10280b96137a4b005d067b6a82fbd7e9f7212109d5912fdf4fbdf"} Jul 06 15:28:16.741850 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:28:16.741815 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8fw8f" podUID="fa5d3c60-7684-45d6-aaf2-e5d6cfea0123" Jul 06 15:28:17.094184 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:17.094113 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8fw8f" Jul 06 15:28:17.614522 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:17.614455 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:17.704901 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:17.704869 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:18.145368 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:18.145329 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:18.215116 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:18.215080 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:18.410319 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:18.410243 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:18.514805 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:28:18.514765 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-jr4kq" podUID="20db46ed-b7f8-4846-993e-578a879360b4" Jul 06 15:28:20.108275 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:20.108227 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w6hqj" event={"ID":"537918f5-ba69-4fb8-99ce-dc171dc79a4a","Type":"ContainerStarted","Data":"c1d51d1571e858783e0534e999a9042b7d1f73aef4d77690417cc47134c36bb8"} Jul 06 15:28:21.113819 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:21.113779 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w6hqj" event={"ID":"537918f5-ba69-4fb8-99ce-dc171dc79a4a","Type":"ContainerStarted","Data":"8a013cd69e50162e9ab174fc670b3b4be87b5acb8e040b3d7728316276d7acb6"} Jul 06 15:28:21.618183 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:21.618142 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-metrics-tls\") pod \"dns-default-8fw8f\" (UID: \"fa5d3c60-7684-45d6-aaf2-e5d6cfea0123\") " pod="openshift-dns/dns-default-8fw8f" Jul 06 15:28:21.620987 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:21.620957 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa5d3c60-7684-45d6-aaf2-e5d6cfea0123-metrics-tls\") pod \"dns-default-8fw8f\" (UID: \"fa5d3c60-7684-45d6-aaf2-e5d6cfea0123\") " pod="openshift-dns/dns-default-8fw8f" Jul 06 15:28:21.668284 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:21.668253 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:21.897347 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:21.897265 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wz98m\"" Jul 06 15:28:21.905306 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:21.905286 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8fw8f" Jul 06 15:28:22.909174 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:22.909149 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8fw8f"] Jul 06 15:28:22.911899 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:28:22.911876 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa5d3c60_7684_45d6_aaf2_e5d6cfea0123.slice/crio-91c3bba8fbb71cae84b04b5f708b10e0316ec3201b56e7eb02222f3163c23100 WatchSource:0}: Error finding container 91c3bba8fbb71cae84b04b5f708b10e0316ec3201b56e7eb02222f3163c23100: Status 404 returned error can't find the container with id 91c3bba8fbb71cae84b04b5f708b10e0316ec3201b56e7eb02222f3163c23100 Jul 06 15:28:23.121971 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:23.121875 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8fw8f" event={"ID":"fa5d3c60-7684-45d6-aaf2-e5d6cfea0123","Type":"ContainerStarted","Data":"91c3bba8fbb71cae84b04b5f708b10e0316ec3201b56e7eb02222f3163c23100"} Jul 06 15:28:23.123650 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:23.123622 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w6hqj" event={"ID":"537918f5-ba69-4fb8-99ce-dc171dc79a4a","Type":"ContainerStarted","Data":"440c2577bd89120ad9860f8f64caec98e469301a014230c6e770fdc933667481"} Jul 06 15:28:23.146883 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:23.146839 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-w6hqj" podStartSLOduration=33.532454561 podStartE2EDuration="40.146824828s" totalImagesPullingTime="6.614370267s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:27:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:28:23.145771329 +0000 UTC m=+164.270833599" watchObservedRunningTime="2026-07-06 15:28:23.146824828 +0000 UTC m=+164.271887109" Jul 06 15:28:23.327245 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:23.327208 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:23.805798 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:23.805765 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:24.079779 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.079675 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:24.189357 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.189329 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-j7frt"] Jul 06 15:28:24.192088 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.192057 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:24.192218 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.192129 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j7frt" Jul 06 15:28:24.194853 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.194608 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 15:28:24.194853 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.194618 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 15:28:24.194853 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.194612 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 15:28:24.194853 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.194754 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 15:28:24.195832 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.195749 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 15:28:24.196001 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.195950 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 15:28:24.196186 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.196173 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rgg4q\"" Jul 06 15:28:24.240508 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.240420 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8349bcaa-2d78-4ba9-9f86-2943587e50c9-root\") pod \"node-exporter-j7frt\" (UID: \"8349bcaa-2d78-4ba9-9f86-2943587e50c9\") " pod="openshift-monitoring/node-exporter-j7frt" Jul 06 15:28:24.240508 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.240461 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8349bcaa-2d78-4ba9-9f86-2943587e50c9-node-exporter-tls\") pod \"node-exporter-j7frt\" (UID: \"8349bcaa-2d78-4ba9-9f86-2943587e50c9\") " pod="openshift-monitoring/node-exporter-j7frt" Jul 06 15:28:24.240508 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.240491 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8349bcaa-2d78-4ba9-9f86-2943587e50c9-node-exporter-wtmp\") pod \"node-exporter-j7frt\" (UID: \"8349bcaa-2d78-4ba9-9f86-2943587e50c9\") " pod="openshift-monitoring/node-exporter-j7frt" Jul 06 15:28:24.240508 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.240516 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l57ft\" (UniqueName: \"kubernetes.io/projected/8349bcaa-2d78-4ba9-9f86-2943587e50c9-kube-api-access-l57ft\") pod \"node-exporter-j7frt\" (UID: \"8349bcaa-2d78-4ba9-9f86-2943587e50c9\") " pod="openshift-monitoring/node-exporter-j7frt" Jul 06 15:28:24.240868 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.240550 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8349bcaa-2d78-4ba9-9f86-2943587e50c9-node-exporter-accelerators-collector-config\") pod \"node-exporter-j7frt\" (UID: \"8349bcaa-2d78-4ba9-9f86-2943587e50c9\") " pod="openshift-monitoring/node-exporter-j7frt" Jul 06 15:28:24.240868 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.240619 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8349bcaa-2d78-4ba9-9f86-2943587e50c9-sys\") pod \"node-exporter-j7frt\" (UID: \"8349bcaa-2d78-4ba9-9f86-2943587e50c9\") " pod="openshift-monitoring/node-exporter-j7frt" Jul 06 15:28:24.240868 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.240702 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8349bcaa-2d78-4ba9-9f86-2943587e50c9-node-exporter-textfile\") pod \"node-exporter-j7frt\" (UID: \"8349bcaa-2d78-4ba9-9f86-2943587e50c9\") " pod="openshift-monitoring/node-exporter-j7frt" Jul 06 15:28:24.240868 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.240732 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8349bcaa-2d78-4ba9-9f86-2943587e50c9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j7frt\" (UID: \"8349bcaa-2d78-4ba9-9f86-2943587e50c9\") " pod="openshift-monitoring/node-exporter-j7frt" Jul 06 15:28:24.240868 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.240804 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8349bcaa-2d78-4ba9-9f86-2943587e50c9-metrics-client-ca\") pod \"node-exporter-j7frt\" (UID: \"8349bcaa-2d78-4ba9-9f86-2943587e50c9\") " pod="openshift-monitoring/node-exporter-j7frt" Jul 06 15:28:24.339910 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.339824 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:24.341966 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.341940 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8349bcaa-2d78-4ba9-9f86-2943587e50c9-node-exporter-accelerators-collector-config\") pod \"node-exporter-j7frt\" (UID: \"8349bcaa-2d78-4ba9-9f86-2943587e50c9\") " pod="openshift-monitoring/node-exporter-j7frt" Jul 06 15:28:24.342088 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.341997 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8349bcaa-2d78-4ba9-9f86-2943587e50c9-sys\") pod \"node-exporter-j7frt\" (UID: \"8349bcaa-2d78-4ba9-9f86-2943587e50c9\") " pod="openshift-monitoring/node-exporter-j7frt" Jul 06 15:28:24.342088 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.342072 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8349bcaa-2d78-4ba9-9f86-2943587e50c9-node-exporter-textfile\") pod \"node-exporter-j7frt\" (UID: \"8349bcaa-2d78-4ba9-9f86-2943587e50c9\") " pod="openshift-monitoring/node-exporter-j7frt" Jul 06 15:28:24.342211 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.342103 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8349bcaa-2d78-4ba9-9f86-2943587e50c9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j7frt\" (UID: \"8349bcaa-2d78-4ba9-9f86-2943587e50c9\") " pod="openshift-monitoring/node-exporter-j7frt" Jul 06 15:28:24.342211 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.342124 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8349bcaa-2d78-4ba9-9f86-2943587e50c9-sys\") pod \"node-exporter-j7frt\" (UID: \"8349bcaa-2d78-4ba9-9f86-2943587e50c9\") " pod="openshift-monitoring/node-exporter-j7frt" Jul 06 15:28:24.342211 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.342170 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8349bcaa-2d78-4ba9-9f86-2943587e50c9-metrics-client-ca\") pod \"node-exporter-j7frt\" (UID: \"8349bcaa-2d78-4ba9-9f86-2943587e50c9\") " pod="openshift-monitoring/node-exporter-j7frt" Jul 06 15:28:24.342354 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.342222 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8349bcaa-2d78-4ba9-9f86-2943587e50c9-root\") pod \"node-exporter-j7frt\" (UID: \"8349bcaa-2d78-4ba9-9f86-2943587e50c9\") " pod="openshift-monitoring/node-exporter-j7frt" Jul 06 15:28:24.342354 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.342249 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8349bcaa-2d78-4ba9-9f86-2943587e50c9-node-exporter-tls\") pod \"node-exporter-j7frt\" (UID: \"8349bcaa-2d78-4ba9-9f86-2943587e50c9\") " pod="openshift-monitoring/node-exporter-j7frt" Jul 06 15:28:24.342354 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.342274 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8349bcaa-2d78-4ba9-9f86-2943587e50c9-node-exporter-wtmp\") pod \"node-exporter-j7frt\" (UID: \"8349bcaa-2d78-4ba9-9f86-2943587e50c9\") " pod="openshift-monitoring/node-exporter-j7frt" Jul 06 15:28:24.342354 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.342302 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l57ft\" (UniqueName: \"kubernetes.io/projected/8349bcaa-2d78-4ba9-9f86-2943587e50c9-kube-api-access-l57ft\") pod \"node-exporter-j7frt\" (UID: \"8349bcaa-2d78-4ba9-9f86-2943587e50c9\") " pod="openshift-monitoring/node-exporter-j7frt" Jul 06 15:28:24.342529 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.342354 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8349bcaa-2d78-4ba9-9f86-2943587e50c9-node-exporter-textfile\") pod \"node-exporter-j7frt\" (UID: \"8349bcaa-2d78-4ba9-9f86-2943587e50c9\") " pod="openshift-monitoring/node-exporter-j7frt" Jul 06 15:28:24.342701 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.342582 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8349bcaa-2d78-4ba9-9f86-2943587e50c9-node-exporter-accelerators-collector-config\") pod \"node-exporter-j7frt\" (UID: \"8349bcaa-2d78-4ba9-9f86-2943587e50c9\") " pod="openshift-monitoring/node-exporter-j7frt" Jul 06 15:28:24.342701 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.342673 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8349bcaa-2d78-4ba9-9f86-2943587e50c9-node-exporter-wtmp\") pod \"node-exporter-j7frt\" (UID: \"8349bcaa-2d78-4ba9-9f86-2943587e50c9\") " pod="openshift-monitoring/node-exporter-j7frt" Jul 06 15:28:24.342831 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.342694 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8349bcaa-2d78-4ba9-9f86-2943587e50c9-metrics-client-ca\") pod \"node-exporter-j7frt\" (UID: \"8349bcaa-2d78-4ba9-9f86-2943587e50c9\") " pod="openshift-monitoring/node-exporter-j7frt" Jul 06 15:28:24.342831 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.342707 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8349bcaa-2d78-4ba9-9f86-2943587e50c9-root\") pod \"node-exporter-j7frt\" (UID: \"8349bcaa-2d78-4ba9-9f86-2943587e50c9\") " pod="openshift-monitoring/node-exporter-j7frt" Jul 06 15:28:24.344999 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.344978 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8349bcaa-2d78-4ba9-9f86-2943587e50c9-node-exporter-tls\") pod \"node-exporter-j7frt\" (UID: \"8349bcaa-2d78-4ba9-9f86-2943587e50c9\") " pod="openshift-monitoring/node-exporter-j7frt" Jul 06 15:28:24.345134 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.345109 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8349bcaa-2d78-4ba9-9f86-2943587e50c9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j7frt\" (UID: \"8349bcaa-2d78-4ba9-9f86-2943587e50c9\") " pod="openshift-monitoring/node-exporter-j7frt" Jul 06 15:28:24.353050 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.353021 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l57ft\" (UniqueName: \"kubernetes.io/projected/8349bcaa-2d78-4ba9-9f86-2943587e50c9-kube-api-access-l57ft\") pod \"node-exporter-j7frt\" (UID: \"8349bcaa-2d78-4ba9-9f86-2943587e50c9\") " pod="openshift-monitoring/node-exporter-j7frt" Jul 06 15:28:24.440447 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.440410 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:24.503996 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.503965 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j7frt" Jul 06 15:28:24.512424 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:28:24.512400 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8349bcaa_2d78_4ba9_9f86_2943587e50c9.slice/crio-848b505712d8ead555b058b88bc065358be45a41d404c1d15ff07dbcccd60bd6 WatchSource:0}: Error finding container 848b505712d8ead555b058b88bc065358be45a41d404c1d15ff07dbcccd60bd6: Status 404 returned error can't find the container with id 848b505712d8ead555b058b88bc065358be45a41d404c1d15ff07dbcccd60bd6 Jul 06 15:28:24.607728 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.607658 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:24.708165 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.708128 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:24.916490 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:24.916407 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:25.124999 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:25.124959 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:25.131825 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:25.131800 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j7frt" event={"ID":"8349bcaa-2d78-4ba9-9f86-2943587e50c9","Type":"ContainerStarted","Data":"848b505712d8ead555b058b88bc065358be45a41d404c1d15ff07dbcccd60bd6"} Jul 06 15:28:25.133717 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:25.133691 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8fw8f" event={"ID":"fa5d3c60-7684-45d6-aaf2-e5d6cfea0123","Type":"ContainerStarted","Data":"1ff7d47465293f86234c438f76de75be01b0e78a0cce5fa5ebe7ba66758edd60"} Jul 06 15:28:25.133832 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:25.133735 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8fw8f" event={"ID":"fa5d3c60-7684-45d6-aaf2-e5d6cfea0123","Type":"ContainerStarted","Data":"604f0e6d36e4cce22acbfa966c1b3e3b7938473c5704cb1c0efb834afc934881"} Jul 06 15:28:25.133947 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:25.133848 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8fw8f" Jul 06 15:28:25.157380 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:25.157336 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8fw8f" podStartSLOduration=130.765604165 podStartE2EDuration="2m12.157319669s" totalImagesPullingTime="1.391715504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:26:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:28:25.155781676 +0000 UTC m=+166.280843971" watchObservedRunningTime="2026-07-06 15:28:25.157319669 +0000 UTC m=+166.282381940" Jul 06 15:28:25.225922 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:25.225842 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:25.451631 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:25.451600 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:26.139184 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:26.139155 2573 generic.go:356] "Generic (PLEG): container finished" podID="8349bcaa-2d78-4ba9-9f86-2943587e50c9" containerID="d1bde69f6fcf95a0cd84537467f45e73fc5f294af37ccf2eaea99859235d96ac" exitCode=0 Jul 06 15:28:26.139718 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:26.139237 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j7frt" event={"ID":"8349bcaa-2d78-4ba9-9f86-2943587e50c9","Type":"ContainerDied","Data":"d1bde69f6fcf95a0cd84537467f45e73fc5f294af37ccf2eaea99859235d96ac"} Jul 06 15:28:26.968795 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:26.968764 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:27.067431 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:27.067400 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:27.144861 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:27.144822 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j7frt" event={"ID":"8349bcaa-2d78-4ba9-9f86-2943587e50c9","Type":"ContainerStarted","Data":"a31ed797350d21cd6caaa5ae5511f61594f6b64c6aa155e9550fad46f4959e69"} Jul 06 15:28:27.145341 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:27.144869 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j7frt" event={"ID":"8349bcaa-2d78-4ba9-9f86-2943587e50c9","Type":"ContainerStarted","Data":"c981dfc4441966219611ead58da0a373d05758fd0d0df3d16bc141a7ac8e8d2f"} Jul 06 15:28:27.167748 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:27.167704 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:27.169177 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:27.169135 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-j7frt" podStartSLOduration=2.086102859 podStartE2EDuration="3.169120996s" totalImagesPullingTime="1.019721757s" totalInitContainerRuntime="63.29638ms" isStatefulPod=true podCreationTimestamp="2026-07-06 15:28:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:28:27.167598417 +0000 UTC m=+168.292660705" watchObservedRunningTime="2026-07-06 15:28:27.169120996 +0000 UTC m=+168.294183267" Jul 06 15:28:27.306189 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:27.306158 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:27.507259 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:27.507228 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:28.144475 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:28.144439 2573 patch_prober.go:28] interesting pod/image-registry-77475c64fc-knd7h container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 15:28:28.144645 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:28.144495 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-77475c64fc-knd7h" podUID="e2eadc45-cd82-4d24-94a3-4f6ee4383779" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 15:28:28.747679 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:28.747643 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:28.868528 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:28.868488 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:29.032685 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:29.032576 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:29.125282 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:29.125252 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:30.076949 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.076919 2573 patch_prober.go:28] interesting pod/image-registry-77475c64fc-knd7h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 15:28:30.077343 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.076976 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-77475c64fc-knd7h" podUID="e2eadc45-cd82-4d24-94a3-4f6ee4383779" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 15:28:30.155957 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.155928 2573 generic.go:356] "Generic (PLEG): container finished" podID="bd4b8811-1315-4cae-838d-c8845cbf1d53" containerID="5990a0eac5c09362f2f787fbe2cc9f2a6a39387e8ebfc0705c01c04fec076e33" exitCode=1 Jul 06 15:28:30.156083 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.155966 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c4dd7c89f-stbqv" event={"ID":"bd4b8811-1315-4cae-838d-c8845cbf1d53","Type":"ContainerDied","Data":"5990a0eac5c09362f2f787fbe2cc9f2a6a39387e8ebfc0705c01c04fec076e33"} Jul 06 15:28:30.156281 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.156268 2573 scope.go:117] "RemoveContainer" containerID="5990a0eac5c09362f2f787fbe2cc9f2a6a39387e8ebfc0705c01c04fec076e33" Jul 06 15:28:30.475980 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.475893 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 15:28:30.478616 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.478593 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.481571 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.481551 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 15:28:30.483760 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.483734 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 15:28:30.483760 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.483751 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 15:28:30.483949 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.483774 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 15:28:30.483949 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.483856 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 15:28:30.483949 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.483925 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 15:28:30.484141 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.484094 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 15:28:30.484217 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.484200 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 15:28:30.485100 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.485080 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 15:28:30.485379 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.485361 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 15:28:30.485454 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.485439 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 15:28:30.485545 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.485529 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-f5tckd64cpvq3\"" Jul 06 15:28:30.485598 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.485554 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 15:28:30.485683 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.485667 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vbjdv\"" Jul 06 15:28:30.485757 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.485743 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 15:28:30.490229 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.490212 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 15:28:30.495141 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.495125 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 15:28:30.495493 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.495478 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:30.500587 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.500568 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 15:28:30.589476 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.589446 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd4811be-167b-443d-a0b1-159996f9e1f9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.589476 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.589486 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd4811be-167b-443d-a0b1-159996f9e1f9-config-out\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.589704 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.589515 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.589704 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.589589 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.589704 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.589641 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.589704 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.589679 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.589704 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.589700 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.589884 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.589738 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.589884 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.589762 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-config\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.589884 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.589779 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.589884 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.589805 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.589884 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.589849 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbklm\" (UniqueName: \"kubernetes.io/projected/bd4811be-167b-443d-a0b1-159996f9e1f9-kube-api-access-nbklm\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.590062 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.589881 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.590062 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.589901 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.590062 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.589920 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.590062 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.589935 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-web-config\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.590062 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.589954 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.590062 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.589970 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.590062 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.589984 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.590062 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.590001 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bd4811be-167b-443d-a0b1-159996f9e1f9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.690948 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.690910 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.690948 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.690948 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.691186 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.690975 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.691186 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.690996 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-config\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.691186 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.691014 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.691186 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.691052 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.691186 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.691077 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbklm\" (UniqueName: \"kubernetes.io/projected/bd4811be-167b-443d-a0b1-159996f9e1f9-kube-api-access-nbklm\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.691186 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.691102 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.691948 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.691515 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.691948 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.691566 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.691948 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.691597 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-web-config\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.691948 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.691622 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.691948 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.691647 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.691948 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.691670 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.691948 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.691697 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bd4811be-167b-443d-a0b1-159996f9e1f9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.691948 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.691737 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd4811be-167b-443d-a0b1-159996f9e1f9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.691948 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.691767 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd4811be-167b-443d-a0b1-159996f9e1f9-config-out\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.691948 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.691774 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.691948 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.691793 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.691948 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.691837 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.694198 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.691774 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.695021 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.694982 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.695475 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.695441 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bd4811be-167b-443d-a0b1-159996f9e1f9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.696120 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.696095 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.696553 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.696527 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.696642 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.696552 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.697114 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.697091 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.698241 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.697457 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.698241 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.697500 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.698241 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.697891 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-config\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.698241 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.691883 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.698490 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.698342 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.698900 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.698873 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.701117 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.699877 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-web-config\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.701117 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.700239 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.701339 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.701314 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd4811be-167b-443d-a0b1-159996f9e1f9-config-out\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.701794 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.701769 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.702476 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.702452 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd4811be-167b-443d-a0b1-159996f9e1f9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.702641 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.702625 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbklm\" (UniqueName: \"kubernetes.io/projected/bd4811be-167b-443d-a0b1-159996f9e1f9-kube-api-access-nbklm\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.702693 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.702674 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.788225 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.788191 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:30.790183 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.790162 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c4dd7c89f-stbqv" Jul 06 15:28:30.926716 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:30.926688 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 15:28:30.929825 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:28:30.929799 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd4811be_167b_443d_a0b1_159996f9e1f9.slice/crio-88b5da05cb6a8a8ecbe3699327968037c1d3dac90472c8cce2b1b8160a43d183 WatchSource:0}: Error finding container 88b5da05cb6a8a8ecbe3699327968037c1d3dac90472c8cce2b1b8160a43d183: Status 404 returned error can't find the container with id 88b5da05cb6a8a8ecbe3699327968037c1d3dac90472c8cce2b1b8160a43d183 Jul 06 15:28:31.161449 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:31.161337 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd4811be-167b-443d-a0b1-159996f9e1f9","Type":"ContainerStarted","Data":"88b5da05cb6a8a8ecbe3699327968037c1d3dac90472c8cce2b1b8160a43d183"} Jul 06 15:28:31.163029 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:31.163006 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c4dd7c89f-stbqv" event={"ID":"bd4b8811-1315-4cae-838d-c8845cbf1d53","Type":"ContainerStarted","Data":"d1b054a650331add6ecfa764a98b2405aeb7cfc518fc17eed38126e5a9516602"} Jul 06 15:28:31.163268 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:31.163253 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c4dd7c89f-stbqv" Jul 06 15:28:31.163856 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:31.163841 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c4dd7c89f-stbqv" Jul 06 15:28:32.170942 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:32.170862 2573 generic.go:356] "Generic (PLEG): container finished" podID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerID="7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d" exitCode=0 Jul 06 15:28:32.171413 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:32.170953 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd4811be-167b-443d-a0b1-159996f9e1f9","Type":"ContainerDied","Data":"7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d"} Jul 06 15:28:32.491676 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:32.491651 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:28:32.708193 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:32.708159 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:32.778412 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:32.778285 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:35.142228 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:35.142197 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8fw8f" Jul 06 15:28:36.188890 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:36.188854 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd4811be-167b-443d-a0b1-159996f9e1f9","Type":"ContainerStarted","Data":"7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6"} Jul 06 15:28:36.189347 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:36.188927 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd4811be-167b-443d-a0b1-159996f9e1f9","Type":"ContainerStarted","Data":"7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7"} Jul 06 15:28:37.195208 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:37.195136 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd4811be-167b-443d-a0b1-159996f9e1f9","Type":"ContainerStarted","Data":"fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb"} Jul 06 15:28:37.195208 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:37.195196 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd4811be-167b-443d-a0b1-159996f9e1f9","Type":"ContainerStarted","Data":"94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b"} Jul 06 15:28:37.195596 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:37.195221 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd4811be-167b-443d-a0b1-159996f9e1f9","Type":"ContainerStarted","Data":"2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3"} Jul 06 15:28:37.195596 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:37.195246 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd4811be-167b-443d-a0b1-159996f9e1f9","Type":"ContainerStarted","Data":"f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605"} Jul 06 15:28:37.275188 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:37.275145 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.772599639 podStartE2EDuration="7.275127535s" totalImagesPullingTime="5.482405438s" totalInitContainerRuntime="20.122458ms" isStatefulPod=false podCreationTimestamp="2026-07-06 15:28:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:28:37.275061397 +0000 UTC m=+178.400123666" watchObservedRunningTime="2026-07-06 15:28:37.275127535 +0000 UTC m=+178.400189806" Jul 06 15:28:38.144783 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:38.144751 2573 patch_prober.go:28] interesting pod/image-registry-77475c64fc-knd7h container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 15:28:38.144931 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:38.144808 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-77475c64fc-knd7h" podUID="e2eadc45-cd82-4d24-94a3-4f6ee4383779" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 15:28:39.959365 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:39.959318 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:40.032092 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:40.032055 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:40.077097 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:40.077071 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77475c64fc-knd7h" Jul 06 15:28:40.227900 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:40.227812 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:40.329089 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:40.329053 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:40.789291 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:40.789249 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:40.879159 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:40.879127 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:40.945462 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:40.945427 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:42.199097 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:42.199064 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:42.300377 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:42.300347 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:44.327605 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:44.327569 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:44.431221 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:44.431184 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:46.250405 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:46.250377 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:47.707906 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:47.707871 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:47.809581 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:47.809541 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:48.721976 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:48.721946 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:48.807330 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:48.807291 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:49.471645 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:49.471614 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:49.565167 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:49.565137 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:49.666600 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:49.666559 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:49.746044 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:49.746006 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:49.979168 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:49.979138 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:50.056898 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:50.056781 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:50.136811 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:50.136778 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:53.365765 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:53.365733 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:53.455370 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:53.455339 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:53.984483 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:53.984446 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" podUID="a8ed37d9-d81f-4d44-9a90-141451f9da8c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 06 15:28:54.796477 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:54.796450 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ktjtd_8e774c49-07c6-48f4-9720-d6ebb9734b9a/serve-healthcheck-canary/0.log" Jul 06 15:28:57.513707 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:57.513655 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:58.124371 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:58.124324 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:58.322723 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:58.322672 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:58.448633 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:28:58.448550 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:29:02.711648 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:02.711606 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:29:02.788260 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:02.788229 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:29:03.983811 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:03.983771 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" podUID="a8ed37d9-d81f-4d44-9a90-141451f9da8c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 06 15:29:13.984122 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:13.984082 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" podUID="a8ed37d9-d81f-4d44-9a90-141451f9da8c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 06 15:29:13.984488 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:13.984160 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" Jul 06 15:29:13.984654 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:13.984624 2573 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"7fff35e2ecf83f15f938e86f6d367f1604f1f7c559505a28f5dbcaf78d60c1fc"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 06 15:29:13.984691 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:13.984673 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" podUID="a8ed37d9-d81f-4d44-9a90-141451f9da8c" containerName="service-proxy" containerID="cri-o://7fff35e2ecf83f15f938e86f6d367f1604f1f7c559505a28f5dbcaf78d60c1fc" gracePeriod=30 Jul 06 15:29:14.328514 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:14.328478 2573 generic.go:356] "Generic (PLEG): container finished" podID="a8ed37d9-d81f-4d44-9a90-141451f9da8c" containerID="7fff35e2ecf83f15f938e86f6d367f1604f1f7c559505a28f5dbcaf78d60c1fc" exitCode=2 Jul 06 15:29:14.328696 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:14.328545 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" event={"ID":"a8ed37d9-d81f-4d44-9a90-141451f9da8c","Type":"ContainerDied","Data":"7fff35e2ecf83f15f938e86f6d367f1604f1f7c559505a28f5dbcaf78d60c1fc"} Jul 06 15:29:14.328696 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:14.328589 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf4f964f7-r27hh" event={"ID":"a8ed37d9-d81f-4d44-9a90-141451f9da8c","Type":"ContainerStarted","Data":"6e35d735837fbb87d544c69c702ee3158b4e2ac52e5d274732ef6b4bcf90a8f6"} Jul 06 15:29:26.091718 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:26.091683 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:29:26.163403 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:26.163370 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:29:30.788978 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:30.788943 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:30.809175 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:30.809141 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:31.403025 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:31.402999 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:36.709093 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:36.709048 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:29:43.473267 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:43.473231 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:29:44.072232 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:44.072204 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:29:46.214183 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:46.214149 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:29:46.290700 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:46.290670 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:29:48.910170 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:48.910140 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 15:29:48.910610 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:48.910430 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerName="prometheus" containerID="cri-o://7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7" gracePeriod=600 Jul 06 15:29:48.910610 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:48.910456 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerName="kube-rbac-proxy-thanos" containerID="cri-o://fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb" gracePeriod=600 Jul 06 15:29:48.910610 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:48.910491 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerName="config-reloader" containerID="cri-o://7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6" gracePeriod=600 Jul 06 15:29:48.910610 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:48.910503 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerName="kube-rbac-proxy-web" containerID="cri-o://2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3" gracePeriod=600 Jul 06 15:29:48.910610 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:48.910435 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerName="kube-rbac-proxy" containerID="cri-o://94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b" gracePeriod=600 Jul 06 15:29:48.910610 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:48.910503 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerName="thanos-sidecar" containerID="cri-o://f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605" gracePeriod=600 Jul 06 15:29:49.143406 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.143382 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.256298 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.256264 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-thanos-prometheus-http-client-file\") pod \"bd4811be-167b-443d-a0b1-159996f9e1f9\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " Jul 06 15:29:49.256478 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.256315 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-prometheus-k8s-tls\") pod \"bd4811be-167b-443d-a0b1-159996f9e1f9\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " Jul 06 15:29:49.256478 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.256342 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd4811be-167b-443d-a0b1-159996f9e1f9-config-out\") pod \"bd4811be-167b-443d-a0b1-159996f9e1f9\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " Jul 06 15:29:49.256478 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.256452 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"bd4811be-167b-443d-a0b1-159996f9e1f9\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " Jul 06 15:29:49.256660 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.256486 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-kube-rbac-proxy\") pod \"bd4811be-167b-443d-a0b1-159996f9e1f9\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " Jul 06 15:29:49.256660 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.256540 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-prometheus-k8s-rulefiles-2\") pod \"bd4811be-167b-443d-a0b1-159996f9e1f9\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " Jul 06 15:29:49.256660 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.256558 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-config\") pod \"bd4811be-167b-443d-a0b1-159996f9e1f9\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " Jul 06 15:29:49.256660 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.256575 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-prometheus-trusted-ca-bundle\") pod \"bd4811be-167b-443d-a0b1-159996f9e1f9\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " Jul 06 15:29:49.256660 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.256599 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-configmap-kubelet-serving-ca-bundle\") pod \"bd4811be-167b-443d-a0b1-159996f9e1f9\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " Jul 06 15:29:49.256660 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.256622 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-prometheus-k8s-rulefiles-0\") pod \"bd4811be-167b-443d-a0b1-159996f9e1f9\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " Jul 06 15:29:49.256660 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.256651 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-prometheus-k8s-rulefiles-1\") pod \"bd4811be-167b-443d-a0b1-159996f9e1f9\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " Jul 06 15:29:49.256995 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.256681 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bd4811be-167b-443d-a0b1-159996f9e1f9-prometheus-k8s-db\") pod \"bd4811be-167b-443d-a0b1-159996f9e1f9\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " Jul 06 15:29:49.256995 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.256735 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-configmap-metrics-client-ca\") pod \"bd4811be-167b-443d-a0b1-159996f9e1f9\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " Jul 06 15:29:49.256995 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.256764 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"bd4811be-167b-443d-a0b1-159996f9e1f9\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " Jul 06 15:29:49.256995 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.256795 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd4811be-167b-443d-a0b1-159996f9e1f9-tls-assets\") pod \"bd4811be-167b-443d-a0b1-159996f9e1f9\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " Jul 06 15:29:49.256995 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.256820 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-metrics-client-certs\") pod \"bd4811be-167b-443d-a0b1-159996f9e1f9\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " Jul 06 15:29:49.256995 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.256853 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-grpc-tls\") pod \"bd4811be-167b-443d-a0b1-159996f9e1f9\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " Jul 06 15:29:49.256995 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.256878 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-configmap-serving-certs-ca-bundle\") pod \"bd4811be-167b-443d-a0b1-159996f9e1f9\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " Jul 06 15:29:49.256995 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.256898 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "bd4811be-167b-443d-a0b1-159996f9e1f9" (UID: "bd4811be-167b-443d-a0b1-159996f9e1f9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:29:49.256995 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.256912 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-web-config\") pod \"bd4811be-167b-443d-a0b1-159996f9e1f9\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " Jul 06 15:29:49.256995 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.256991 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbklm\" (UniqueName: \"kubernetes.io/projected/bd4811be-167b-443d-a0b1-159996f9e1f9-kube-api-access-nbklm\") pod \"bd4811be-167b-443d-a0b1-159996f9e1f9\" (UID: \"bd4811be-167b-443d-a0b1-159996f9e1f9\") " Jul 06 15:29:49.257515 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.257264 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-129.ec2.internal\" DevicePath \"\"" Jul 06 15:29:49.259186 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.259077 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "bd4811be-167b-443d-a0b1-159996f9e1f9" (UID: "bd4811be-167b-443d-a0b1-159996f9e1f9"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:29:49.259457 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.259431 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "bd4811be-167b-443d-a0b1-159996f9e1f9" (UID: "bd4811be-167b-443d-a0b1-159996f9e1f9"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:29:49.259592 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.259508 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "bd4811be-167b-443d-a0b1-159996f9e1f9" (UID: "bd4811be-167b-443d-a0b1-159996f9e1f9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:29:49.259736 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.259708 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "bd4811be-167b-443d-a0b1-159996f9e1f9" (UID: "bd4811be-167b-443d-a0b1-159996f9e1f9"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:29:49.259806 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.259720 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd4811be-167b-443d-a0b1-159996f9e1f9-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "bd4811be-167b-443d-a0b1-159996f9e1f9" (UID: "bd4811be-167b-443d-a0b1-159996f9e1f9"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:29:49.259806 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.259769 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "bd4811be-167b-443d-a0b1-159996f9e1f9" (UID: "bd4811be-167b-443d-a0b1-159996f9e1f9"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:29:49.259936 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.259817 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "bd4811be-167b-443d-a0b1-159996f9e1f9" (UID: "bd4811be-167b-443d-a0b1-159996f9e1f9"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:29:49.259936 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.259895 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "bd4811be-167b-443d-a0b1-159996f9e1f9" (UID: "bd4811be-167b-443d-a0b1-159996f9e1f9"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:29:49.259936 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.259913 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-config" (OuterVolumeSpecName: "config") pod "bd4811be-167b-443d-a0b1-159996f9e1f9" (UID: "bd4811be-167b-443d-a0b1-159996f9e1f9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:29:49.260200 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.259949 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "bd4811be-167b-443d-a0b1-159996f9e1f9" (UID: "bd4811be-167b-443d-a0b1-159996f9e1f9"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:29:49.260200 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.260002 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "bd4811be-167b-443d-a0b1-159996f9e1f9" (UID: "bd4811be-167b-443d-a0b1-159996f9e1f9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:29:49.260304 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.260281 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "bd4811be-167b-443d-a0b1-159996f9e1f9" (UID: "bd4811be-167b-443d-a0b1-159996f9e1f9"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:29:49.260426 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.260402 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd4811be-167b-443d-a0b1-159996f9e1f9-config-out" (OuterVolumeSpecName: "config-out") pod "bd4811be-167b-443d-a0b1-159996f9e1f9" (UID: "bd4811be-167b-443d-a0b1-159996f9e1f9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:29:49.261197 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.261171 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd4811be-167b-443d-a0b1-159996f9e1f9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "bd4811be-167b-443d-a0b1-159996f9e1f9" (UID: "bd4811be-167b-443d-a0b1-159996f9e1f9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:29:49.261399 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.261377 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd4811be-167b-443d-a0b1-159996f9e1f9-kube-api-access-nbklm" (OuterVolumeSpecName: "kube-api-access-nbklm") pod "bd4811be-167b-443d-a0b1-159996f9e1f9" (UID: "bd4811be-167b-443d-a0b1-159996f9e1f9"). InnerVolumeSpecName "kube-api-access-nbklm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:29:49.261641 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.261625 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "bd4811be-167b-443d-a0b1-159996f9e1f9" (UID: "bd4811be-167b-443d-a0b1-159996f9e1f9"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:29:49.261782 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.261770 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "bd4811be-167b-443d-a0b1-159996f9e1f9" (UID: "bd4811be-167b-443d-a0b1-159996f9e1f9"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:29:49.262312 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.262300 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "bd4811be-167b-443d-a0b1-159996f9e1f9" (UID: "bd4811be-167b-443d-a0b1-159996f9e1f9"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:29:49.271346 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.271326 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-web-config" (OuterVolumeSpecName: "web-config") pod "bd4811be-167b-443d-a0b1-159996f9e1f9" (UID: "bd4811be-167b-443d-a0b1-159996f9e1f9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:29:49.357943 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.357917 2573 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-129.ec2.internal\" DevicePath \"\"" Jul 06 15:29:49.357943 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.357938 2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-129.ec2.internal\" DevicePath \"\"" Jul 06 15:29:49.357943 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.357948 2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd4811be-167b-443d-a0b1-159996f9e1f9-config-out\") on node \"ip-10-0-143-129.ec2.internal\" DevicePath \"\"" Jul 06 15:29:49.358153 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.357957 2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-129.ec2.internal\" DevicePath \"\"" Jul 06 15:29:49.358153 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.357966 2573 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-kube-rbac-proxy\") on node \"ip-10-0-143-129.ec2.internal\" DevicePath \"\"" Jul 06 15:29:49.358153 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.357976 2573 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-config\") on node \"ip-10-0-143-129.ec2.internal\" DevicePath \"\"" Jul 06 15:29:49.358153 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.357985 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-129.ec2.internal\" DevicePath \"\"" Jul 06 15:29:49.358153 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.357994 2573 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-129.ec2.internal\" DevicePath \"\"" Jul 06 15:29:49.358153 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.358003 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-129.ec2.internal\" DevicePath \"\"" Jul 06 15:29:49.358153 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.358012 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-129.ec2.internal\" DevicePath \"\"" Jul 06 15:29:49.358153 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.358020 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bd4811be-167b-443d-a0b1-159996f9e1f9-prometheus-k8s-db\") on node \"ip-10-0-143-129.ec2.internal\" DevicePath \"\"" Jul 06 15:29:49.358153 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.358028 2573 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-configmap-metrics-client-ca\") on node \"ip-10-0-143-129.ec2.internal\" DevicePath \"\"" Jul 06 15:29:49.358153 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.358053 2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-129.ec2.internal\" DevicePath \"\"" Jul 06 15:29:49.358153 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.358068 2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd4811be-167b-443d-a0b1-159996f9e1f9-tls-assets\") on node \"ip-10-0-143-129.ec2.internal\" DevicePath \"\"" Jul 06 15:29:49.358153 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.358077 2573 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-metrics-client-certs\") on node \"ip-10-0-143-129.ec2.internal\" DevicePath \"\"" Jul 06 15:29:49.358153 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.358084 2573 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-secret-grpc-tls\") on node \"ip-10-0-143-129.ec2.internal\" DevicePath \"\"" Jul 06 15:29:49.358153 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.358092 2573 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd4811be-167b-443d-a0b1-159996f9e1f9-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-129.ec2.internal\" DevicePath \"\"" Jul 06 15:29:49.358153 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.358100 2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd4811be-167b-443d-a0b1-159996f9e1f9-web-config\") on node \"ip-10-0-143-129.ec2.internal\" DevicePath \"\"" Jul 06 15:29:49.358153 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.358108 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbklm\" (UniqueName: \"kubernetes.io/projected/bd4811be-167b-443d-a0b1-159996f9e1f9-kube-api-access-nbklm\") on node \"ip-10-0-143-129.ec2.internal\" DevicePath \"\"" Jul 06 15:29:49.454045 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.454010 2573 generic.go:356] "Generic (PLEG): container finished" podID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerID="fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb" exitCode=0 Jul 06 15:29:49.454045 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.454051 2573 generic.go:356] "Generic (PLEG): container finished" podID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerID="94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b" exitCode=0 Jul 06 15:29:49.454228 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.454061 2573 generic.go:356] "Generic (PLEG): container finished" podID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerID="2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3" exitCode=0 Jul 06 15:29:49.454228 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.454070 2573 generic.go:356] "Generic (PLEG): container finished" podID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerID="f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605" exitCode=0 Jul 06 15:29:49.454228 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.454063 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd4811be-167b-443d-a0b1-159996f9e1f9","Type":"ContainerDied","Data":"fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb"} Jul 06 15:29:49.454228 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.454125 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.454228 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.454078 2573 generic.go:356] "Generic (PLEG): container finished" podID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerID="7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6" exitCode=0 Jul 06 15:29:49.454228 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.454160 2573 generic.go:356] "Generic (PLEG): container finished" podID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerID="7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7" exitCode=0 Jul 06 15:29:49.454228 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.454179 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd4811be-167b-443d-a0b1-159996f9e1f9","Type":"ContainerDied","Data":"94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b"} Jul 06 15:29:49.454228 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.454222 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd4811be-167b-443d-a0b1-159996f9e1f9","Type":"ContainerDied","Data":"2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3"} Jul 06 15:29:49.454485 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.454263 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd4811be-167b-443d-a0b1-159996f9e1f9","Type":"ContainerDied","Data":"f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605"} Jul 06 15:29:49.454485 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.454256 2573 scope.go:117] "RemoveContainer" containerID="fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb" Jul 06 15:29:49.454485 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.454306 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd4811be-167b-443d-a0b1-159996f9e1f9","Type":"ContainerDied","Data":"7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6"} Jul 06 15:29:49.454485 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.454347 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd4811be-167b-443d-a0b1-159996f9e1f9","Type":"ContainerDied","Data":"7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7"} Jul 06 15:29:49.454485 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.454388 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd4811be-167b-443d-a0b1-159996f9e1f9","Type":"ContainerDied","Data":"88b5da05cb6a8a8ecbe3699327968037c1d3dac90472c8cce2b1b8160a43d183"} Jul 06 15:29:49.463558 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.463536 2573 scope.go:117] "RemoveContainer" containerID="94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b" Jul 06 15:29:49.470695 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.470679 2573 scope.go:117] "RemoveContainer" containerID="2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3" Jul 06 15:29:49.476620 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.476604 2573 scope.go:117] "RemoveContainer" containerID="f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605" Jul 06 15:29:49.481016 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.480997 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 15:29:49.483492 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.483473 2573 scope.go:117] "RemoveContainer" containerID="7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6" Jul 06 15:29:49.488912 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.488893 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 15:29:49.489673 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.489656 2573 scope.go:117] "RemoveContainer" containerID="7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7" Jul 06 15:29:49.495668 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.495649 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd4811be-167b-443d-a0b1-159996f9e1f9" path="/var/lib/kubelet/pods/bd4811be-167b-443d-a0b1-159996f9e1f9/volumes" Jul 06 15:29:49.496668 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.496656 2573 scope.go:117] "RemoveContainer" containerID="7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d" Jul 06 15:29:49.502664 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.502650 2573 scope.go:117] "RemoveContainer" containerID="fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb" Jul 06 15:29:49.502931 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:29:49.502913 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb\": container with ID starting with fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb not found: ID does not exist" containerID="fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb" Jul 06 15:29:49.502984 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.502939 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb"} err="failed to get container status \"fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb\": rpc error: code = NotFound desc = could not find container \"fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb\": container with ID starting with fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb not found: ID does not exist" Jul 06 15:29:49.502984 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.502955 2573 scope.go:117] "RemoveContainer" containerID="94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b" Jul 06 15:29:49.503210 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:29:49.503192 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b\": container with ID starting with 94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b not found: ID does not exist" containerID="94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b" Jul 06 15:29:49.503274 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.503219 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b"} err="failed to get container status \"94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b\": rpc error: code = NotFound desc = could not find container \"94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b\": container with ID starting with 94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b not found: ID does not exist" Jul 06 15:29:49.503274 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.503242 2573 scope.go:117] "RemoveContainer" containerID="2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3" Jul 06 15:29:49.503455 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:29:49.503440 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3\": container with ID starting with 2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3 not found: ID does not exist" containerID="2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3" Jul 06 15:29:49.503513 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.503461 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3"} err="failed to get container status \"2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3\": rpc error: code = NotFound desc = could not find container \"2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3\": container with ID starting with 2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3 not found: ID does not exist" Jul 06 15:29:49.503513 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.503481 2573 scope.go:117] "RemoveContainer" containerID="f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605" Jul 06 15:29:49.503724 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:29:49.503709 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605\": container with ID starting with f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605 not found: ID does not exist" containerID="f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605" Jul 06 15:29:49.503760 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.503728 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605"} err="failed to get container status \"f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605\": rpc error: code = NotFound desc = could not find container \"f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605\": container with ID starting with f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605 not found: ID does not exist" Jul 06 15:29:49.503760 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.503742 2573 scope.go:117] "RemoveContainer" containerID="7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6" Jul 06 15:29:49.503954 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:29:49.503939 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6\": container with ID starting with 7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6 not found: ID does not exist" containerID="7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6" Jul 06 15:29:49.504016 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.503960 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6"} err="failed to get container status \"7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6\": rpc error: code = NotFound desc = could not find container \"7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6\": container with ID starting with 7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6 not found: ID does not exist" Jul 06 15:29:49.504016 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.503978 2573 scope.go:117] "RemoveContainer" containerID="7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7" Jul 06 15:29:49.504319 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:29:49.504302 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7\": container with ID starting with 7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7 not found: ID does not exist" containerID="7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7" Jul 06 15:29:49.504378 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.504322 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7"} err="failed to get container status \"7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7\": rpc error: code = NotFound desc = could not find container \"7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7\": container with ID starting with 7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7 not found: ID does not exist" Jul 06 15:29:49.504378 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.504336 2573 scope.go:117] "RemoveContainer" containerID="7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d" Jul 06 15:29:49.504549 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:29:49.504531 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d\": container with ID starting with 7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d not found: ID does not exist" containerID="7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d" Jul 06 15:29:49.504582 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.504552 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d"} err="failed to get container status \"7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d\": rpc error: code = NotFound desc = could not find container \"7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d\": container with ID starting with 7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d not found: ID does not exist" Jul 06 15:29:49.504582 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.504565 2573 scope.go:117] "RemoveContainer" containerID="fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb" Jul 06 15:29:49.504779 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.504762 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb"} err="failed to get container status \"fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb\": rpc error: code = NotFound desc = could not find container \"fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb\": container with ID starting with fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb not found: ID does not exist" Jul 06 15:29:49.504822 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.504783 2573 scope.go:117] "RemoveContainer" containerID="94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b" Jul 06 15:29:49.504977 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.504960 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b"} err="failed to get container status \"94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b\": rpc error: code = NotFound desc = could not find container \"94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b\": container with ID starting with 94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b not found: ID does not exist" Jul 06 15:29:49.505062 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.504979 2573 scope.go:117] "RemoveContainer" containerID="2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3" Jul 06 15:29:49.505216 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.505199 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3"} err="failed to get container status \"2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3\": rpc error: code = NotFound desc = could not find container \"2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3\": container with ID starting with 2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3 not found: ID does not exist" Jul 06 15:29:49.505283 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.505218 2573 scope.go:117] "RemoveContainer" containerID="f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605" Jul 06 15:29:49.505409 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.505392 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605"} err="failed to get container status \"f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605\": rpc error: code = NotFound desc = could not find container \"f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605\": container with ID starting with f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605 not found: ID does not exist" Jul 06 15:29:49.505452 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.505410 2573 scope.go:117] "RemoveContainer" containerID="7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6" Jul 06 15:29:49.505600 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.505582 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6"} err="failed to get container status \"7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6\": rpc error: code = NotFound desc = could not find container \"7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6\": container with ID starting with 7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6 not found: ID does not exist" Jul 06 15:29:49.505666 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.505601 2573 scope.go:117] "RemoveContainer" containerID="7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7" Jul 06 15:29:49.505832 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.505814 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7"} err="failed to get container status \"7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7\": rpc error: code = NotFound desc = could not find container \"7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7\": container with ID starting with 7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7 not found: ID does not exist" Jul 06 15:29:49.505879 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.505834 2573 scope.go:117] "RemoveContainer" containerID="7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d" Jul 06 15:29:49.506050 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.506016 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d"} err="failed to get container status \"7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d\": rpc error: code = NotFound desc = could not find container \"7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d\": container with ID starting with 7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d not found: ID does not exist" Jul 06 15:29:49.506050 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.506046 2573 scope.go:117] "RemoveContainer" containerID="fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb" Jul 06 15:29:49.506269 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.506248 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb"} err="failed to get container status \"fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb\": rpc error: code = NotFound desc = could not find container \"fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb\": container with ID starting with fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb not found: ID does not exist" Jul 06 15:29:49.506330 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.506270 2573 scope.go:117] "RemoveContainer" containerID="94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b" Jul 06 15:29:49.506470 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.506453 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b"} err="failed to get container status \"94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b\": rpc error: code = NotFound desc = could not find container \"94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b\": container with ID starting with 94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b not found: ID does not exist" Jul 06 15:29:49.506539 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.506472 2573 scope.go:117] "RemoveContainer" containerID="2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3" Jul 06 15:29:49.506697 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.506676 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3"} err="failed to get container status \"2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3\": rpc error: code = NotFound desc = could not find container \"2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3\": container with ID starting with 2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3 not found: ID does not exist" Jul 06 15:29:49.506742 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.506697 2573 scope.go:117] "RemoveContainer" containerID="f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605" Jul 06 15:29:49.506886 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.506869 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605"} err="failed to get container status \"f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605\": rpc error: code = NotFound desc = could not find container \"f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605\": container with ID starting with f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605 not found: ID does not exist" Jul 06 15:29:49.506950 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.506887 2573 scope.go:117] "RemoveContainer" containerID="7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6" Jul 06 15:29:49.507107 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.507091 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6"} err="failed to get container status \"7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6\": rpc error: code = NotFound desc = could not find container \"7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6\": container with ID starting with 7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6 not found: ID does not exist" Jul 06 15:29:49.507158 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.507108 2573 scope.go:117] "RemoveContainer" containerID="7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7" Jul 06 15:29:49.507287 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.507269 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7"} err="failed to get container status \"7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7\": rpc error: code = NotFound desc = could not find container \"7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7\": container with ID starting with 7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7 not found: ID does not exist" Jul 06 15:29:49.507346 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.507288 2573 scope.go:117] "RemoveContainer" containerID="7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d" Jul 06 15:29:49.507469 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.507454 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d"} err="failed to get container status \"7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d\": rpc error: code = NotFound desc = could not find container \"7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d\": container with ID starting with 7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d not found: ID does not exist" Jul 06 15:29:49.507509 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.507469 2573 scope.go:117] "RemoveContainer" containerID="fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb" Jul 06 15:29:49.507623 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.507609 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb"} err="failed to get container status \"fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb\": rpc error: code = NotFound desc = could not find container \"fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb\": container with ID starting with fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb not found: ID does not exist" Jul 06 15:29:49.507663 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.507623 2573 scope.go:117] "RemoveContainer" containerID="94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b" Jul 06 15:29:49.507839 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.507821 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b"} err="failed to get container status \"94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b\": rpc error: code = NotFound desc = could not find container \"94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b\": container with ID starting with 94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b not found: ID does not exist" Jul 06 15:29:49.507898 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.507840 2573 scope.go:117] "RemoveContainer" containerID="2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3" Jul 06 15:29:49.508105 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.508088 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3"} err="failed to get container status \"2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3\": rpc error: code = NotFound desc = could not find container \"2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3\": container with ID starting with 2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3 not found: ID does not exist" Jul 06 15:29:49.508155 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.508106 2573 scope.go:117] "RemoveContainer" containerID="f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605" Jul 06 15:29:49.508318 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.508300 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605"} err="failed to get container status \"f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605\": rpc error: code = NotFound desc = could not find container \"f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605\": container with ID starting with f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605 not found: ID does not exist" Jul 06 15:29:49.508383 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.508320 2573 scope.go:117] "RemoveContainer" containerID="7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6" Jul 06 15:29:49.508572 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.508546 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6"} err="failed to get container status \"7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6\": rpc error: code = NotFound desc = could not find container \"7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6\": container with ID starting with 7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6 not found: ID does not exist" Jul 06 15:29:49.508626 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.508573 2573 scope.go:117] "RemoveContainer" containerID="7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7" Jul 06 15:29:49.508803 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.508780 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7"} err="failed to get container status \"7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7\": rpc error: code = NotFound desc = could not find container \"7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7\": container with ID starting with 7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7 not found: ID does not exist" Jul 06 15:29:49.508858 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.508803 2573 scope.go:117] "RemoveContainer" containerID="7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d" Jul 06 15:29:49.509068 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.509021 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d"} err="failed to get container status \"7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d\": rpc error: code = NotFound desc = could not find container \"7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d\": container with ID starting with 7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d not found: ID does not exist" Jul 06 15:29:49.509068 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.509055 2573 scope.go:117] "RemoveContainer" containerID="fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb" Jul 06 15:29:49.509278 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.509263 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb"} err="failed to get container status \"fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb\": rpc error: code = NotFound desc = could not find container \"fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb\": container with ID starting with fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb not found: ID does not exist" Jul 06 15:29:49.509325 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.509278 2573 scope.go:117] "RemoveContainer" containerID="94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b" Jul 06 15:29:49.509468 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.509454 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b"} err="failed to get container status \"94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b\": rpc error: code = NotFound desc = could not find container \"94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b\": container with ID starting with 94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b not found: ID does not exist" Jul 06 15:29:49.509517 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.509469 2573 scope.go:117] "RemoveContainer" containerID="2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3" Jul 06 15:29:49.509659 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.509640 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3"} err="failed to get container status \"2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3\": rpc error: code = NotFound desc = could not find container \"2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3\": container with ID starting with 2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3 not found: ID does not exist" Jul 06 15:29:49.509700 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.509661 2573 scope.go:117] "RemoveContainer" containerID="f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605" Jul 06 15:29:49.509857 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.509842 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605"} err="failed to get container status \"f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605\": rpc error: code = NotFound desc = could not find container \"f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605\": container with ID starting with f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605 not found: ID does not exist" Jul 06 15:29:49.509904 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.509857 2573 scope.go:117] "RemoveContainer" containerID="7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6" Jul 06 15:29:49.510022 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.510007 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6"} err="failed to get container status \"7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6\": rpc error: code = NotFound desc = could not find container \"7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6\": container with ID starting with 7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6 not found: ID does not exist" Jul 06 15:29:49.510071 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.510022 2573 scope.go:117] "RemoveContainer" containerID="7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7" Jul 06 15:29:49.510205 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.510190 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7"} err="failed to get container status \"7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7\": rpc error: code = NotFound desc = could not find container \"7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7\": container with ID starting with 7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7 not found: ID does not exist" Jul 06 15:29:49.510250 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.510205 2573 scope.go:117] "RemoveContainer" containerID="7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d" Jul 06 15:29:49.510406 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.510387 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d"} err="failed to get container status \"7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d\": rpc error: code = NotFound desc = could not find container \"7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d\": container with ID starting with 7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d not found: ID does not exist" Jul 06 15:29:49.510473 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.510407 2573 scope.go:117] "RemoveContainer" containerID="fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb" Jul 06 15:29:49.510601 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.510585 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb"} err="failed to get container status \"fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb\": rpc error: code = NotFound desc = could not find container \"fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb\": container with ID starting with fc6aac5a080b58ca0e3361bc7682c3cba8e6dd9116d95c761bc7163e506082cb not found: ID does not exist" Jul 06 15:29:49.510601 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.510600 2573 scope.go:117] "RemoveContainer" containerID="94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b" Jul 06 15:29:49.510764 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.510746 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b"} err="failed to get container status \"94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b\": rpc error: code = NotFound desc = could not find container \"94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b\": container with ID starting with 94e03676f3fde744283addd3b923882525e7ca4d425b8a6f26a80344519a269b not found: ID does not exist" Jul 06 15:29:49.510810 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.510772 2573 scope.go:117] "RemoveContainer" containerID="2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3" Jul 06 15:29:49.510972 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.510953 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3"} err="failed to get container status \"2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3\": rpc error: code = NotFound desc = could not find container \"2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3\": container with ID starting with 2fc2d501d28ac4c53faeaec0098633d42e0a74ee9cf2068825df1fd97b5fdbc3 not found: ID does not exist" Jul 06 15:29:49.511020 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.510972 2573 scope.go:117] "RemoveContainer" containerID="f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605" Jul 06 15:29:49.511157 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.511139 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605"} err="failed to get container status \"f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605\": rpc error: code = NotFound desc = could not find container \"f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605\": container with ID starting with f582ca10a73eda2c1a3c1eb0be4d9109664c4d3d8bcb041d48bce8683dadd605 not found: ID does not exist" Jul 06 15:29:49.511227 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.511159 2573 scope.go:117] "RemoveContainer" containerID="7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6" Jul 06 15:29:49.511364 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.511348 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6"} err="failed to get container status \"7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6\": rpc error: code = NotFound desc = could not find container \"7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6\": container with ID starting with 7129b3c0ceab9d257732616838a85d024b3ef5efae09b051a6390cb13657c6f6 not found: ID does not exist" Jul 06 15:29:49.511414 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.511366 2573 scope.go:117] "RemoveContainer" containerID="7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7" Jul 06 15:29:49.511538 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.511521 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7"} err="failed to get container status \"7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7\": rpc error: code = NotFound desc = could not find container \"7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7\": container with ID starting with 7d32bd4e2b4f25f3f15ba9be9aa8d8896ae87a4a499b27afcfae59fb6245a5c7 not found: ID does not exist" Jul 06 15:29:49.511587 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.511538 2573 scope.go:117] "RemoveContainer" containerID="7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d" Jul 06 15:29:49.511712 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.511697 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d"} err="failed to get container status \"7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d\": rpc error: code = NotFound desc = could not find container \"7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d\": container with ID starting with 7cdb6d1283501213b91ae74f189be22bf405dcaf9b5c2988d2e8e379b574fb9d not found: ID does not exist" Jul 06 15:29:49.516814 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.516796 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 15:29:49.517012 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.517001 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerName="thanos-sidecar" Jul 06 15:29:49.517084 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.517014 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerName="thanos-sidecar" Jul 06 15:29:49.517084 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.517020 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerName="kube-rbac-proxy-thanos" Jul 06 15:29:49.517084 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.517025 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerName="kube-rbac-proxy-thanos" Jul 06 15:29:49.517084 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.517049 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerName="prometheus" Jul 06 15:29:49.517084 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.517058 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerName="prometheus" Jul 06 15:29:49.517084 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.517071 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerName="kube-rbac-proxy-web" Jul 06 15:29:49.517084 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.517077 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerName="kube-rbac-proxy-web" Jul 06 15:29:49.517084 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.517085 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerName="kube-rbac-proxy" Jul 06 15:29:49.517345 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.517090 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerName="kube-rbac-proxy" Jul 06 15:29:49.517345 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.517097 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerName="init-config-reloader" Jul 06 15:29:49.517345 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.517102 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerName="init-config-reloader" Jul 06 15:29:49.517345 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.517108 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerName="config-reloader" Jul 06 15:29:49.517345 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.517114 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerName="config-reloader" Jul 06 15:29:49.517345 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.517152 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerName="prometheus" Jul 06 15:29:49.517345 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.517159 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerName="thanos-sidecar" Jul 06 15:29:49.517345 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.517164 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerName="kube-rbac-proxy-web" Jul 06 15:29:49.517345 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.517170 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerName="kube-rbac-proxy" Jul 06 15:29:49.517345 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.517176 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerName="kube-rbac-proxy-thanos" Jul 06 15:29:49.517345 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.517182 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd4811be-167b-443d-a0b1-159996f9e1f9" containerName="config-reloader" Jul 06 15:29:49.521074 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.521060 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.523623 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.523605 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 15:29:49.523703 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.523607 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 15:29:49.523703 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.523672 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 15:29:49.523954 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.523939 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 15:29:49.524054 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.524022 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 15:29:49.524216 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.524202 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-f5tckd64cpvq3\"" Jul 06 15:29:49.524525 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.524512 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 15:29:49.525080 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.525009 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 15:29:49.525080 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.525067 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 15:29:49.525080 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.525079 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 15:29:49.525327 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.525313 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 15:29:49.525406 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.525315 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 15:29:49.525585 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.525567 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 15:29:49.525679 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.525665 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vbjdv\"" Jul 06 15:29:49.527159 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.527142 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 15:29:49.529309 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.529288 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 15:29:49.532054 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.532022 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 15:29:49.543665 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.543643 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 15:29:49.559443 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.559421 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5694cc3b-4f6c-46da-82a2-e2e688e442fc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.559526 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.559466 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5694cc3b-4f6c-46da-82a2-e2e688e442fc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.559526 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.559488 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5694cc3b-4f6c-46da-82a2-e2e688e442fc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.559597 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.559537 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnp8l\" (UniqueName: \"kubernetes.io/projected/5694cc3b-4f6c-46da-82a2-e2e688e442fc-kube-api-access-jnp8l\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.559597 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.559562 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5694cc3b-4f6c-46da-82a2-e2e688e442fc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.559597 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.559580 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5694cc3b-4f6c-46da-82a2-e2e688e442fc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.559702 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.559602 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5694cc3b-4f6c-46da-82a2-e2e688e442fc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.559702 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.559621 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5694cc3b-4f6c-46da-82a2-e2e688e442fc-web-config\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.559702 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.559660 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5694cc3b-4f6c-46da-82a2-e2e688e442fc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.559702 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.559684 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5694cc3b-4f6c-46da-82a2-e2e688e442fc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.559833 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.559709 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5694cc3b-4f6c-46da-82a2-e2e688e442fc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.559833 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.559740 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5694cc3b-4f6c-46da-82a2-e2e688e442fc-config-out\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.559833 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.559765 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5694cc3b-4f6c-46da-82a2-e2e688e442fc-config\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.559833 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.559780 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5694cc3b-4f6c-46da-82a2-e2e688e442fc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.559972 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.559823 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5694cc3b-4f6c-46da-82a2-e2e688e442fc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.559972 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.559850 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5694cc3b-4f6c-46da-82a2-e2e688e442fc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.559972 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.559874 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5694cc3b-4f6c-46da-82a2-e2e688e442fc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.559972 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.559891 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5694cc3b-4f6c-46da-82a2-e2e688e442fc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.559972 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.559911 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5694cc3b-4f6c-46da-82a2-e2e688e442fc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.559972 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.559926 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5694cc3b-4f6c-46da-82a2-e2e688e442fc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.660396 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.660362 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5694cc3b-4f6c-46da-82a2-e2e688e442fc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.660535 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.660404 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5694cc3b-4f6c-46da-82a2-e2e688e442fc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.660535 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.660424 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnp8l\" (UniqueName: \"kubernetes.io/projected/5694cc3b-4f6c-46da-82a2-e2e688e442fc-kube-api-access-jnp8l\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.660535 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.660445 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5694cc3b-4f6c-46da-82a2-e2e688e442fc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.660535 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.660463 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5694cc3b-4f6c-46da-82a2-e2e688e442fc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.660535 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.660493 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5694cc3b-4f6c-46da-82a2-e2e688e442fc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.660535 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.660514 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5694cc3b-4f6c-46da-82a2-e2e688e442fc-web-config\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.660826 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.660547 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5694cc3b-4f6c-46da-82a2-e2e688e442fc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.660826 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.660573 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5694cc3b-4f6c-46da-82a2-e2e688e442fc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.660826 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.660598 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5694cc3b-4f6c-46da-82a2-e2e688e442fc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.660826 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.660624 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5694cc3b-4f6c-46da-82a2-e2e688e442fc-config-out\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.660826 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.660662 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5694cc3b-4f6c-46da-82a2-e2e688e442fc-config\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.660826 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.660683 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5694cc3b-4f6c-46da-82a2-e2e688e442fc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.660826 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.660707 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5694cc3b-4f6c-46da-82a2-e2e688e442fc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.660826 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.660731 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5694cc3b-4f6c-46da-82a2-e2e688e442fc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.660826 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.660751 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5694cc3b-4f6c-46da-82a2-e2e688e442fc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.660826 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.660776 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5694cc3b-4f6c-46da-82a2-e2e688e442fc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.660826 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.660801 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5694cc3b-4f6c-46da-82a2-e2e688e442fc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.660826 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.660804 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5694cc3b-4f6c-46da-82a2-e2e688e442fc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.660826 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.660824 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5694cc3b-4f6c-46da-82a2-e2e688e442fc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.661463 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.660880 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5694cc3b-4f6c-46da-82a2-e2e688e442fc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.661463 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.661225 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5694cc3b-4f6c-46da-82a2-e2e688e442fc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.661463 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.661404 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5694cc3b-4f6c-46da-82a2-e2e688e442fc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.661690 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.661554 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5694cc3b-4f6c-46da-82a2-e2e688e442fc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.661776 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.661753 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5694cc3b-4f6c-46da-82a2-e2e688e442fc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.662420 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.662393 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5694cc3b-4f6c-46da-82a2-e2e688e442fc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.663049 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.663012 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5694cc3b-4f6c-46da-82a2-e2e688e442fc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.663478 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.663366 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5694cc3b-4f6c-46da-82a2-e2e688e442fc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.663778 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.663754 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5694cc3b-4f6c-46da-82a2-e2e688e442fc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.664129 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.664102 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5694cc3b-4f6c-46da-82a2-e2e688e442fc-config-out\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.664129 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.664118 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5694cc3b-4f6c-46da-82a2-e2e688e442fc-web-config\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.664368 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.664347 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5694cc3b-4f6c-46da-82a2-e2e688e442fc-config\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.664974 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.664948 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5694cc3b-4f6c-46da-82a2-e2e688e442fc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.665330 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.665309 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5694cc3b-4f6c-46da-82a2-e2e688e442fc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.665869 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.665842 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5694cc3b-4f6c-46da-82a2-e2e688e442fc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.666174 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.666158 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5694cc3b-4f6c-46da-82a2-e2e688e442fc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.666254 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.666239 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5694cc3b-4f6c-46da-82a2-e2e688e442fc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.666441 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.666425 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5694cc3b-4f6c-46da-82a2-e2e688e442fc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.666545 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.666520 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5694cc3b-4f6c-46da-82a2-e2e688e442fc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.669306 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.669287 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnp8l\" (UniqueName: \"kubernetes.io/projected/5694cc3b-4f6c-46da-82a2-e2e688e442fc-kube-api-access-jnp8l\") pod \"prometheus-k8s-0\" (UID: \"5694cc3b-4f6c-46da-82a2-e2e688e442fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.830875 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.830789 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:49.965083 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:49.965061 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 15:29:49.966932 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:29:49.966907 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5694cc3b_4f6c_46da_82a2_e2e688e442fc.slice/crio-d0a3eacb243c0d63f26a6c5604da63887332ef08cc3e701502337c14059751de WatchSource:0}: Error finding container d0a3eacb243c0d63f26a6c5604da63887332ef08cc3e701502337c14059751de: Status 404 returned error can't find the container with id d0a3eacb243c0d63f26a6c5604da63887332ef08cc3e701502337c14059751de Jul 06 15:29:50.265272 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:50.265238 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20db46ed-b7f8-4846-993e-578a879360b4-metrics-certs\") pod \"network-metrics-daemon-jr4kq\" (UID: \"20db46ed-b7f8-4846-993e-578a879360b4\") " pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:29:50.267376 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:50.267357 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20db46ed-b7f8-4846-993e-578a879360b4-metrics-certs\") pod \"network-metrics-daemon-jr4kq\" (UID: \"20db46ed-b7f8-4846-993e-578a879360b4\") " pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:29:50.459890 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:50.459862 2573 generic.go:356] "Generic (PLEG): container finished" podID="5694cc3b-4f6c-46da-82a2-e2e688e442fc" containerID="f5070bef454a833daf3ce89dc745663549a7ce5dd41339a2cd4434be66ddf8eb" exitCode=0 Jul 06 15:29:50.460073 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:50.459902 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5694cc3b-4f6c-46da-82a2-e2e688e442fc","Type":"ContainerDied","Data":"f5070bef454a833daf3ce89dc745663549a7ce5dd41339a2cd4434be66ddf8eb"} Jul 06 15:29:50.460073 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:50.459951 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5694cc3b-4f6c-46da-82a2-e2e688e442fc","Type":"ContainerStarted","Data":"d0a3eacb243c0d63f26a6c5604da63887332ef08cc3e701502337c14059751de"} Jul 06 15:29:50.494770 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:50.494739 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cvwwb\"" Jul 06 15:29:50.503688 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:50.503653 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jr4kq" Jul 06 15:29:50.673988 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:50.672954 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jr4kq"] Jul 06 15:29:50.682219 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:29:50.682176 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20db46ed_b7f8_4846_993e_578a879360b4.slice/crio-198a4619cc61611be1d4b8be3e6d6145636cf48092dfa91141ca6e7c607aafd0 WatchSource:0}: Error finding container 198a4619cc61611be1d4b8be3e6d6145636cf48092dfa91141ca6e7c607aafd0: Status 404 returned error can't find the container with id 198a4619cc61611be1d4b8be3e6d6145636cf48092dfa91141ca6e7c607aafd0 Jul 06 15:29:51.465096 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:51.465059 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jr4kq" event={"ID":"20db46ed-b7f8-4846-993e-578a879360b4","Type":"ContainerStarted","Data":"198a4619cc61611be1d4b8be3e6d6145636cf48092dfa91141ca6e7c607aafd0"} Jul 06 15:29:51.468728 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:51.468700 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5694cc3b-4f6c-46da-82a2-e2e688e442fc","Type":"ContainerStarted","Data":"07c6f8f88fced4e2ba597e30f081524206dbf2746cf39c3eb1b10861e3caedee"} Jul 06 15:29:51.468873 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:51.468771 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5694cc3b-4f6c-46da-82a2-e2e688e442fc","Type":"ContainerStarted","Data":"65da5f444c70347db07be413adf456ae1c8f19818613a38abaf883f81d374b4b"} Jul 06 15:29:51.468873 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:51.468812 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5694cc3b-4f6c-46da-82a2-e2e688e442fc","Type":"ContainerStarted","Data":"9f12088b9c8e57699eaea4c986a8793fcddd9d3ec88132cc60265d6fa4ca5445"} Jul 06 15:29:51.468873 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:51.468851 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5694cc3b-4f6c-46da-82a2-e2e688e442fc","Type":"ContainerStarted","Data":"f481b4b2e7c88275d18fb67fbe2d7c6ac1c13bbd60832cc82efc1902add37124"} Jul 06 15:29:51.469049 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:51.468889 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5694cc3b-4f6c-46da-82a2-e2e688e442fc","Type":"ContainerStarted","Data":"1216df398a596f031fb5320e262c21b02102cd3fe4ce0258f91e53fd13055363"} Jul 06 15:29:51.469049 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:51.468925 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5694cc3b-4f6c-46da-82a2-e2e688e442fc","Type":"ContainerStarted","Data":"4889d2bc84dc2632d6d234dd4dfc7925c4d40fa27829215532b0b77e711bcbf2"} Jul 06 15:29:51.502300 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:51.502251 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.483531878 podStartE2EDuration="2.502234324s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.702446ms" isStatefulPod=false podCreationTimestamp="2026-07-06 15:29:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:29:51.499981317 +0000 UTC m=+252.625043610" watchObservedRunningTime="2026-07-06 15:29:51.502234324 +0000 UTC m=+252.627296593" Jul 06 15:29:52.387108 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:52.387072 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:29:52.477043 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:52.477009 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jr4kq" event={"ID":"20db46ed-b7f8-4846-993e-578a879360b4","Type":"ContainerStarted","Data":"2ac6409254be0dc7b8f570400c1080d4c104c9506f56458c2c4f44a975e2c48f"} Jul 06 15:29:52.477420 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:52.477090 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jr4kq" event={"ID":"20db46ed-b7f8-4846-993e-578a879360b4","Type":"ContainerStarted","Data":"416145d268ab3c9ad5287a8a387cc3679cc9e6dd1424b695ee9b027a9af12681"} Jul 06 15:29:52.498269 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:52.498222 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jr4kq" podStartSLOduration=252.588687343 podStartE2EDuration="4m13.498207269s" totalImagesPullingTime="909.519926ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:25:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:29:52.49688188 +0000 UTC m=+253.621944174" watchObservedRunningTime="2026-07-06 15:29:52.498207269 +0000 UTC m=+253.623269539" Jul 06 15:29:52.614985 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:52.614953 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:29:52.715161 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:52.715081 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:29:53.015592 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:53.015555 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:29:53.213120 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:53.213085 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:29:53.284986 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:53.284917 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:29:53.738551 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:53.738507 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:29:53.815883 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:53.815845 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:29:54.487419 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:54.487386 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:29:54.587703 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:54.587661 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:29:54.831224 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:29:54.831130 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:30:04.350519 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:30:04.350414 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:30:04.452909 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:30:04.452870 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:30:04.523331 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:30:04.523301 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:30:24.846125 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:30:24.846087 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:30:24.907501 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:30:24.907467 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:30:34.728323 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:30:34.728287 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:30:39.347092 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:30:39.347068 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hxm84_869b9829-1278-4da3-b582-6364317623f7/ovn-acl-logging/0.log" Jul 06 15:30:39.352665 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:30:39.352642 2573 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 15:30:39.362264 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:30:39.362239 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hxm84_869b9829-1278-4da3-b582-6364317623f7/ovn-acl-logging/0.log" Jul 06 15:30:49.831297 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:30:49.831260 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:30:49.846564 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:30:49.846539 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:30:50.685548 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:30:50.685518 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:30:58.802878 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:30:58.802842 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:30:58.905862 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:30:58.905831 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:31:03.377050 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:31:03.376999 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:31:03.451828 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:31:03.451788 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:31:10.764612 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:31:10.764575 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:31:10.856045 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:31:10.856010 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:31:13.892463 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:31:13.892427 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:31:13.968081 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:31:13.968027 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:31:17.733453 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:31:17.733394 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:31:17.833258 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:31:17.833226 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:32:11.880287 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:32:11.880250 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:32:11.978288 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:32:11.978220 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:32:12.354425 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:32:12.354394 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:32:12.467504 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:32:12.467476 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:32:39.736363 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:32:39.736333 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:32:39.892006 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:32:39.891974 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:32:45.242824 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:32:45.242792 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:32:47.513234 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:32:47.513201 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:32:47.611157 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:32:47.611124 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:32:47.790073 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:32:47.789987 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:32:47.880919 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:32:47.880890 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:33:02.677821 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:33:02.677745 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:33:02.794135 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:33:02.794109 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:33:37.798010 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:33:37.797978 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:34:04.289097 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:34:04.289061 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:34:04.434866 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:34:04.434830 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:34:04.591850 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:34:04.591769 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:34:04.738778 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:34:04.738748 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:34:05.433928 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:34:05.433900 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:34:05.534103 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:34:05.534072 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:34:41.828884 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:34:41.828806 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:34:41.987815 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:34:41.987782 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:34:53.328894 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:34:53.328858 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:34:53.592929 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:34:53.592854 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:34:57.934348 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:34:57.934310 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:34:58.142436 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:34:58.142408 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:00.759819 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:00.759785 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:01.110787 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:01.110708 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:01.422837 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:01.422756 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:03.080110 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:03.080080 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:03.382615 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:03.382540 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:03.625640 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:03.625608 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:03.830748 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:03.830702 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:04.253570 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:04.253540 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:11.634540 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:11.634511 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:11.848107 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:11.848071 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:15.208569 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:15.208525 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:15.430980 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:15.430943 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:23.367536 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:23.367506 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:23.547140 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:23.547114 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:27.387220 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:27.387187 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:33.579952 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:33.579920 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:33.818527 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:33.818494 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:34.913028 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:34.912988 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:35.116308 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:35.116283 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:36.044347 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:36.044310 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:37.969013 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:37.968981 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:38.097910 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:38.097879 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:39.370332 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:39.370299 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hxm84_869b9829-1278-4da3-b582-6364317623f7/ovn-acl-logging/0.log" Jul 06 15:35:39.382120 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:39.382101 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hxm84_869b9829-1278-4da3-b582-6364317623f7/ovn-acl-logging/0.log" Jul 06 15:35:42.481089 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:42.481061 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:42.609991 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:42.609961 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:46.164011 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:46.163973 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:46.178682 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:46.178655 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-67f86478cd-bccl2"] Jul 06 15:35:46.181616 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:46.181600 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67f86478cd-bccl2" Jul 06 15:35:46.189418 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:46.189399 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 15:35:46.191198 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:46.191184 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 15:35:46.199653 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:46.199629 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67f86478cd-bccl2"] Jul 06 15:35:46.201674 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:46.201654 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 15:35:46.201774 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:46.201692 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 15:35:46.201830 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:46.201817 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-dr7h6\"" Jul 06 15:35:46.203598 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:46.203582 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 15:35:46.282280 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:46.282246 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbggc\" (UniqueName: \"kubernetes.io/projected/e7e65ddd-973f-44d0-9dc8-bf55d0687e49-kube-api-access-tbggc\") pod \"lws-controller-manager-67f86478cd-bccl2\" (UID: \"e7e65ddd-973f-44d0-9dc8-bf55d0687e49\") " pod="openshift-lws-operator/lws-controller-manager-67f86478cd-bccl2" Jul 06 15:35:46.282471 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:46.282298 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e7e65ddd-973f-44d0-9dc8-bf55d0687e49-manager-config\") pod \"lws-controller-manager-67f86478cd-bccl2\" (UID: \"e7e65ddd-973f-44d0-9dc8-bf55d0687e49\") " pod="openshift-lws-operator/lws-controller-manager-67f86478cd-bccl2" Jul 06 15:35:46.282471 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:46.282393 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7e65ddd-973f-44d0-9dc8-bf55d0687e49-cert\") pod \"lws-controller-manager-67f86478cd-bccl2\" (UID: \"e7e65ddd-973f-44d0-9dc8-bf55d0687e49\") " pod="openshift-lws-operator/lws-controller-manager-67f86478cd-bccl2" Jul 06 15:35:46.282471 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:46.282418 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7e65ddd-973f-44d0-9dc8-bf55d0687e49-metrics-cert\") pod \"lws-controller-manager-67f86478cd-bccl2\" (UID: \"e7e65ddd-973f-44d0-9dc8-bf55d0687e49\") " pod="openshift-lws-operator/lws-controller-manager-67f86478cd-bccl2" Jul 06 15:35:46.367347 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:46.367314 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:46.383472 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:46.383449 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7e65ddd-973f-44d0-9dc8-bf55d0687e49-cert\") pod \"lws-controller-manager-67f86478cd-bccl2\" (UID: \"e7e65ddd-973f-44d0-9dc8-bf55d0687e49\") " pod="openshift-lws-operator/lws-controller-manager-67f86478cd-bccl2" Jul 06 15:35:46.383565 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:46.383476 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7e65ddd-973f-44d0-9dc8-bf55d0687e49-metrics-cert\") pod \"lws-controller-manager-67f86478cd-bccl2\" (UID: \"e7e65ddd-973f-44d0-9dc8-bf55d0687e49\") " pod="openshift-lws-operator/lws-controller-manager-67f86478cd-bccl2" Jul 06 15:35:46.383565 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:46.383508 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbggc\" (UniqueName: \"kubernetes.io/projected/e7e65ddd-973f-44d0-9dc8-bf55d0687e49-kube-api-access-tbggc\") pod \"lws-controller-manager-67f86478cd-bccl2\" (UID: \"e7e65ddd-973f-44d0-9dc8-bf55d0687e49\") " pod="openshift-lws-operator/lws-controller-manager-67f86478cd-bccl2" Jul 06 15:35:46.383565 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:46.383536 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e7e65ddd-973f-44d0-9dc8-bf55d0687e49-manager-config\") pod \"lws-controller-manager-67f86478cd-bccl2\" (UID: \"e7e65ddd-973f-44d0-9dc8-bf55d0687e49\") " pod="openshift-lws-operator/lws-controller-manager-67f86478cd-bccl2" Jul 06 15:35:46.384208 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:46.384189 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e7e65ddd-973f-44d0-9dc8-bf55d0687e49-manager-config\") pod \"lws-controller-manager-67f86478cd-bccl2\" (UID: \"e7e65ddd-973f-44d0-9dc8-bf55d0687e49\") " pod="openshift-lws-operator/lws-controller-manager-67f86478cd-bccl2" Jul 06 15:35:46.385867 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:46.385848 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7e65ddd-973f-44d0-9dc8-bf55d0687e49-metrics-cert\") pod \"lws-controller-manager-67f86478cd-bccl2\" (UID: \"e7e65ddd-973f-44d0-9dc8-bf55d0687e49\") " pod="openshift-lws-operator/lws-controller-manager-67f86478cd-bccl2" Jul 06 15:35:46.385959 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:46.385944 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7e65ddd-973f-44d0-9dc8-bf55d0687e49-cert\") pod \"lws-controller-manager-67f86478cd-bccl2\" (UID: \"e7e65ddd-973f-44d0-9dc8-bf55d0687e49\") " pod="openshift-lws-operator/lws-controller-manager-67f86478cd-bccl2" Jul 06 15:35:46.435361 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:46.435294 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbggc\" (UniqueName: \"kubernetes.io/projected/e7e65ddd-973f-44d0-9dc8-bf55d0687e49-kube-api-access-tbggc\") pod \"lws-controller-manager-67f86478cd-bccl2\" (UID: \"e7e65ddd-973f-44d0-9dc8-bf55d0687e49\") " pod="openshift-lws-operator/lws-controller-manager-67f86478cd-bccl2" Jul 06 15:35:46.490527 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:46.490497 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67f86478cd-bccl2" Jul 06 15:35:46.616313 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:46.616279 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:46.713364 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:46.713289 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67f86478cd-bccl2"] Jul 06 15:35:46.716672 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:35:46.716648 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7e65ddd_973f_44d0_9dc8_bf55d0687e49.slice/crio-8a6f8764ff6b0a4351872146be783138af80563c8b49c647d08357128be31d4a WatchSource:0}: Error finding container 8a6f8764ff6b0a4351872146be783138af80563c8b49c647d08357128be31d4a: Status 404 returned error can't find the container with id 8a6f8764ff6b0a4351872146be783138af80563c8b49c647d08357128be31d4a Jul 06 15:35:46.718651 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:46.718633 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 15:35:47.678359 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:47.678318 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67f86478cd-bccl2" event={"ID":"e7e65ddd-973f-44d0-9dc8-bf55d0687e49","Type":"ContainerStarted","Data":"8a6f8764ff6b0a4351872146be783138af80563c8b49c647d08357128be31d4a"} Jul 06 15:35:49.687273 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:49.687243 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67f86478cd-bccl2" event={"ID":"e7e65ddd-973f-44d0-9dc8-bf55d0687e49","Type":"ContainerStarted","Data":"c50d085ada38d85fc0ff8d53852b9034a75cd3e360e99d7b4ce2f29b02205cb7"} Jul 06 15:35:49.687695 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:49.687425 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-67f86478cd-bccl2" Jul 06 15:35:50.136699 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:50.136667 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:50.357628 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:35:50.357595 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:00.693807 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:00.693780 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-67f86478cd-bccl2" Jul 06 15:36:00.805313 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:00.805261 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-67f86478cd-bccl2" podStartSLOduration=12.084592525 podStartE2EDuration="14.805246189s" totalImagesPullingTime="2.720653664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:35:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:35:49.717133571 +0000 UTC m=+610.842195841" watchObservedRunningTime="2026-07-06 15:36:00.805246189 +0000 UTC m=+621.930308459" Jul 06 15:36:01.612808 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:01.612734 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:04.077261 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:04.077221 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:04.374356 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:04.374254 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:05.474185 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:05.474156 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:05.708959 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:05.708924 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:06.711246 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:06.711212 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:07.344243 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:07.344205 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:07.655259 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:07.655152 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:07.969483 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:07.969387 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:08.269514 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:08.269481 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:08.650988 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:08.650909 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:11.702970 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:11.702938 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:12.678609 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:12.678573 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:13.168398 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:13.168366 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6f9f468797-lzl4k"] Jul 06 15:36:13.171376 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:13.171360 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-lzl4k" Jul 06 15:36:13.174809 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:13.174786 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 15:36:13.175095 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:13.175074 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 15:36:13.175775 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:13.175761 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-k2gpw\"" Jul 06 15:36:13.232795 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:13.232767 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6f9f468797-lzl4k"] Jul 06 15:36:13.314153 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:13.314120 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t766z\" (UniqueName: \"kubernetes.io/projected/b78ae759-8b47-49f2-b8cc-43ea59eb9874-kube-api-access-t766z\") pod \"limitador-operator-controller-manager-6f9f468797-lzl4k\" (UID: \"b78ae759-8b47-49f2-b8cc-43ea59eb9874\") " pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-lzl4k" Jul 06 15:36:13.415166 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:13.415131 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t766z\" (UniqueName: \"kubernetes.io/projected/b78ae759-8b47-49f2-b8cc-43ea59eb9874-kube-api-access-t766z\") pod \"limitador-operator-controller-manager-6f9f468797-lzl4k\" (UID: \"b78ae759-8b47-49f2-b8cc-43ea59eb9874\") " pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-lzl4k" Jul 06 15:36:13.434514 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:13.434456 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t766z\" (UniqueName: \"kubernetes.io/projected/b78ae759-8b47-49f2-b8cc-43ea59eb9874-kube-api-access-t766z\") pod \"limitador-operator-controller-manager-6f9f468797-lzl4k\" (UID: \"b78ae759-8b47-49f2-b8cc-43ea59eb9874\") " pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-lzl4k" Jul 06 15:36:13.481353 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:13.481325 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-lzl4k" Jul 06 15:36:13.626925 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:13.626902 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6f9f468797-lzl4k"] Jul 06 15:36:13.629470 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:36:13.629424 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb78ae759_8b47_49f2_b8cc_43ea59eb9874.slice/crio-ae6a2a7e9ee6b819c269d2093de3b66077582674a188734b6c7106062292324c WatchSource:0}: Error finding container ae6a2a7e9ee6b819c269d2093de3b66077582674a188734b6c7106062292324c: Status 404 returned error can't find the container with id ae6a2a7e9ee6b819c269d2093de3b66077582674a188734b6c7106062292324c Jul 06 15:36:13.768946 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:13.768914 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-lzl4k" event={"ID":"b78ae759-8b47-49f2-b8cc-43ea59eb9874","Type":"ContainerStarted","Data":"ae6a2a7e9ee6b819c269d2093de3b66077582674a188734b6c7106062292324c"} Jul 06 15:36:14.577857 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:14.577826 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:14.798825 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:14.798793 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:15.778054 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:15.778005 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-lzl4k" event={"ID":"b78ae759-8b47-49f2-b8cc-43ea59eb9874","Type":"ContainerStarted","Data":"49c255a03b682cf605960a3514e0023bc73d25016b45154c0da07448b96bcc6e"} Jul 06 15:36:15.778472 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:15.778113 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-lzl4k" Jul 06 15:36:15.816136 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:15.816089 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-lzl4k" podStartSLOduration=1.3969794979999999 podStartE2EDuration="2.816028683s" totalImagesPullingTime="1.419049185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:36:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:36:15.815069899 +0000 UTC m=+636.940132189" watchObservedRunningTime="2026-07-06 15:36:15.816028683 +0000 UTC m=+636.941090952" Jul 06 15:36:18.445190 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:18.445159 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:18.777145 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:18.777113 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:20.187866 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:20.187828 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:20.537904 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:20.537866 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:20.692318 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:20.692292 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:24.060243 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:24.060209 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:24.191517 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:24.191463 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:24.347017 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:24.346928 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:26.783317 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:26.783286 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-lzl4k" Jul 06 15:36:30.075149 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:30.075116 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:31.197073 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:31.197014 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:31.295852 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:31.295808 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:33.763804 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:33.763767 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:33.864113 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:33.864080 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:35.751698 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:35.751658 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:39.197524 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:39.197483 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:39.292084 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:39.292054 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:39.624278 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:39.624242 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:39.908405 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:39.908328 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:43.963234 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:43.963175 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:44.086536 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:44.086507 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:44.196736 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:44.196706 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:50.975007 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:50.974971 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:36:51.079137 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:36:51.079098 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:37:02.602118 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:02.602084 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:37:02.664013 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:02.663979 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:37:03.095592 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:03.095557 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:37:03.220924 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:03.220890 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:37:03.305475 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:03.305443 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:37:03.469794 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:03.469720 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-2f5c8"] Jul 06 15:37:03.472080 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:03.472060 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-69574b596d-2f5c8" Jul 06 15:37:03.474385 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:03.474367 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xjsvl\"" Jul 06 15:37:03.474477 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:03.474385 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 06 15:37:03.481766 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:03.481747 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-2f5c8"] Jul 06 15:37:03.498485 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:03.498467 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-2f5c8"] Jul 06 15:37:03.599132 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:03.599099 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8knk\" (UniqueName: \"kubernetes.io/projected/fa886f1d-bcda-4acb-a1d0-db6c56db92de-kube-api-access-s8knk\") pod \"limitador-limitador-69574b596d-2f5c8\" (UID: \"fa886f1d-bcda-4acb-a1d0-db6c56db92de\") " pod="kuadrant-system/limitador-limitador-69574b596d-2f5c8" Jul 06 15:37:03.599132 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:03.599136 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fa886f1d-bcda-4acb-a1d0-db6c56db92de-config-file\") pod \"limitador-limitador-69574b596d-2f5c8\" (UID: \"fa886f1d-bcda-4acb-a1d0-db6c56db92de\") " pod="kuadrant-system/limitador-limitador-69574b596d-2f5c8" Jul 06 15:37:03.700482 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:03.700451 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8knk\" (UniqueName: \"kubernetes.io/projected/fa886f1d-bcda-4acb-a1d0-db6c56db92de-kube-api-access-s8knk\") pod \"limitador-limitador-69574b596d-2f5c8\" (UID: \"fa886f1d-bcda-4acb-a1d0-db6c56db92de\") " pod="kuadrant-system/limitador-limitador-69574b596d-2f5c8" Jul 06 15:37:03.700482 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:03.700485 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fa886f1d-bcda-4acb-a1d0-db6c56db92de-config-file\") pod \"limitador-limitador-69574b596d-2f5c8\" (UID: \"fa886f1d-bcda-4acb-a1d0-db6c56db92de\") " pod="kuadrant-system/limitador-limitador-69574b596d-2f5c8" Jul 06 15:37:03.701167 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:03.701147 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fa886f1d-bcda-4acb-a1d0-db6c56db92de-config-file\") pod \"limitador-limitador-69574b596d-2f5c8\" (UID: \"fa886f1d-bcda-4acb-a1d0-db6c56db92de\") " pod="kuadrant-system/limitador-limitador-69574b596d-2f5c8" Jul 06 15:37:03.712152 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:03.712128 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8knk\" (UniqueName: \"kubernetes.io/projected/fa886f1d-bcda-4acb-a1d0-db6c56db92de-kube-api-access-s8knk\") pod \"limitador-limitador-69574b596d-2f5c8\" (UID: \"fa886f1d-bcda-4acb-a1d0-db6c56db92de\") " pod="kuadrant-system/limitador-limitador-69574b596d-2f5c8" Jul 06 15:37:03.781844 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:03.781816 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-69574b596d-2f5c8" Jul 06 15:37:03.906901 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:03.906864 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-2f5c8"] Jul 06 15:37:03.910625 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:37:03.910596 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa886f1d_bcda_4acb_a1d0_db6c56db92de.slice/crio-e8f52a23d0656e86386c6dd33c96aacd3dfc9ae4ff584518aad508da4114a0e8 WatchSource:0}: Error finding container e8f52a23d0656e86386c6dd33c96aacd3dfc9ae4ff584518aad508da4114a0e8: Status 404 returned error can't find the container with id e8f52a23d0656e86386c6dd33c96aacd3dfc9ae4ff584518aad508da4114a0e8 Jul 06 15:37:03.947020 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:03.946991 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-69574b596d-2f5c8" event={"ID":"fa886f1d-bcda-4acb-a1d0-db6c56db92de","Type":"ContainerStarted","Data":"e8f52a23d0656e86386c6dd33c96aacd3dfc9ae4ff584518aad508da4114a0e8"} Jul 06 15:37:03.955732 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:03.955712 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b6c89bb85-6k4zz"] Jul 06 15:37:03.958164 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:03.958148 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b6c89bb85-6k4zz" Jul 06 15:37:03.960957 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:03.960938 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pcfq7\"" Jul 06 15:37:03.968456 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:03.968436 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b6c89bb85-6k4zz"] Jul 06 15:37:04.043295 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:04.043216 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:37:04.104120 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:04.104095 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krznp\" (UniqueName: \"kubernetes.io/projected/a0bfc078-a1bb-45dc-8619-1d961ff256f5-kube-api-access-krznp\") pod \"authorino-b6c89bb85-6k4zz\" (UID: \"a0bfc078-a1bb-45dc-8619-1d961ff256f5\") " pod="kuadrant-system/authorino-b6c89bb85-6k4zz" Jul 06 15:37:04.173104 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:04.173074 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:37:04.205414 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:04.205383 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krznp\" (UniqueName: \"kubernetes.io/projected/a0bfc078-a1bb-45dc-8619-1d961ff256f5-kube-api-access-krznp\") pod \"authorino-b6c89bb85-6k4zz\" (UID: \"a0bfc078-a1bb-45dc-8619-1d961ff256f5\") " pod="kuadrant-system/authorino-b6c89bb85-6k4zz" Jul 06 15:37:04.215138 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:04.215116 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krznp\" (UniqueName: \"kubernetes.io/projected/a0bfc078-a1bb-45dc-8619-1d961ff256f5-kube-api-access-krznp\") pod \"authorino-b6c89bb85-6k4zz\" (UID: \"a0bfc078-a1bb-45dc-8619-1d961ff256f5\") " pod="kuadrant-system/authorino-b6c89bb85-6k4zz" Jul 06 15:37:04.267216 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:04.267189 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b6c89bb85-6k4zz" Jul 06 15:37:04.388637 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:04.388606 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b6c89bb85-6k4zz"] Jul 06 15:37:04.392615 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:37:04.392589 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0bfc078_a1bb_45dc_8619_1d961ff256f5.slice/crio-8b79cf528dccf76ddfc589e2875520fc6b24aa5088f73d43b4e7ff902851fc74 WatchSource:0}: Error finding container 8b79cf528dccf76ddfc589e2875520fc6b24aa5088f73d43b4e7ff902851fc74: Status 404 returned error can't find the container with id 8b79cf528dccf76ddfc589e2875520fc6b24aa5088f73d43b4e7ff902851fc74 Jul 06 15:37:04.952591 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:04.952554 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b6c89bb85-6k4zz" event={"ID":"a0bfc078-a1bb-45dc-8619-1d961ff256f5","Type":"ContainerStarted","Data":"8b79cf528dccf76ddfc589e2875520fc6b24aa5088f73d43b4e7ff902851fc74"} Jul 06 15:37:06.991682 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:06.991647 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b6c89bb85-6k4zz"] Jul 06 15:37:08.971147 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:08.971105 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-69574b596d-2f5c8" event={"ID":"fa886f1d-bcda-4acb-a1d0-db6c56db92de","Type":"ContainerStarted","Data":"b0f9fc5f1b1b87a4d9dcd083e5548bf04a7617bb90c871ab3d406342a281900f"} Jul 06 15:37:08.971561 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:08.971237 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-69574b596d-2f5c8" Jul 06 15:37:08.972554 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:08.972532 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b6c89bb85-6k4zz" event={"ID":"a0bfc078-a1bb-45dc-8619-1d961ff256f5","Type":"ContainerStarted","Data":"35e99636357301e89fdc818c5fb97a6e372d4b1eda3d0c993374c29c3790e969"} Jul 06 15:37:08.972705 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:08.972573 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-b6c89bb85-6k4zz" podUID="a0bfc078-a1bb-45dc-8619-1d961ff256f5" containerName="authorino" containerID="cri-o://35e99636357301e89fdc818c5fb97a6e372d4b1eda3d0c993374c29c3790e969" gracePeriod=30 Jul 06 15:37:08.992304 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:08.992264 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-69574b596d-2f5c8" podStartSLOduration=1.125663838 podStartE2EDuration="5.992249103s" totalImagesPullingTime="4.866585265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:37:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:37:08.991101054 +0000 UTC m=+690.116163341" watchObservedRunningTime="2026-07-06 15:37:08.992249103 +0000 UTC m=+690.117311406" Jul 06 15:37:09.013277 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:09.013231 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b6c89bb85-6k4zz" podStartSLOduration=1.627659696 podStartE2EDuration="6.013218009s" totalImagesPullingTime="4.385558313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:37:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:37:09.012946928 +0000 UTC m=+690.138009215" watchObservedRunningTime="2026-07-06 15:37:09.013218009 +0000 UTC m=+690.138280280" Jul 06 15:37:09.200509 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:09.200486 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b6c89bb85-6k4zz" Jul 06 15:37:09.352066 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:09.351957 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krznp\" (UniqueName: \"kubernetes.io/projected/a0bfc078-a1bb-45dc-8619-1d961ff256f5-kube-api-access-krznp\") pod \"a0bfc078-a1bb-45dc-8619-1d961ff256f5\" (UID: \"a0bfc078-a1bb-45dc-8619-1d961ff256f5\") " Jul 06 15:37:09.354065 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:09.354043 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0bfc078-a1bb-45dc-8619-1d961ff256f5-kube-api-access-krznp" (OuterVolumeSpecName: "kube-api-access-krznp") pod "a0bfc078-a1bb-45dc-8619-1d961ff256f5" (UID: "a0bfc078-a1bb-45dc-8619-1d961ff256f5"). InnerVolumeSpecName "kube-api-access-krznp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:37:09.452782 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:09.452740 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krznp\" (UniqueName: \"kubernetes.io/projected/a0bfc078-a1bb-45dc-8619-1d961ff256f5-kube-api-access-krznp\") on node \"ip-10-0-143-129.ec2.internal\" DevicePath \"\"" Jul 06 15:37:09.977015 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:09.976977 2573 generic.go:356] "Generic (PLEG): container finished" podID="a0bfc078-a1bb-45dc-8619-1d961ff256f5" containerID="35e99636357301e89fdc818c5fb97a6e372d4b1eda3d0c993374c29c3790e969" exitCode=0 Jul 06 15:37:09.977015 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:09.977020 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b6c89bb85-6k4zz" Jul 06 15:37:09.977513 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:09.977075 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b6c89bb85-6k4zz" event={"ID":"a0bfc078-a1bb-45dc-8619-1d961ff256f5","Type":"ContainerDied","Data":"35e99636357301e89fdc818c5fb97a6e372d4b1eda3d0c993374c29c3790e969"} Jul 06 15:37:09.977513 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:09.977126 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b6c89bb85-6k4zz" event={"ID":"a0bfc078-a1bb-45dc-8619-1d961ff256f5","Type":"ContainerDied","Data":"8b79cf528dccf76ddfc589e2875520fc6b24aa5088f73d43b4e7ff902851fc74"} Jul 06 15:37:09.977513 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:09.977142 2573 scope.go:117] "RemoveContainer" containerID="35e99636357301e89fdc818c5fb97a6e372d4b1eda3d0c993374c29c3790e969" Jul 06 15:37:09.984807 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:09.984788 2573 scope.go:117] "RemoveContainer" containerID="35e99636357301e89fdc818c5fb97a6e372d4b1eda3d0c993374c29c3790e969" Jul 06 15:37:09.985043 ip-10-0-143-129 kubenswrapper[2573]: E0706 15:37:09.985017 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35e99636357301e89fdc818c5fb97a6e372d4b1eda3d0c993374c29c3790e969\": container with ID starting with 35e99636357301e89fdc818c5fb97a6e372d4b1eda3d0c993374c29c3790e969 not found: ID does not exist" containerID="35e99636357301e89fdc818c5fb97a6e372d4b1eda3d0c993374c29c3790e969" Jul 06 15:37:09.985108 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:09.985057 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35e99636357301e89fdc818c5fb97a6e372d4b1eda3d0c993374c29c3790e969"} err="failed to get container status \"35e99636357301e89fdc818c5fb97a6e372d4b1eda3d0c993374c29c3790e969\": rpc error: code = NotFound desc = could not find container \"35e99636357301e89fdc818c5fb97a6e372d4b1eda3d0c993374c29c3790e969\": container with ID starting with 35e99636357301e89fdc818c5fb97a6e372d4b1eda3d0c993374c29c3790e969 not found: ID does not exist" Jul 06 15:37:09.997332 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:09.997289 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b6c89bb85-6k4zz"] Jul 06 15:37:09.998859 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:09.998841 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b6c89bb85-6k4zz"] Jul 06 15:37:11.496299 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:11.496270 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0bfc078-a1bb-45dc-8619-1d961ff256f5" path="/var/lib/kubelet/pods/a0bfc078-a1bb-45dc-8619-1d961ff256f5/volumes" Jul 06 15:37:19.978764 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:19.978731 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-69574b596d-2f5c8" Jul 06 15:37:26.173990 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:26.173957 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:37:26.406590 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:26.406560 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:37:30.893943 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:30.893913 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c77957575-q2l8k"] Jul 06 15:37:30.894337 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:30.894254 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0bfc078-a1bb-45dc-8619-1d961ff256f5" containerName="authorino" Jul 06 15:37:30.894337 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:30.894266 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0bfc078-a1bb-45dc-8619-1d961ff256f5" containerName="authorino" Jul 06 15:37:30.894337 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:30.894312 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0bfc078-a1bb-45dc-8619-1d961ff256f5" containerName="authorino" Jul 06 15:37:30.896830 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:30.896811 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c77957575-q2l8k" Jul 06 15:37:30.900254 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:30.900232 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pcfq7\"" Jul 06 15:37:30.900349 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:30.900239 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 06 15:37:30.917440 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:30.917419 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c77957575-q2l8k"] Jul 06 15:37:30.920346 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:30.920321 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzdt6\" (UniqueName: \"kubernetes.io/projected/043cc309-a0b5-477b-824d-7e2835017066-kube-api-access-nzdt6\") pod \"authorino-7c77957575-q2l8k\" (UID: \"043cc309-a0b5-477b-824d-7e2835017066\") " pod="kuadrant-system/authorino-7c77957575-q2l8k" Jul 06 15:37:30.920449 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:30.920430 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/043cc309-a0b5-477b-824d-7e2835017066-tls-cert\") pod \"authorino-7c77957575-q2l8k\" (UID: \"043cc309-a0b5-477b-824d-7e2835017066\") " pod="kuadrant-system/authorino-7c77957575-q2l8k" Jul 06 15:37:31.021327 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:31.021290 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzdt6\" (UniqueName: \"kubernetes.io/projected/043cc309-a0b5-477b-824d-7e2835017066-kube-api-access-nzdt6\") pod \"authorino-7c77957575-q2l8k\" (UID: \"043cc309-a0b5-477b-824d-7e2835017066\") " pod="kuadrant-system/authorino-7c77957575-q2l8k" Jul 06 15:37:31.021510 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:31.021454 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/043cc309-a0b5-477b-824d-7e2835017066-tls-cert\") pod \"authorino-7c77957575-q2l8k\" (UID: \"043cc309-a0b5-477b-824d-7e2835017066\") " pod="kuadrant-system/authorino-7c77957575-q2l8k" Jul 06 15:37:31.023810 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:31.023773 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/043cc309-a0b5-477b-824d-7e2835017066-tls-cert\") pod \"authorino-7c77957575-q2l8k\" (UID: \"043cc309-a0b5-477b-824d-7e2835017066\") " pod="kuadrant-system/authorino-7c77957575-q2l8k" Jul 06 15:37:31.031421 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:31.031399 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzdt6\" (UniqueName: \"kubernetes.io/projected/043cc309-a0b5-477b-824d-7e2835017066-kube-api-access-nzdt6\") pod \"authorino-7c77957575-q2l8k\" (UID: \"043cc309-a0b5-477b-824d-7e2835017066\") " pod="kuadrant-system/authorino-7c77957575-q2l8k" Jul 06 15:37:31.205139 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:31.205001 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c77957575-q2l8k" Jul 06 15:37:31.335440 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:31.335407 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c77957575-q2l8k"] Jul 06 15:37:31.339524 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:37:31.339499 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod043cc309_a0b5_477b_824d_7e2835017066.slice/crio-74e9694881fb5fe009433a8cd2afb9c9286f5ef7b0b5fe193c34d8e8743676c7 WatchSource:0}: Error finding container 74e9694881fb5fe009433a8cd2afb9c9286f5ef7b0b5fe193c34d8e8743676c7: Status 404 returned error can't find the container with id 74e9694881fb5fe009433a8cd2afb9c9286f5ef7b0b5fe193c34d8e8743676c7 Jul 06 15:37:32.065247 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:32.065213 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c77957575-q2l8k" event={"ID":"043cc309-a0b5-477b-824d-7e2835017066","Type":"ContainerStarted","Data":"8e46a9bed3fab90581175bc53dcff1ee38eec7e5921046fd0101f32092bc751e"} Jul 06 15:37:32.065632 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:32.065257 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c77957575-q2l8k" event={"ID":"043cc309-a0b5-477b-824d-7e2835017066","Type":"ContainerStarted","Data":"74e9694881fb5fe009433a8cd2afb9c9286f5ef7b0b5fe193c34d8e8743676c7"} Jul 06 15:37:32.093249 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:32.093200 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7c77957575-q2l8k" podStartSLOduration=1.755372796 podStartE2EDuration="2.093185851s" totalImagesPullingTime="337.813055ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:37:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:37:32.090539756 +0000 UTC m=+713.215602026" watchObservedRunningTime="2026-07-06 15:37:32.093185851 +0000 UTC m=+713.218248121" Jul 06 15:37:37.983459 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:37:37.983422 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:38:10.215963 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:38:10.215929 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:38:11.729654 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:38:11.729609 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:38:21.974426 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:38:21.974388 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:38:22.049632 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:38:22.049596 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:38:24.569683 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:38:24.569652 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:38:24.678197 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:38:24.678165 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:38:30.090076 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:38:30.090014 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:38:30.191069 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:38:30.191020 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:39:33.340988 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:39:33.340956 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:39:33.508646 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:39:33.508613 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:39:45.079594 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:39:45.079559 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:39:45.178822 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:39:45.178781 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:39:52.852781 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:39:52.852751 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:39:52.952451 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:39:52.952421 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:40:18.195125 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:18.195102 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-q2l8k_043cc309-a0b5-477b-824d-7e2835017066/authorino/0.log" Jul 06 15:40:18.332218 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:18.332188 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-2f5c8_fa886f1d-bcda-4acb-a1d0-db6c56db92de/limitador/0.log" Jul 06 15:40:18.361586 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:18.361562 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-lzl4k_b78ae759-8b47-49f2-b8cc-43ea59eb9874/manager/0.log" Jul 06 15:40:23.078311 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:23.078280 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:40:23.251012 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:23.250979 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:40:23.335268 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:23.335185 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:40:26.446775 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:26.446745 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-slsrs_914b7462-be30-4d19-99ba-80ee135acec7/global-pull-secret-syncer/0.log" Jul 06 15:40:26.520358 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:26.520327 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" Jul 06 15:40:26.729888 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:26.729819 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-129.ec2.internal_7cbb15a3b59006910713defe15de5c17/haproxy/0.log" Jul 06 15:40:30.658364 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:30.658336 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-q2l8k_043cc309-a0b5-477b-824d-7e2835017066/authorino/0.log" Jul 06 15:40:31.081551 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:31.081528 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-2f5c8_fa886f1d-bcda-4acb-a1d0-db6c56db92de/limitador/0.log" Jul 06 15:40:31.167143 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:31.167071 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-lzl4k_b78ae759-8b47-49f2-b8cc-43ea59eb9874/manager/0.log" Jul 06 15:40:31.348348 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:31.348271 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:40:31.473908 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:31.473875 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:40:31.620560 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:31.620496 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b97pn_de1dd724-0faf-491e-bd1d-bf08496ea967/konnectivity-agent/0.log" limit=1024 Jul 06 15:40:33.611023 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:33.610942 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j7frt_8349bcaa-2d78-4ba9-9f86-2943587e50c9/node-exporter/0.log" Jul 06 15:40:33.658117 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:33.658088 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j7frt_8349bcaa-2d78-4ba9-9f86-2943587e50c9/kube-rbac-proxy/0.log" Jul 06 15:40:33.695525 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:33.695505 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j7frt_8349bcaa-2d78-4ba9-9f86-2943587e50c9/init-textfile/0.log" Jul 06 15:40:34.116705 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:34.116675 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5694cc3b-4f6c-46da-82a2-e2e688e442fc/prometheus/0.log" Jul 06 15:40:34.183267 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:34.183244 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5694cc3b-4f6c-46da-82a2-e2e688e442fc/config-reloader/0.log" Jul 06 15:40:34.244818 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:34.244791 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5694cc3b-4f6c-46da-82a2-e2e688e442fc/thanos-sidecar/0.log" Jul 06 15:40:34.301980 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:34.301955 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5694cc3b-4f6c-46da-82a2-e2e688e442fc/kube-rbac-proxy-web/0.log" Jul 06 15:40:34.350264 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:34.350243 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5694cc3b-4f6c-46da-82a2-e2e688e442fc/kube-rbac-proxy/0.log" Jul 06 15:40:34.409613 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:34.409556 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5694cc3b-4f6c-46da-82a2-e2e688e442fc/kube-rbac-proxy-thanos/0.log" Jul 06 15:40:34.468005 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:34.467979 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5694cc3b-4f6c-46da-82a2-e2e688e442fc/init-config-reloader/0.log" Jul 06 15:40:35.883550 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:35.883519 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p2c9j/perf-node-gather-daemonset-gsfg6"] Jul 06 15:40:35.886655 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:35.886636 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-gsfg6" Jul 06 15:40:35.890776 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:35.890757 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p2c9j\"/\"openshift-service-ca.crt\"" Jul 06 15:40:35.890924 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:35.890764 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p2c9j\"/\"default-dockercfg-hfqhq\"" Jul 06 15:40:35.891388 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:35.891375 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p2c9j\"/\"kube-root-ca.crt\"" Jul 06 15:40:35.902944 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:35.902920 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p2c9j/perf-node-gather-daemonset-gsfg6"] Jul 06 15:40:35.990242 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:35.990215 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a440119c-38cb-4fe4-811b-5a5d7524b652-lib-modules\") pod \"perf-node-gather-daemonset-gsfg6\" (UID: \"a440119c-38cb-4fe4-811b-5a5d7524b652\") " pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-gsfg6" Jul 06 15:40:35.990416 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:35.990249 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk8hn\" (UniqueName: \"kubernetes.io/projected/a440119c-38cb-4fe4-811b-5a5d7524b652-kube-api-access-tk8hn\") pod \"perf-node-gather-daemonset-gsfg6\" (UID: \"a440119c-38cb-4fe4-811b-5a5d7524b652\") " pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-gsfg6" Jul 06 15:40:35.990416 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:35.990317 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a440119c-38cb-4fe4-811b-5a5d7524b652-podres\") pod \"perf-node-gather-daemonset-gsfg6\" (UID: \"a440119c-38cb-4fe4-811b-5a5d7524b652\") " pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-gsfg6" Jul 06 15:40:35.990416 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:35.990367 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a440119c-38cb-4fe4-811b-5a5d7524b652-proc\") pod \"perf-node-gather-daemonset-gsfg6\" (UID: \"a440119c-38cb-4fe4-811b-5a5d7524b652\") " pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-gsfg6" Jul 06 15:40:35.990416 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:35.990407 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a440119c-38cb-4fe4-811b-5a5d7524b652-sys\") pod \"perf-node-gather-daemonset-gsfg6\" (UID: \"a440119c-38cb-4fe4-811b-5a5d7524b652\") " pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-gsfg6" Jul 06 15:40:36.091609 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:36.091576 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a440119c-38cb-4fe4-811b-5a5d7524b652-lib-modules\") pod \"perf-node-gather-daemonset-gsfg6\" (UID: \"a440119c-38cb-4fe4-811b-5a5d7524b652\") " pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-gsfg6" Jul 06 15:40:36.091609 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:36.091610 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk8hn\" (UniqueName: \"kubernetes.io/projected/a440119c-38cb-4fe4-811b-5a5d7524b652-kube-api-access-tk8hn\") pod \"perf-node-gather-daemonset-gsfg6\" (UID: \"a440119c-38cb-4fe4-811b-5a5d7524b652\") " pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-gsfg6" Jul 06 15:40:36.091827 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:36.091639 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a440119c-38cb-4fe4-811b-5a5d7524b652-podres\") pod \"perf-node-gather-daemonset-gsfg6\" (UID: \"a440119c-38cb-4fe4-811b-5a5d7524b652\") " pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-gsfg6" Jul 06 15:40:36.091827 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:36.091677 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a440119c-38cb-4fe4-811b-5a5d7524b652-proc\") pod \"perf-node-gather-daemonset-gsfg6\" (UID: \"a440119c-38cb-4fe4-811b-5a5d7524b652\") " pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-gsfg6" Jul 06 15:40:36.091827 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:36.091697 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a440119c-38cb-4fe4-811b-5a5d7524b652-sys\") pod \"perf-node-gather-daemonset-gsfg6\" (UID: \"a440119c-38cb-4fe4-811b-5a5d7524b652\") " pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-gsfg6" Jul 06 15:40:36.091827 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:36.091769 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a440119c-38cb-4fe4-811b-5a5d7524b652-lib-modules\") pod \"perf-node-gather-daemonset-gsfg6\" (UID: \"a440119c-38cb-4fe4-811b-5a5d7524b652\") " pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-gsfg6" Jul 06 15:40:36.091827 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:36.091789 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a440119c-38cb-4fe4-811b-5a5d7524b652-sys\") pod \"perf-node-gather-daemonset-gsfg6\" (UID: \"a440119c-38cb-4fe4-811b-5a5d7524b652\") " pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-gsfg6" Jul 06 15:40:36.091827 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:36.091802 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a440119c-38cb-4fe4-811b-5a5d7524b652-proc\") pod \"perf-node-gather-daemonset-gsfg6\" (UID: \"a440119c-38cb-4fe4-811b-5a5d7524b652\") " pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-gsfg6" Jul 06 15:40:36.092101 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:36.091841 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a440119c-38cb-4fe4-811b-5a5d7524b652-podres\") pod \"perf-node-gather-daemonset-gsfg6\" (UID: \"a440119c-38cb-4fe4-811b-5a5d7524b652\") " pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-gsfg6" Jul 06 15:40:36.103572 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:36.103538 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk8hn\" (UniqueName: \"kubernetes.io/projected/a440119c-38cb-4fe4-811b-5a5d7524b652-kube-api-access-tk8hn\") pod \"perf-node-gather-daemonset-gsfg6\" (UID: \"a440119c-38cb-4fe4-811b-5a5d7524b652\") " pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-gsfg6" Jul 06 15:40:36.171751 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:36.171675 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-pchvh_97bfc3e0-3330-40eb-b2f0-6eddd1adbbe9/networking-console-plugin/0.log" Jul 06 15:40:36.196439 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:36.196415 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-gsfg6" Jul 06 15:40:36.328171 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:36.328142 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p2c9j/perf-node-gather-daemonset-gsfg6"] Jul 06 15:40:36.331176 ip-10-0-143-129 kubenswrapper[2573]: W0706 15:40:36.331148 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda440119c_38cb_4fe4_811b_5a5d7524b652.slice/crio-ebf0d22e24665f09ef09862751b0f8c7b1e7ae00ed062978e2b176ed428927ec WatchSource:0}: Error finding container ebf0d22e24665f09ef09862751b0f8c7b1e7ae00ed062978e2b176ed428927ec: Status 404 returned error can't find the container with id ebf0d22e24665f09ef09862751b0f8c7b1e7ae00ed062978e2b176ed428927ec Jul 06 15:40:36.729616 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:36.729586 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-gsfg6" event={"ID":"a440119c-38cb-4fe4-811b-5a5d7524b652","Type":"ContainerStarted","Data":"3572ffb1a20df2a0dde178d023d2418a529b4d09fd7be86aa2a5079c1e21c91a"} Jul 06 15:40:36.729780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:36.729634 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-gsfg6" event={"ID":"a440119c-38cb-4fe4-811b-5a5d7524b652","Type":"ContainerStarted","Data":"ebf0d22e24665f09ef09862751b0f8c7b1e7ae00ed062978e2b176ed428927ec"} Jul 06 15:40:36.729780 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:36.729665 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-gsfg6" Jul 06 15:40:36.749646 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:36.749602 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-gsfg6" podStartSLOduration=1.749584965 podStartE2EDuration="1.749584965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:40:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:40:36.748585036 +0000 UTC m=+897.873647308" watchObservedRunningTime="2026-07-06 15:40:36.749584965 +0000 UTC m=+897.874647234" Jul 06 15:40:39.171801 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:39.171773 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8fw8f_fa5d3c60-7684-45d6-aaf2-e5d6cfea0123/dns/0.log" Jul 06 15:40:39.203361 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:39.203333 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8fw8f_fa5d3c60-7684-45d6-aaf2-e5d6cfea0123/kube-rbac-proxy/0.log" Jul 06 15:40:39.392816 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:39.392790 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hxm84_869b9829-1278-4da3-b582-6364317623f7/ovn-acl-logging/0.log" Jul 06 15:40:39.402947 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:39.402926 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hxm84_869b9829-1278-4da3-b582-6364317623f7/ovn-acl-logging/0.log" Jul 06 15:40:39.453670 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:39.453599 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s6nb2_54ff6682-60fa-41c6-a133-1dd32f237779/dns-node-resolver/0.log" Jul 06 15:40:40.040269 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:40.040243 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-77475c64fc-knd7h_e2eadc45-cd82-4d24-94a3-4f6ee4383779/registry/0.log" Jul 06 15:40:40.069049 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:40.069008 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wrhr9_b5f3d5ad-ce7e-467c-ab15-30f58cbda56c/node-ca/0.log" Jul 06 15:40:41.968894 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:41.968863 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ktjtd_8e774c49-07c6-48f4-9720-d6ebb9734b9a/serve-healthcheck-canary/0.log" Jul 06 15:40:42.741979 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:42.741949 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-gsfg6" Jul 06 15:40:42.839207 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:42.839184 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w6hqj_537918f5-ba69-4fb8-99ce-dc171dc79a4a/kube-rbac-proxy/0.log" Jul 06 15:40:42.871532 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:42.871515 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w6hqj_537918f5-ba69-4fb8-99ce-dc171dc79a4a/exporter/0.log" Jul 06 15:40:42.917787 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:42.917768 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w6hqj_537918f5-ba69-4fb8-99ce-dc171dc79a4a/extractor/0.log" Jul 06 15:40:46.299283 ip-10-0-143-129 kubenswrapper[2573]: I0706 15:40:46.299253 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-67f86478cd-bccl2_e7e65ddd-973f-44d0-9dc8-bf55d0687e49/manager/0.log"