Jul 30 16:58:45.054216 ip-10-0-136-120 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 30 16:58:45.054398 ip-10-0-136-120 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 30 16:58:45.054526 ip-10-0-136-120 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 30 16:58:45.055077 ip-10-0-136-120 systemd[1]: Failed to start Kubernetes Kubelet. Jul 30 16:58:55.295036 ip-10-0-136-120 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 30 16:58:55.295052 ip-10-0-136-120 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot cb599d0b7ed34db5b415c22f1123f686 -- Jul 30 17:00:53.740895 ip-10-0-136-120 systemd[1]: Starting Kubernetes Kubelet... Jul 30 17:00:54.170953 ip-10-0-136-120 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 30 17:00:54.170953 ip-10-0-136-120 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 30 17:00:54.170953 ip-10-0-136-120 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 30 17:00:54.170953 ip-10-0-136-120 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 30 17:00:54.170953 ip-10-0-136-120 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 30 17:00:54.172580 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.172433 2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 30 17:00:54.177271 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177245 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 17:00:54.177271 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177267 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 17:00:54.177271 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177271 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 17:00:54.177271 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177275 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 17:00:54.177399 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177278 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 17:00:54.177399 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177282 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 17:00:54.177399 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177284 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 17:00:54.177399 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177287 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 17:00:54.177399 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177290 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 17:00:54.177399 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177292 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 17:00:54.177399 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177296 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 17:00:54.177399 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177299 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 17:00:54.177399 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177301 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 17:00:54.177399 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177304 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 30 17:00:54.177399 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177306 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 17:00:54.177399 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177309 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 17:00:54.177399 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177312 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 17:00:54.177399 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177314 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 17:00:54.177399 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177317 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 17:00:54.177399 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177325 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 17:00:54.177399 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177328 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 17:00:54.177399 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177331 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 17:00:54.177399 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177333 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 17:00:54.177399 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177336 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 17:00:54.177932 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177338 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 17:00:54.177932 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177341 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 17:00:54.177932 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177343 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 17:00:54.177932 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177346 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 17:00:54.177932 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177349 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 17:00:54.177932 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177351 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 17:00:54.177932 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177354 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 17:00:54.177932 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177356 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 17:00:54.177932 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177359 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 17:00:54.177932 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177361 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 17:00:54.177932 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177364 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 17:00:54.177932 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177367 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 17:00:54.177932 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177369 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 17:00:54.177932 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177373 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 17:00:54.177932 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177375 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 17:00:54.177932 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177378 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 17:00:54.177932 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177382 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 17:00:54.177932 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177384 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 17:00:54.177932 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177388 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 17:00:54.178395 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177390 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 17:00:54.178395 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177393 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 17:00:54.178395 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177395 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 17:00:54.178395 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177398 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 17:00:54.178395 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177400 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 17:00:54.178395 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177403 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 17:00:54.178395 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177406 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 17:00:54.178395 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177409 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 17:00:54.178395 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177411 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 17:00:54.178395 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177415 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 17:00:54.178395 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177417 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 17:00:54.178395 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177420 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 17:00:54.178395 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177423 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 17:00:54.178395 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177429 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 17:00:54.178395 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177433 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 17:00:54.178395 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177437 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 17:00:54.178395 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177440 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 17:00:54.178395 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177443 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 17:00:54.178395 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177446 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 17:00:54.178395 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177449 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 17:00:54.178898 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177452 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 17:00:54.178898 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177454 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 17:00:54.178898 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177457 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 17:00:54.178898 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177459 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 17:00:54.178898 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177462 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 17:00:54.178898 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177464 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 17:00:54.178898 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177469 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 17:00:54.178898 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177473 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 17:00:54.178898 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177476 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 17:00:54.178898 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177479 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 17:00:54.178898 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177482 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 17:00:54.178898 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177485 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 17:00:54.178898 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177487 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 17:00:54.178898 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177490 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 17:00:54.178898 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177492 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 17:00:54.178898 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177495 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 17:00:54.178898 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177498 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 17:00:54.178898 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177501 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 17:00:54.178898 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177504 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 17:00:54.178898 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177507 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 17:00:54.179388 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177509 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 17:00:54.179388 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177513 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 17:00:54.179388 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177517 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 17:00:54.179388 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177520 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 17:00:54.179388 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177522 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 17:00:54.179388 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177525 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 17:00:54.179388 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177527 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 17:00:54.179388 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177530 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 17:00:54.179388 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177533 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 17:00:54.179388 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177535 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 17:00:54.179388 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177538 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 17:00:54.179388 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177540 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 17:00:54.179388 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177542 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 17:00:54.179388 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177561 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 17:00:54.179388 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177566 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 17:00:54.179388 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.177569 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 17:00:54.179388 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178320 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 17:00:54.179388 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178326 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 17:00:54.179388 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178331 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 17:00:54.179388 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178334 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 17:00:54.179916 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178337 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 17:00:54.179916 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178341 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 17:00:54.179916 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178344 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 17:00:54.179916 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178347 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 17:00:54.179916 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178350 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 17:00:54.179916 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178352 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 17:00:54.179916 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178355 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 17:00:54.179916 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178358 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 17:00:54.179916 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178360 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 17:00:54.179916 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178363 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 17:00:54.179916 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178365 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 17:00:54.179916 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178368 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 17:00:54.179916 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178370 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 17:00:54.179916 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178375 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 17:00:54.179916 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178379 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 17:00:54.179916 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178383 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 17:00:54.179916 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178386 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 17:00:54.179916 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178389 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 17:00:54.179916 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178392 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 17:00:54.180381 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178394 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 17:00:54.180381 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178397 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 17:00:54.180381 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178400 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 17:00:54.180381 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178403 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 17:00:54.180381 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178406 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 17:00:54.180381 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178409 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 17:00:54.180381 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178411 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 17:00:54.180381 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178414 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 17:00:54.180381 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178417 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 17:00:54.180381 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178419 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 17:00:54.180381 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178421 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 17:00:54.180381 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178424 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 17:00:54.180381 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178427 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 17:00:54.180381 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178430 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 17:00:54.180381 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178433 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 17:00:54.180381 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178437 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 17:00:54.180381 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178439 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 17:00:54.180381 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178442 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 17:00:54.180381 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178445 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 17:00:54.180381 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178447 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 17:00:54.180897 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178449 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 17:00:54.180897 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178452 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 17:00:54.180897 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178454 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 17:00:54.180897 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178457 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 17:00:54.180897 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178460 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 17:00:54.180897 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178463 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 17:00:54.180897 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178465 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 17:00:54.180897 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178468 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 17:00:54.180897 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178471 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 17:00:54.180897 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178474 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 30 17:00:54.180897 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178477 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 17:00:54.180897 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178479 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 17:00:54.180897 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178482 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 17:00:54.180897 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178484 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 17:00:54.180897 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178487 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 17:00:54.180897 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178489 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 17:00:54.180897 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178491 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 17:00:54.180897 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178494 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 17:00:54.180897 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178497 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 17:00:54.180897 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178499 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 17:00:54.181396 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178502 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 17:00:54.181396 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178505 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 17:00:54.181396 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178508 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 17:00:54.181396 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178511 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 17:00:54.181396 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178513 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 17:00:54.181396 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178516 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 17:00:54.181396 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178520 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 17:00:54.181396 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178524 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 17:00:54.181396 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178527 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 17:00:54.181396 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178530 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 17:00:54.181396 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178532 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 17:00:54.181396 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178535 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 17:00:54.181396 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178540 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 17:00:54.181396 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178543 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 17:00:54.181396 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178561 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 17:00:54.181396 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178564 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 17:00:54.181396 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178567 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 17:00:54.181396 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178570 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 17:00:54.181396 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178572 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 17:00:54.181918 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178575 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 17:00:54.181918 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178578 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 17:00:54.181918 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178581 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 17:00:54.181918 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178584 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 17:00:54.181918 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178587 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 17:00:54.181918 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178589 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 17:00:54.181918 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178592 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 17:00:54.181918 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178594 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 17:00:54.181918 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178597 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 17:00:54.181918 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178600 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 17:00:54.181918 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178602 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 17:00:54.181918 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178605 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 17:00:54.181918 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178608 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 17:00:54.181918 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178611 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 17:00:54.181918 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178613 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 17:00:54.181918 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178616 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 17:00:54.181918 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.178618 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 17:00:54.181918 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179032 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 17:00:54.182354 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179038 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 17:00:54.182354 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179042 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 17:00:54.182354 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179045 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 17:00:54.182354 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179048 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 17:00:54.182354 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179051 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 17:00:54.182354 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179054 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 17:00:54.182354 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179057 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 17:00:54.182354 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179059 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 17:00:54.182354 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179062 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 17:00:54.182354 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179064 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 17:00:54.182354 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179067 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 17:00:54.182354 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179070 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 17:00:54.182354 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179072 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 17:00:54.182354 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179075 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 17:00:54.182354 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179078 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 17:00:54.182354 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179081 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 17:00:54.182354 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179084 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 17:00:54.182354 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179087 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 17:00:54.182354 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179089 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 17:00:54.182822 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179091 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 17:00:54.182822 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179094 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 17:00:54.182822 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179097 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 17:00:54.182822 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179099 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 17:00:54.182822 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179102 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 17:00:54.182822 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179104 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 17:00:54.182822 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179107 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 17:00:54.182822 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179110 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 17:00:54.182822 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179113 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 17:00:54.182822 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179116 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 17:00:54.182822 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179118 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 17:00:54.182822 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179121 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 17:00:54.182822 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179123 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 17:00:54.182822 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179126 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 17:00:54.182822 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179129 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 17:00:54.182822 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179131 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 17:00:54.182822 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179134 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 17:00:54.182822 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179137 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 17:00:54.182822 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179139 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 17:00:54.182822 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179142 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 17:00:54.182822 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179144 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 17:00:54.183361 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179147 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 17:00:54.183361 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179149 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 17:00:54.183361 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179152 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 17:00:54.183361 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179154 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 17:00:54.183361 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179157 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 17:00:54.183361 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179159 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 17:00:54.183361 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179162 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 17:00:54.183361 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179165 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 17:00:54.183361 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179167 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 17:00:54.183361 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179170 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 17:00:54.183361 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179173 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 17:00:54.183361 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179175 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 17:00:54.183361 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179178 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 17:00:54.183361 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179180 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 17:00:54.183361 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179183 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 17:00:54.183361 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179185 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 17:00:54.183361 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179187 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 17:00:54.183361 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179190 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 17:00:54.183361 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179192 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 17:00:54.183361 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179219 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 17:00:54.183886 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179223 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 17:00:54.183886 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179227 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 17:00:54.183886 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179230 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 17:00:54.183886 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179233 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 17:00:54.183886 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179235 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 17:00:54.183886 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179238 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 17:00:54.183886 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179241 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 17:00:54.183886 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179243 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 17:00:54.183886 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179246 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 17:00:54.183886 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179249 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 17:00:54.183886 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179252 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 17:00:54.183886 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179254 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 17:00:54.183886 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179258 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 17:00:54.183886 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179261 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 17:00:54.183886 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179265 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 17:00:54.183886 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179267 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 17:00:54.183886 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179270 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 17:00:54.183886 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179272 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 17:00:54.183886 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179276 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 17:00:54.184382 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179278 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 17:00:54.184382 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179281 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 17:00:54.184382 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179283 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 17:00:54.184382 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179286 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 17:00:54.184382 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179288 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 17:00:54.184382 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179291 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 17:00:54.184382 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179295 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 17:00:54.184382 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179299 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 17:00:54.184382 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179301 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 17:00:54.184382 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179304 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 17:00:54.184382 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179307 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 17:00:54.184382 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179309 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 17:00:54.184382 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179314 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 17:00:54.184382 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179317 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 30 17:00:54.184382 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179319 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 17:00:54.184382 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179322 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 17:00:54.184382 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179325 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 17:00:54.184382 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179327 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 17:00:54.184382 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.179330 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 17:00:54.184382 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179414 2570 flags.go:64] FLAG: --address="0.0.0.0" Jul 30 17:00:54.185622 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179423 2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 30 17:00:54.185622 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179430 2570 flags.go:64] FLAG: --anonymous-auth="true" Jul 30 17:00:54.185622 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179435 2570 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 30 17:00:54.185622 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179440 2570 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 30 17:00:54.185622 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179444 2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 30 17:00:54.185622 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179448 2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 30 17:00:54.185622 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179453 2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 30 17:00:54.185622 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179456 2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 30 17:00:54.185622 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179460 2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 30 17:00:54.185622 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179464 2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 30 17:00:54.185622 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179468 2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 30 17:00:54.185622 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179471 2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 30 17:00:54.185622 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179474 2570 flags.go:64] FLAG: --cgroup-root="" Jul 30 17:00:54.185622 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179477 2570 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 30 17:00:54.185622 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179480 2570 flags.go:64] FLAG: --client-ca-file="" Jul 30 17:00:54.185622 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179483 2570 flags.go:64] FLAG: --cloud-provider="external" Jul 30 17:00:54.185622 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179486 2570 flags.go:64] FLAG: --cluster-dns="[]" Jul 30 17:00:54.185622 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179491 2570 flags.go:64] FLAG: --cluster-domain="" Jul 30 17:00:54.185622 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179494 2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 30 17:00:54.185622 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179497 2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 30 17:00:54.185622 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179500 2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 30 17:00:54.185622 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179504 2570 flags.go:64] FLAG: --container-log-max-files="5" Jul 30 17:00:54.185622 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179508 2570 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 30 17:00:54.185622 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179511 2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 30 17:00:54.186202 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179516 2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 30 17:00:54.186202 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179519 2570 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 30 17:00:54.186202 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179522 2570 flags.go:64] FLAG: --contention-profiling="false" Jul 30 17:00:54.186202 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179526 2570 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 30 17:00:54.186202 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179529 2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 30 17:00:54.186202 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179532 2570 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 30 17:00:54.186202 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179535 2570 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 30 17:00:54.186202 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179539 2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 30 17:00:54.186202 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179542 2570 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 30 17:00:54.186202 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179560 2570 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 30 17:00:54.186202 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179565 2570 flags.go:64] FLAG: --enable-load-reader="false" Jul 30 17:00:54.186202 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179570 2570 flags.go:64] FLAG: --enable-server="true" Jul 30 17:00:54.186202 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179575 2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 30 17:00:54.186202 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179582 2570 flags.go:64] FLAG: --event-burst="100" Jul 30 17:00:54.186202 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179585 2570 flags.go:64] FLAG: --event-qps="50" Jul 30 17:00:54.186202 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179588 2570 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 30 17:00:54.186202 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179591 2570 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 30 17:00:54.186202 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179594 2570 flags.go:64] FLAG: --eviction-hard="" Jul 30 17:00:54.186202 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179599 2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 30 17:00:54.186202 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179602 2570 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 30 17:00:54.186202 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179605 2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 30 17:00:54.186202 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179608 2570 flags.go:64] FLAG: --eviction-soft="" Jul 30 17:00:54.186202 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179611 2570 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 30 17:00:54.186202 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179614 2570 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 30 17:00:54.186202 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179617 2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 30 17:00:54.186868 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179620 2570 flags.go:64] FLAG: --experimental-mounter-path="" Jul 30 17:00:54.186868 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179623 2570 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 30 17:00:54.186868 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179625 2570 flags.go:64] FLAG: --fail-swap-on="true" Jul 30 17:00:54.186868 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179628 2570 flags.go:64] FLAG: --feature-gates="" Jul 30 17:00:54.186868 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179632 2570 flags.go:64] FLAG: --file-check-frequency="20s" Jul 30 17:00:54.186868 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179635 2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 30 17:00:54.186868 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179644 2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 30 17:00:54.186868 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179649 2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 30 17:00:54.186868 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179652 2570 flags.go:64] FLAG: --healthz-port="10248" Jul 30 17:00:54.186868 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179655 2570 flags.go:64] FLAG: --help="false" Jul 30 17:00:54.186868 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179658 2570 flags.go:64] FLAG: --hostname-override="ip-10-0-136-120.ec2.internal" Jul 30 17:00:54.186868 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179661 2570 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 30 17:00:54.186868 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179664 2570 flags.go:64] FLAG: --http-check-frequency="20s" Jul 30 17:00:54.186868 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179667 2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 30 17:00:54.186868 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179670 2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 30 17:00:54.186868 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179673 2570 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 30 17:00:54.186868 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179676 2570 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 30 17:00:54.186868 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179679 2570 flags.go:64] FLAG: --image-service-endpoint="" Jul 30 17:00:54.186868 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179682 2570 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 30 17:00:54.186868 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179685 2570 flags.go:64] FLAG: --kube-api-burst="100" Jul 30 17:00:54.186868 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179689 2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 30 17:00:54.186868 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179692 2570 flags.go:64] FLAG: --kube-api-qps="50" Jul 30 17:00:54.186868 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179695 2570 flags.go:64] FLAG: --kube-reserved="" Jul 30 17:00:54.186868 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179698 2570 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 30 17:00:54.187476 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179701 2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 30 17:00:54.187476 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179704 2570 flags.go:64] FLAG: --kubelet-cgroups="" Jul 30 17:00:54.187476 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179707 2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 30 17:00:54.187476 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179710 2570 flags.go:64] FLAG: --lock-file="" Jul 30 17:00:54.187476 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179712 2570 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 30 17:00:54.187476 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179715 2570 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 30 17:00:54.187476 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179719 2570 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 30 17:00:54.187476 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179724 2570 flags.go:64] FLAG: --log-json-split-stream="false" Jul 30 17:00:54.187476 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179727 2570 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 30 17:00:54.187476 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179730 2570 flags.go:64] FLAG: --log-text-split-stream="false" Jul 30 17:00:54.187476 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179732 2570 flags.go:64] FLAG: --logging-format="text" Jul 30 17:00:54.187476 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179735 2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 30 17:00:54.187476 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179738 2570 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 30 17:00:54.187476 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179741 2570 flags.go:64] FLAG: --manifest-url="" Jul 30 17:00:54.187476 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179745 2570 flags.go:64] FLAG: --manifest-url-header="" Jul 30 17:00:54.187476 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179751 2570 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 30 17:00:54.187476 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179754 2570 flags.go:64] FLAG: --max-open-files="1000000" Jul 30 17:00:54.187476 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179758 2570 flags.go:64] FLAG: --max-pods="110" Jul 30 17:00:54.187476 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179761 2570 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 30 17:00:54.187476 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179764 2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 30 17:00:54.187476 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179767 2570 flags.go:64] FLAG: --memory-manager-policy="None" Jul 30 17:00:54.187476 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179771 2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 30 17:00:54.187476 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179774 2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 30 17:00:54.187476 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179777 2570 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 30 17:00:54.187476 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179780 2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 30 17:00:54.188116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179790 2570 flags.go:64] FLAG: --node-status-max-images="50" Jul 30 17:00:54.188116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179793 2570 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 30 17:00:54.188116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179796 2570 flags.go:64] FLAG: --oom-score-adj="-999" Jul 30 17:00:54.188116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179799 2570 flags.go:64] FLAG: --pod-cidr="" Jul 30 17:00:54.188116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179802 2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 30 17:00:54.188116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179809 2570 flags.go:64] FLAG: --pod-manifest-path="" Jul 30 17:00:54.188116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179812 2570 flags.go:64] FLAG: --pod-max-pids="-1" Jul 30 17:00:54.188116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179815 2570 flags.go:64] FLAG: --pods-per-core="0" Jul 30 17:00:54.188116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179818 2570 flags.go:64] FLAG: --port="10250" Jul 30 17:00:54.188116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179821 2570 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 30 17:00:54.188116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179824 2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0aa70f7109954956f" Jul 30 17:00:54.188116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179828 2570 flags.go:64] FLAG: --qos-reserved="" Jul 30 17:00:54.188116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179831 2570 flags.go:64] FLAG: --read-only-port="10255" Jul 30 17:00:54.188116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179834 2570 flags.go:64] FLAG: --register-node="true" Jul 30 17:00:54.188116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179837 2570 flags.go:64] FLAG: --register-with-taints="" Jul 30 17:00:54.188116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179845 2570 flags.go:64] FLAG: --registry-burst="10" Jul 30 17:00:54.188116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179848 2570 flags.go:64] FLAG: --registry-qps="5" Jul 30 17:00:54.188116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179851 2570 flags.go:64] FLAG: --reserved-cpus="" Jul 30 17:00:54.188116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179854 2570 flags.go:64] FLAG: --reserved-memory="" Jul 30 17:00:54.188116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179858 2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 30 17:00:54.188116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179862 2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 30 17:00:54.188116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179865 2570 flags.go:64] FLAG: --rotate-certificates="false" Jul 30 17:00:54.188116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179868 2570 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 30 17:00:54.188116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179872 2570 flags.go:64] FLAG: --runonce="false" Jul 30 17:00:54.188116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179875 2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 30 17:00:54.188828 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179880 2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 30 17:00:54.188828 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179883 2570 flags.go:64] FLAG: --seccomp-default="false" Jul 30 17:00:54.188828 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179886 2570 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 30 17:00:54.188828 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179889 2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 30 17:00:54.188828 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179892 2570 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 30 17:00:54.188828 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179896 2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 30 17:00:54.188828 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179899 2570 flags.go:64] FLAG: --storage-driver-password="root" Jul 30 17:00:54.188828 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179902 2570 flags.go:64] FLAG: --storage-driver-secure="false" Jul 30 17:00:54.188828 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179905 2570 flags.go:64] FLAG: --storage-driver-table="stats" Jul 30 17:00:54.188828 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179908 2570 flags.go:64] FLAG: --storage-driver-user="root" Jul 30 17:00:54.188828 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179911 2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 30 17:00:54.188828 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179914 2570 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 30 17:00:54.188828 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179918 2570 flags.go:64] FLAG: --system-cgroups="" Jul 30 17:00:54.188828 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179921 2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 30 17:00:54.188828 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179927 2570 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 30 17:00:54.188828 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179930 2570 flags.go:64] FLAG: --tls-cert-file="" Jul 30 17:00:54.188828 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179933 2570 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 30 17:00:54.188828 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179937 2570 flags.go:64] FLAG: --tls-min-version="" Jul 30 17:00:54.188828 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179940 2570 flags.go:64] FLAG: --tls-private-key-file="" Jul 30 17:00:54.188828 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179943 2570 flags.go:64] FLAG: --topology-manager-policy="none" Jul 30 17:00:54.188828 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179946 2570 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 30 17:00:54.188828 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179949 2570 flags.go:64] FLAG: --topology-manager-scope="container" Jul 30 17:00:54.188828 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179953 2570 flags.go:64] FLAG: --v="2" Jul 30 17:00:54.188828 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179957 2570 flags.go:64] FLAG: --version="false" Jul 30 17:00:54.188828 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179961 2570 flags.go:64] FLAG: --vmodule="" Jul 30 17:00:54.189477 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179965 2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 30 17:00:54.189477 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.179968 2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 30 17:00:54.189477 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180101 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 17:00:54.189477 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180105 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 17:00:54.189477 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180108 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 17:00:54.189477 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180112 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 17:00:54.189477 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180116 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 17:00:54.189477 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180120 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 17:00:54.189477 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180123 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 17:00:54.189477 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180125 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 17:00:54.189477 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180128 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 17:00:54.189477 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180131 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 17:00:54.189477 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180133 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 30 17:00:54.189477 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180136 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 17:00:54.189477 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180139 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 17:00:54.189477 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180143 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 17:00:54.189477 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180146 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 17:00:54.189477 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180149 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 17:00:54.189477 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180154 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 17:00:54.189477 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180157 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 17:00:54.189980 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180166 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 17:00:54.189980 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180168 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 17:00:54.189980 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180171 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 17:00:54.189980 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180174 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 17:00:54.189980 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180177 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 17:00:54.189980 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180180 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 17:00:54.189980 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180182 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 17:00:54.189980 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180185 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 17:00:54.189980 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180187 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 17:00:54.189980 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180190 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 17:00:54.189980 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180193 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 17:00:54.189980 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180195 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 17:00:54.189980 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180197 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 17:00:54.189980 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180200 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 17:00:54.189980 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180202 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 17:00:54.189980 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180205 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 17:00:54.189980 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180207 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 17:00:54.189980 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180212 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 17:00:54.189980 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180214 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 17:00:54.189980 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180219 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 17:00:54.190462 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180222 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 17:00:54.190462 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180224 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 17:00:54.190462 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180227 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 17:00:54.190462 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180230 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 17:00:54.190462 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180232 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 17:00:54.190462 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180235 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 17:00:54.190462 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180238 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 17:00:54.190462 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180240 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 17:00:54.190462 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180243 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 17:00:54.190462 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180245 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 17:00:54.190462 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180248 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 17:00:54.190462 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180251 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 17:00:54.190462 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180253 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 17:00:54.190462 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180256 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 17:00:54.190462 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180259 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 17:00:54.190462 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180261 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 17:00:54.190462 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180264 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 17:00:54.190462 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180267 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 17:00:54.190462 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180269 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 17:00:54.190462 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180272 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 17:00:54.190969 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180275 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 17:00:54.190969 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180278 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 17:00:54.190969 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180280 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 17:00:54.190969 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180283 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 17:00:54.190969 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180285 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 17:00:54.190969 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180288 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 17:00:54.190969 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180290 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 17:00:54.190969 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180293 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 17:00:54.190969 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180296 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 17:00:54.190969 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180302 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 17:00:54.190969 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180304 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 17:00:54.190969 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180309 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 17:00:54.190969 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180312 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 17:00:54.190969 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180315 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 17:00:54.190969 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180317 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 17:00:54.190969 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180320 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 17:00:54.190969 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180322 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 17:00:54.190969 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180325 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 17:00:54.190969 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180328 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 17:00:54.191453 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180330 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 17:00:54.191453 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180333 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 17:00:54.191453 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180336 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 17:00:54.191453 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180338 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 17:00:54.191453 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180341 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 17:00:54.191453 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180343 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 17:00:54.191453 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180346 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 17:00:54.191453 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180349 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 17:00:54.191453 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180351 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 17:00:54.191453 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180354 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 17:00:54.191453 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180356 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 17:00:54.191453 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180359 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 17:00:54.191453 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180362 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 17:00:54.191453 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180364 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 17:00:54.191453 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180367 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 17:00:54.191453 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180369 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 17:00:54.191453 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180372 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 17:00:54.191453 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180375 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 17:00:54.191453 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180377 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 17:00:54.191453 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180380 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 17:00:54.191961 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180382 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 17:00:54.191961 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.180385 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 17:00:54.191961 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.181138 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 30 17:00:54.191961 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.188328 2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 30 17:00:54.191961 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.188347 2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 30 17:00:54.191961 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.188362 2570 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 30 17:00:54.191961 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.188368 2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 30 17:00:54.191961 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188430 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 17:00:54.191961 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188435 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 17:00:54.191961 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188439 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 17:00:54.191961 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188443 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 17:00:54.191961 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188446 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 17:00:54.191961 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188449 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 17:00:54.191961 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188453 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 17:00:54.191961 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188456 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 17:00:54.192337 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188459 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 17:00:54.192337 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188462 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 17:00:54.192337 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188465 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 17:00:54.192337 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188468 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 17:00:54.192337 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188472 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 17:00:54.192337 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188476 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 17:00:54.192337 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188480 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 17:00:54.192337 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188483 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 17:00:54.192337 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188486 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 17:00:54.192337 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188488 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 17:00:54.192337 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188491 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 17:00:54.192337 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188495 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 17:00:54.192337 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188499 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 17:00:54.192337 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188502 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 17:00:54.192337 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188505 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 17:00:54.192337 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188508 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 17:00:54.192337 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188511 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 17:00:54.192337 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188513 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 17:00:54.192337 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188516 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 17:00:54.192890 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188518 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 17:00:54.192890 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188521 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 17:00:54.192890 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188526 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 17:00:54.192890 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188529 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 17:00:54.192890 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188531 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 17:00:54.192890 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188534 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 17:00:54.192890 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188537 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 17:00:54.192890 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188540 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 17:00:54.192890 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188542 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 17:00:54.192890 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188559 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 17:00:54.192890 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188563 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 17:00:54.192890 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188567 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 17:00:54.192890 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188570 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 17:00:54.192890 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188573 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 17:00:54.192890 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188576 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 17:00:54.192890 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188579 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 30 17:00:54.192890 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188582 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 17:00:54.192890 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188585 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 17:00:54.192890 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188587 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 17:00:54.193375 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188590 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 17:00:54.193375 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188593 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 17:00:54.193375 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188595 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 17:00:54.193375 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188598 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 17:00:54.193375 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188600 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 17:00:54.193375 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188603 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 17:00:54.193375 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188605 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 17:00:54.193375 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188608 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 17:00:54.193375 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188610 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 17:00:54.193375 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188613 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 17:00:54.193375 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188616 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 17:00:54.193375 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188618 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 17:00:54.193375 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188621 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 17:00:54.193375 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188624 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 17:00:54.193375 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188626 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 17:00:54.193375 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188630 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 17:00:54.193375 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188634 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 17:00:54.193375 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188636 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 17:00:54.193375 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188639 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 17:00:54.193375 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188641 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 17:00:54.193920 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188644 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 17:00:54.193920 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188647 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 17:00:54.193920 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188649 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 17:00:54.193920 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188652 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 17:00:54.193920 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188655 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 17:00:54.193920 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188658 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 17:00:54.193920 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188660 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 17:00:54.193920 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188663 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 17:00:54.193920 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188666 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 17:00:54.193920 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188669 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 17:00:54.193920 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188671 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 17:00:54.193920 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188674 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 17:00:54.193920 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188676 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 17:00:54.193920 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188679 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 17:00:54.193920 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188681 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 17:00:54.193920 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188684 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 17:00:54.193920 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188686 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 17:00:54.193920 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188689 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 17:00:54.193920 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188691 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 17:00:54.193920 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188693 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 17:00:54.194405 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188696 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 17:00:54.194405 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188698 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 17:00:54.194405 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188701 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 17:00:54.194405 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188703 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 17:00:54.194405 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188706 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 17:00:54.194405 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188708 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 17:00:54.194405 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188711 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 17:00:54.194405 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188715 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 17:00:54.194405 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188718 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 17:00:54.194405 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188721 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 17:00:54.194405 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188724 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 17:00:54.194405 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188726 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 17:00:54.194405 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188729 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 17:00:54.194405 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.188734 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 30 17:00:54.194405 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188855 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 17:00:54.194817 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188860 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 17:00:54.194817 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188864 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 17:00:54.194817 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188868 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 17:00:54.194817 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188871 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 17:00:54.194817 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188874 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 17:00:54.194817 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188877 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 17:00:54.194817 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188880 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 17:00:54.194817 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188883 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 17:00:54.194817 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188886 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 17:00:54.194817 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188889 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 17:00:54.194817 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188891 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 17:00:54.194817 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188893 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 17:00:54.194817 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188896 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 17:00:54.194817 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188898 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 17:00:54.194817 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188901 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 17:00:54.194817 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188904 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 17:00:54.194817 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188906 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 17:00:54.194817 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188909 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 17:00:54.194817 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188911 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 17:00:54.194817 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188914 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 17:00:54.195366 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188916 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 17:00:54.195366 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188919 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 17:00:54.195366 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188921 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 17:00:54.195366 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188924 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 17:00:54.195366 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188927 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 17:00:54.195366 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188930 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 17:00:54.195366 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188933 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 17:00:54.195366 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188936 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 17:00:54.195366 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188939 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 17:00:54.195366 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188941 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 17:00:54.195366 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188944 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 17:00:54.195366 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188946 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 17:00:54.195366 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188949 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 17:00:54.195366 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188953 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 17:00:54.195366 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188955 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 17:00:54.195366 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188958 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 17:00:54.195366 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188961 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 17:00:54.195366 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188963 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 17:00:54.195366 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188966 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 17:00:54.195366 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188968 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 17:00:54.196067 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188971 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 17:00:54.196067 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188973 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 17:00:54.196067 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188975 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 17:00:54.196067 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188978 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 17:00:54.196067 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188980 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 17:00:54.196067 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188983 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 17:00:54.196067 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188985 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 17:00:54.196067 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188988 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 17:00:54.196067 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188990 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 17:00:54.196067 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188993 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 17:00:54.196067 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188996 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 17:00:54.196067 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.188999 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 17:00:54.196067 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189001 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 17:00:54.196067 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189004 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 17:00:54.196067 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189006 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 17:00:54.196067 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189009 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 17:00:54.196067 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189011 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 17:00:54.196067 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189014 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 17:00:54.196067 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189017 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 17:00:54.196067 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189020 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 17:00:54.196926 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189023 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 17:00:54.196926 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189026 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 17:00:54.196926 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189028 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 17:00:54.196926 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189031 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 17:00:54.196926 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189034 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 17:00:54.196926 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189036 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 17:00:54.196926 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189039 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 17:00:54.196926 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189041 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 17:00:54.196926 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189043 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 17:00:54.196926 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189046 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 17:00:54.196926 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189049 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 17:00:54.196926 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189051 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 17:00:54.196926 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189053 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 17:00:54.196926 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189056 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 17:00:54.196926 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189058 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 17:00:54.196926 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189061 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 30 17:00:54.196926 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189063 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 17:00:54.196926 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189066 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 17:00:54.196926 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189068 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 17:00:54.196926 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189071 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 17:00:54.197465 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189073 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 17:00:54.197465 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189076 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 17:00:54.197465 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189078 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 17:00:54.197465 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189081 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 17:00:54.197465 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189083 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 17:00:54.197465 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189085 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 17:00:54.197465 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189088 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 17:00:54.197465 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189091 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 17:00:54.197465 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189093 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 17:00:54.197465 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189096 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 17:00:54.197465 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189099 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 17:00:54.197465 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189102 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 17:00:54.197465 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189106 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 17:00:54.197465 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189110 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 17:00:54.197465 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189113 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 17:00:54.197465 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189116 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 17:00:54.197465 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189119 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 17:00:54.197465 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:54.189121 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 17:00:54.198160 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.189127 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 30 17:00:54.198160 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.189264 2570 server.go:962] "Client rotation is on, will bootstrap in background" Jul 30 17:00:54.198160 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.193181 2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 30 17:00:54.198160 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.194834 2570 server.go:1019] "Starting client certificate rotation" Jul 30 17:00:54.198160 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.194960 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 30 17:00:54.198160 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.195687 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 30 17:00:54.198160 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.197172 2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 30 17:00:54.201189 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.201159 2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 30 17:00:54.216520 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.216491 2570 log.go:25] "Validated CRI v1 runtime API" Jul 30 17:00:54.218804 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.218780 2570 log.go:25] "Validated CRI v1 image API" Jul 30 17:00:54.219716 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.219685 2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 30 17:00:54.222125 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.222092 2570 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7a990864-29fa-429d-8e63-9bece1461ee0:/dev/nvme0n1p3 dd3ea53b-abbd-4582-b518-f2cecf7ac97b:/dev/nvme0n1p4] Jul 30 17:00:54.222219 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.222121 2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 30 17:00:54.225709 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.225681 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 30 17:00:54.227350 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.227216 2570 manager.go:216] Machine: {Timestamp:2026-07-30 17:00:54.225991666 +0000 UTC m=+0.358838613 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3108772 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25e2606b547047576667ef99df6189 SystemUUID:ec25e260-6b54-7047-5766-67ef99df6189 BootID:cb599d0b-7ed3-4db5-b415-c22f1123f686 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:09:29:5e:11:45 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:09:29:5e:11:45 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:07:10:11:fb:26 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 30 17:00:54.227350 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.227337 2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 30 17:00:54.227581 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.227543 2570 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 30 17:00:54.230361 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.230327 2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 30 17:00:54.230512 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.230365 2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-120.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 30 17:00:54.231168 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.231156 2570 topology_manager.go:138] "Creating topology manager with none policy" Jul 30 17:00:54.231205 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.231171 2570 container_manager_linux.go:309] "Creating device plugin manager" Jul 30 17:00:54.231205 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.231179 2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 30 17:00:54.231735 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.231723 2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 30 17:00:54.232520 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.232508 2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 30 17:00:54.234467 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.234451 2570 state_mem.go:36] "Initialized new in-memory state store" Jul 30 17:00:54.234616 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.234606 2570 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 30 17:00:54.234649 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.234639 2570 kubelet.go:486] "Attempting to sync node with API server" Jul 30 17:00:54.234682 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.234650 2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 30 17:00:54.234682 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.234663 2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 30 17:00:54.234682 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.234672 2570 kubelet.go:398] "Adding apiserver pod source" Jul 30 17:00:54.234786 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.234683 2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 30 17:00:54.235086 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.235070 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 30 17:00:54.235086 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.235089 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 30 17:00:54.238939 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.238916 2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 30 17:00:54.241707 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.241685 2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 30 17:00:54.241809 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.241730 2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 30 17:00:54.244165 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.244140 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 30 17:00:54.244258 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.244174 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 30 17:00:54.244258 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.244198 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 30 17:00:54.244258 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.244205 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 30 17:00:54.244258 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.244216 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 30 17:00:54.244258 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.244223 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 30 17:00:54.244258 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.244231 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 30 17:00:54.244258 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.244238 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 30 17:00:54.244258 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.244246 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 30 17:00:54.244258 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.244252 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 30 17:00:54.244492 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.244265 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 30 17:00:54.244492 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.244272 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 30 17:00:54.244916 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.244902 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 30 17:00:54.244949 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.244930 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 30 17:00:54.247202 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:54.247175 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-120.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 30 17:00:54.247265 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:54.247175 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 30 17:00:54.247265 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.247207 2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-120.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 30 17:00:54.248365 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.248350 2570 server.go:1268] "Started kubelet" Jul 30 17:00:54.248455 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.248424 2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 30 17:00:54.248505 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.248436 2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 30 17:00:54.248569 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.248512 2570 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 30 17:00:54.249225 ip-10-0-136-120 systemd[1]: Started Kubernetes Kubelet. Jul 30 17:00:54.250309 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.250186 2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 30 17:00:54.250561 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.250534 2570 server.go:310] "Adding debug handlers to kubelet server" Jul 30 17:00:54.252364 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:54.252343 2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 30 17:00:54.253283 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.253265 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rwbhr" Jul 30 17:00:54.257039 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.257020 2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 30 17:00:54.257170 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:54.257126 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-120.ec2.internal\" not found" Jul 30 17:00:54.257226 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.257028 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 30 17:00:54.257805 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.257777 2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 30 17:00:54.257913 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.257844 2570 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 30 17:00:54.257913 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.257860 2570 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 30 17:00:54.258026 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.257994 2570 reconstruct.go:97] "Volume reconstruction finished" Jul 30 17:00:54.258026 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.258000 2570 reconciler.go:29] "Reconciler: start to sync state" Jul 30 17:00:54.258156 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.258037 2570 factory.go:55] Registering systemd factory Jul 30 17:00:54.258156 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.258076 2570 factory.go:223] Registration of the systemd container factory successfully Jul 30 17:00:54.258315 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.258300 2570 factory.go:153] Registering CRI-O factory Jul 30 17:00:54.258347 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.258320 2570 factory.go:223] Registration of the crio container factory successfully Jul 30 17:00:54.258374 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.258369 2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 30 17:00:54.258403 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.258392 2570 factory.go:103] Registering Raw factory Jul 30 17:00:54.258439 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.258407 2570 manager.go:1196] Started watching for new ooms in manager Jul 30 17:00:54.258772 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.258752 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rwbhr" Jul 30 17:00:54.258908 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.258896 2570 manager.go:349] Starting recovery of all containers Jul 30 17:00:54.266206 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.266183 2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 17:00:54.270542 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:54.270513 2570 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-120.ec2.internal\" not found" node="ip-10-0-136-120.ec2.internal" Jul 30 17:00:54.275694 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.275668 2570 manager.go:354] Recovery completed Jul 30 17:00:54.281685 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.281665 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 17:00:54.283631 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.283608 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasSufficientMemory" Jul 30 17:00:54.283717 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.283652 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 17:00:54.283717 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.283671 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasSufficientPID" Jul 30 17:00:54.284284 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.284266 2570 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 30 17:00:54.284284 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.284283 2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 30 17:00:54.284406 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.284288 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 17:00:54.284406 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.284305 2570 state_mem.go:36] "Initialized new in-memory state store" Jul 30 17:00:54.285082 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.285067 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasSufficientMemory" Jul 30 17:00:54.285153 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.285107 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 17:00:54.285153 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.285119 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasSufficientPID" Jul 30 17:00:54.285963 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.285951 2570 policy_none.go:49] "None policy: Start" Jul 30 17:00:54.286010 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.285968 2570 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 30 17:00:54.286010 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.285979 2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 30 17:00:54.286931 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.286920 2570 policy_none.go:47] "Start" Jul 30 17:00:54.319464 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.319276 2570 manager.go:337] "Starting Device Plugin manager" Jul 30 17:00:54.319596 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:54.319487 2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 30 17:00:54.319596 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.319497 2570 server.go:87] "Starting device plugin registration server" Jul 30 17:00:54.319769 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.319758 2570 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 30 17:00:54.319802 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.319770 2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 30 17:00:54.319909 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.319885 2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 30 17:00:54.320011 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.319995 2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 30 17:00:54.320011 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.320011 2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 30 17:00:54.320540 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:54.320519 2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 30 17:00:54.320617 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:54.320599 2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-120.ec2.internal\" not found" Jul 30 17:00:54.420807 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.420780 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 17:00:54.421904 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.421779 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasSufficientMemory" Jul 30 17:00:54.421904 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.421810 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 17:00:54.421904 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.421821 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasSufficientPID" Jul 30 17:00:54.421904 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.421852 2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-120.ec2.internal" Jul 30 17:00:54.430715 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.430686 2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-120.ec2.internal" Jul 30 17:00:54.430715 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:54.430717 2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-120.ec2.internal\": node \"ip-10-0-136-120.ec2.internal\" not found" Jul 30 17:00:54.446267 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:54.446235 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-120.ec2.internal\" not found" Jul 30 17:00:54.456508 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.456474 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 30 17:00:54.457796 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.457776 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 30 17:00:54.457868 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.457820 2570 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 30 17:00:54.457868 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.457851 2570 kubelet.go:2448] "Starting kubelet main sync loop" Jul 30 17:00:54.457966 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:54.457893 2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 30 17:00:54.460056 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.460030 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 17:00:54.546708 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:54.546673 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-120.ec2.internal\" not found" Jul 30 17:00:54.558967 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.558925 2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-120.ec2.internal"] Jul 30 17:00:54.559044 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.559012 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 17:00:54.563971 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.563951 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasSufficientMemory" Jul 30 17:00:54.564072 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.563984 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 17:00:54.564072 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.563997 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasSufficientPID" Jul 30 17:00:54.565348 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.565329 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 17:00:54.565482 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.565466 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal" Jul 30 17:00:54.565539 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.565505 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 17:00:54.566211 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.566191 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasSufficientMemory" Jul 30 17:00:54.566211 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.566211 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasSufficientMemory" Jul 30 17:00:54.566381 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.566224 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 17:00:54.566381 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.566233 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 17:00:54.566381 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.566239 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasSufficientPID" Jul 30 17:00:54.566381 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.566246 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasSufficientPID" Jul 30 17:00:54.567623 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.567608 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-120.ec2.internal" Jul 30 17:00:54.567703 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.567639 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 17:00:54.568480 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.568463 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasSufficientMemory" Jul 30 17:00:54.568592 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.568495 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 17:00:54.568592 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.568523 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasSufficientPID" Jul 30 17:00:54.595640 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:54.595615 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-120.ec2.internal\" not found" node="ip-10-0-136-120.ec2.internal" Jul 30 17:00:54.600459 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:54.600438 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-120.ec2.internal\" not found" node="ip-10-0-136-120.ec2.internal" Jul 30 17:00:54.646837 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:54.646802 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-120.ec2.internal\" not found" Jul 30 17:00:54.659129 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.659106 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d53d46ebf7b711813c5a52cde689ce59-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal\" (UID: \"d53d46ebf7b711813c5a52cde689ce59\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal" Jul 30 17:00:54.659239 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.659134 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d53d46ebf7b711813c5a52cde689ce59-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal\" (UID: \"d53d46ebf7b711813c5a52cde689ce59\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal" Jul 30 17:00:54.659239 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.659154 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3492ed6927be9f82b217829acc311662-config\") pod \"kube-apiserver-proxy-ip-10-0-136-120.ec2.internal\" (UID: \"3492ed6927be9f82b217829acc311662\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-120.ec2.internal" Jul 30 17:00:54.747583 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:54.747478 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-120.ec2.internal\" not found" Jul 30 17:00:54.759894 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.759859 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d53d46ebf7b711813c5a52cde689ce59-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal\" (UID: \"d53d46ebf7b711813c5a52cde689ce59\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal" Jul 30 17:00:54.760036 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.759940 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d53d46ebf7b711813c5a52cde689ce59-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal\" (UID: \"d53d46ebf7b711813c5a52cde689ce59\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal" Jul 30 17:00:54.760036 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.759898 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d53d46ebf7b711813c5a52cde689ce59-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal\" (UID: \"d53d46ebf7b711813c5a52cde689ce59\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal" Jul 30 17:00:54.760036 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.759990 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3492ed6927be9f82b217829acc311662-config\") pod \"kube-apiserver-proxy-ip-10-0-136-120.ec2.internal\" (UID: \"3492ed6927be9f82b217829acc311662\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-120.ec2.internal" Jul 30 17:00:54.760036 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.760016 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3492ed6927be9f82b217829acc311662-config\") pod \"kube-apiserver-proxy-ip-10-0-136-120.ec2.internal\" (UID: \"3492ed6927be9f82b217829acc311662\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-120.ec2.internal" Jul 30 17:00:54.760036 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.759956 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d53d46ebf7b711813c5a52cde689ce59-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal\" (UID: \"d53d46ebf7b711813c5a52cde689ce59\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal" Jul 30 17:00:54.848053 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:54.848011 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-120.ec2.internal\" not found" Jul 30 17:00:54.898557 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.898529 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal" Jul 30 17:00:54.904561 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:54.904530 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-120.ec2.internal" Jul 30 17:00:54.948701 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:54.948666 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-120.ec2.internal\" not found" Jul 30 17:00:55.049313 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:55.049214 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-120.ec2.internal\" not found" Jul 30 17:00:55.149853 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:55.149803 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-120.ec2.internal\" not found" Jul 30 17:00:55.194330 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:55.194303 2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 30 17:00:55.194786 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:55.194467 2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 30 17:00:55.194786 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:55.194495 2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 30 17:00:55.250506 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:55.250480 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-120.ec2.internal\" not found" Jul 30 17:00:55.263563 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:55.263496 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-29 16:55:54 +0000 UTC" deadline="2028-04-10 18:38:19.931790226 +0000 UTC" Jul 30 17:00:55.263563 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:55.263564 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14881h37m24.668230697s" Jul 30 17:00:55.351601 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:55.351496 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-120.ec2.internal\" not found" Jul 30 17:00:55.452017 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:55.451986 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-120.ec2.internal\" not found" Jul 30 17:00:55.473752 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:55.473719 2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 17:00:55.475364 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:55.475331 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd53d46ebf7b711813c5a52cde689ce59.slice/crio-ae3dea4ee407dab4828bba8093b4f54cebfea9e6c659bb6cf9ddc911a4846cac WatchSource:0}: Error finding container ae3dea4ee407dab4828bba8093b4f54cebfea9e6c659bb6cf9ddc911a4846cac: Status 404 returned error can't find the container with id ae3dea4ee407dab4828bba8093b4f54cebfea9e6c659bb6cf9ddc911a4846cac Jul 30 17:00:55.480459 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:55.480436 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 30 17:00:55.552661 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:55.552620 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-120.ec2.internal\" not found" Jul 30 17:00:55.653291 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:55.653219 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-120.ec2.internal\" not found" Jul 30 17:00:55.736250 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:55.736222 2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 17:00:55.758230 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:55.758207 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal" Jul 30 17:00:55.769897 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:55.769864 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 30 17:00:55.770727 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:55.770711 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-120.ec2.internal" Jul 30 17:00:55.776411 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:55.776391 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 30 17:00:55.913461 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:55.913431 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3492ed6927be9f82b217829acc311662.slice/crio-13dec8541233644708107a6663dab0068eef89e0f506e55d94956d623c3ce9f8 WatchSource:0}: Error finding container 13dec8541233644708107a6663dab0068eef89e0f506e55d94956d623c3ce9f8: Status 404 returned error can't find the container with id 13dec8541233644708107a6663dab0068eef89e0f506e55d94956d623c3ce9f8 Jul 30 17:00:56.237566 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.237521 2570 apiserver.go:52] "Watching apiserver" Jul 30 17:00:56.246851 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.246821 2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 30 17:00:56.247259 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.247228 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-8vjz8","openshift-network-diagnostics/network-check-target-hwbcz","kube-system/konnectivity-agent-wvmx2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nssxg","openshift-cluster-node-tuning-operator/tuned-v2thn","openshift-image-registry/node-ca-4wsb4","openshift-multus/multus-additional-cni-plugins-8zvvk","openshift-multus/multus-ssvk2","openshift-network-operator/iptables-alerter-6t9xr","openshift-ovn-kubernetes/ovnkube-node-77btm","kube-system/global-pull-secret-syncer-jhw42","kube-system/kube-apiserver-proxy-ip-10-0-136-120.ec2.internal","openshift-dns/node-resolver-tb5cb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal"] Jul 30 17:00:56.249188 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.249169 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:00:56.249269 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:56.249247 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8vjz8" podUID="3fdebda4-24ac-4c03-a395-a0e29dc51625" Jul 30 17:00:56.250536 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.250518 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8zvvk" Jul 30 17:00:56.251962 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.251934 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nssxg" Jul 30 17:00:56.253273 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.253247 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wvmx2" Jul 30 17:00:56.253769 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.253747 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 30 17:00:56.253868 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.253747 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 30 17:00:56.254074 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.254050 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 30 17:00:56.254197 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.254078 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 30 17:00:56.254197 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.254088 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5k4qx\"" Jul 30 17:00:56.254197 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.254050 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 30 17:00:56.254712 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.254693 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 30 17:00:56.254809 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.254750 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 30 17:00:56.254809 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.254781 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 30 17:00:56.254809 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.254800 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8gn2h\"" Jul 30 17:00:56.255001 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.254984 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.255477 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.255450 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 30 17:00:56.255582 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.255456 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 30 17:00:56.255854 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.255812 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-z245f\"" Jul 30 17:00:56.256357 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.256338 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4wsb4" Jul 30 17:00:56.256985 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.256962 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 30 17:00:56.256985 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.256982 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zb8dj\"" Jul 30 17:00:56.257142 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.256936 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 30 17:00:56.257697 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.257680 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 30 17:00:56.257847 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.257827 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:00:56.257942 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:56.257897 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwbcz" podUID="8400548d-00fa-439c-b7b9-3157adfd8f76" Jul 30 17:00:56.259299 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.259021 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 30 17:00:56.259299 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.259031 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 30 17:00:56.259299 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.259105 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zc9v7\"" Jul 30 17:00:56.259299 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.259106 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 30 17:00:56.259299 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.259245 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.260646 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.260622 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6t9xr" Jul 30 17:00:56.261233 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.261213 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 30 17:00:56.262106 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.262078 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xzszr\"" Jul 30 17:00:56.262677 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.262656 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 30 17:00:56.263084 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.263061 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 30 17:00:56.263226 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.263207 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 30 17:00:56.263293 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.263061 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-n9xfn\"" Jul 30 17:00:56.265135 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.265108 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.267126 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.267097 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:00:56.267232 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.267189 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 30 17:00:56.267303 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:56.267220 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhw42" podUID="681ff1ad-fa48-420e-9501-d18e7a57a773" Jul 30 17:00:56.267698 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.267676 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 30 17:00:56.268441 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.268416 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 30 17:00:56.268572 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.268458 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 30 17:00:56.268572 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.268554 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 30 17:00:56.268823 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.268561 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c84tb\"" Jul 30 17:00:56.268823 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.268755 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 30 17:00:56.268923 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.268892 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b08e8de2-4dd8-4cde-b485-dc15f87d3915-system-cni-dir\") pod \"multus-additional-cni-plugins-8zvvk\" (UID: \"b08e8de2-4dd8-4cde-b485-dc15f87d3915\") " pod="openshift-multus/multus-additional-cni-plugins-8zvvk" Jul 30 17:00:56.268978 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.268926 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3ffbe09e-50f3-487b-8c82-5b6f992c5410-multus-daemon-config\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.268978 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.268951 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-etc-kubernetes\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.269122 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.268975 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98f9n\" (UniqueName: \"kubernetes.io/projected/8400548d-00fa-439c-b7b9-3157adfd8f76-kube-api-access-98f9n\") pod \"network-check-target-hwbcz\" (UID: \"8400548d-00fa-439c-b7b9-3157adfd8f76\") " pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:00:56.269122 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269021 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-etc-sysconfig\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.269122 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269077 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-etc-tuned\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.269122 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269109 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b08e8de2-4dd8-4cde-b485-dc15f87d3915-cni-binary-copy\") pod \"multus-additional-cni-plugins-8zvvk\" (UID: \"b08e8de2-4dd8-4cde-b485-dc15f87d3915\") " pod="openshift-multus/multus-additional-cni-plugins-8zvvk" Jul 30 17:00:56.269345 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269137 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3-konnectivity-ca\") pod \"konnectivity-agent-wvmx2\" (UID: \"c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3\") " pod="kube-system/konnectivity-agent-wvmx2" Jul 30 17:00:56.269345 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269165 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtjw9\" (UniqueName: \"kubernetes.io/projected/70b71d45-9729-44bd-a29a-11e4a77e8937-kube-api-access-vtjw9\") pod \"aws-ebs-csi-driver-node-nssxg\" (UID: \"70b71d45-9729-44bd-a29a-11e4a77e8937\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nssxg" Jul 30 17:00:56.269345 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269201 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-tmp\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.269345 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269235 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-multus-cni-dir\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.269345 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269256 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-host-run-k8s-cni-cncf-io\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.269345 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269281 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6tcs\" (UniqueName: \"kubernetes.io/projected/3ffbe09e-50f3-487b-8c82-5b6f992c5410-kube-api-access-p6tcs\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.269345 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269305 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/70b71d45-9729-44bd-a29a-11e4a77e8937-device-dir\") pod \"aws-ebs-csi-driver-node-nssxg\" (UID: \"70b71d45-9729-44bd-a29a-11e4a77e8937\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nssxg" Jul 30 17:00:56.269345 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269321 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-etc-sysctl-conf\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.269345 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269342 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-host-run-multus-certs\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.269823 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269366 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-etc-modprobe-d\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.269823 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269390 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/70b71d45-9729-44bd-a29a-11e4a77e8937-registration-dir\") pod \"aws-ebs-csi-driver-node-nssxg\" (UID: \"70b71d45-9729-44bd-a29a-11e4a77e8937\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nssxg" Jul 30 17:00:56.269823 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269415 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/33961af5-8f26-48ff-98de-e0340507e385-host\") pod \"node-ca-4wsb4\" (UID: \"33961af5-8f26-48ff-98de-e0340507e385\") " pod="openshift-image-registry/node-ca-4wsb4" Jul 30 17:00:56.269823 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269439 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fdebda4-24ac-4c03-a395-a0e29dc51625-metrics-certs\") pod \"network-metrics-daemon-8vjz8\" (UID: \"3fdebda4-24ac-4c03-a395-a0e29dc51625\") " pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:00:56.269823 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269465 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-sys\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.269823 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269482 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ffbe09e-50f3-487b-8c82-5b6f992c5410-cni-binary-copy\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.269823 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269497 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-hostroot\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.269823 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269540 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b08e8de2-4dd8-4cde-b485-dc15f87d3915-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8zvvk\" (UID: \"b08e8de2-4dd8-4cde-b485-dc15f87d3915\") " pod="openshift-multus/multus-additional-cni-plugins-8zvvk" Jul 30 17:00:56.269823 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269596 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/33961af5-8f26-48ff-98de-e0340507e385-serviceca\") pod \"node-ca-4wsb4\" (UID: \"33961af5-8f26-48ff-98de-e0340507e385\") " pod="openshift-image-registry/node-ca-4wsb4" Jul 30 17:00:56.269823 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269625 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-host\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.269823 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269650 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/70b71d45-9729-44bd-a29a-11e4a77e8937-socket-dir\") pod \"aws-ebs-csi-driver-node-nssxg\" (UID: \"70b71d45-9729-44bd-a29a-11e4a77e8937\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nssxg" Jul 30 17:00:56.269823 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269686 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-var-lib-kubelet\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.269823 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269720 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-host-run-netns\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.269823 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269743 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b08e8de2-4dd8-4cde-b485-dc15f87d3915-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8zvvk\" (UID: \"b08e8de2-4dd8-4cde-b485-dc15f87d3915\") " pod="openshift-multus/multus-additional-cni-plugins-8zvvk" Jul 30 17:00:56.269823 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269770 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-run\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.269823 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269783 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tb5cb" Jul 30 17:00:56.269823 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269790 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8whx9\" (UniqueName: \"kubernetes.io/projected/b08e8de2-4dd8-4cde-b485-dc15f87d3915-kube-api-access-8whx9\") pod \"multus-additional-cni-plugins-8zvvk\" (UID: \"b08e8de2-4dd8-4cde-b485-dc15f87d3915\") " pod="openshift-multus/multus-additional-cni-plugins-8zvvk" Jul 30 17:00:56.270495 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269806 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-etc-systemd\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.270495 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269839 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-system-cni-dir\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.270495 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269870 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-multus-socket-dir-parent\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.270495 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269903 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b08e8de2-4dd8-4cde-b485-dc15f87d3915-cnibin\") pod \"multus-additional-cni-plugins-8zvvk\" (UID: \"b08e8de2-4dd8-4cde-b485-dc15f87d3915\") " pod="openshift-multus/multus-additional-cni-plugins-8zvvk" Jul 30 17:00:56.270495 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269931 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-etc-sysctl-d\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.270495 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269962 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/70b71d45-9729-44bd-a29a-11e4a77e8937-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nssxg\" (UID: \"70b71d45-9729-44bd-a29a-11e4a77e8937\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nssxg" Jul 30 17:00:56.270495 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.269986 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-lib-modules\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.270495 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.270012 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-host-var-lib-kubelet\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.270495 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.270043 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b08e8de2-4dd8-4cde-b485-dc15f87d3915-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8zvvk\" (UID: \"b08e8de2-4dd8-4cde-b485-dc15f87d3915\") " pod="openshift-multus/multus-additional-cni-plugins-8zvvk" Jul 30 17:00:56.270495 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.270069 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3-agent-certs\") pod \"konnectivity-agent-wvmx2\" (UID: \"c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3\") " pod="kube-system/konnectivity-agent-wvmx2" Jul 30 17:00:56.270495 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.270105 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjnt9\" (UniqueName: \"kubernetes.io/projected/33961af5-8f26-48ff-98de-e0340507e385-kube-api-access-wjnt9\") pod \"node-ca-4wsb4\" (UID: \"33961af5-8f26-48ff-98de-e0340507e385\") " pod="openshift-image-registry/node-ca-4wsb4" Jul 30 17:00:56.270495 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.270135 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z2lz\" (UniqueName: \"kubernetes.io/projected/3fdebda4-24ac-4c03-a395-a0e29dc51625-kube-api-access-6z2lz\") pod \"network-metrics-daemon-8vjz8\" (UID: \"3fdebda4-24ac-4c03-a395-a0e29dc51625\") " pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:00:56.270495 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.270161 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/70b71d45-9729-44bd-a29a-11e4a77e8937-etc-selinux\") pod \"aws-ebs-csi-driver-node-nssxg\" (UID: \"70b71d45-9729-44bd-a29a-11e4a77e8937\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nssxg" Jul 30 17:00:56.270495 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.270186 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-os-release\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.270495 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.270212 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-host-var-lib-cni-bin\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.270495 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.270233 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b08e8de2-4dd8-4cde-b485-dc15f87d3915-os-release\") pod \"multus-additional-cni-plugins-8zvvk\" (UID: \"b08e8de2-4dd8-4cde-b485-dc15f87d3915\") " pod="openshift-multus/multus-additional-cni-plugins-8zvvk" Jul 30 17:00:56.271163 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.270251 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/70b71d45-9729-44bd-a29a-11e4a77e8937-sys-fs\") pod \"aws-ebs-csi-driver-node-nssxg\" (UID: \"70b71d45-9729-44bd-a29a-11e4a77e8937\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nssxg" Jul 30 17:00:56.271163 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.270266 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-cnibin\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.271163 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.270282 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-host-var-lib-cni-multus\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.271163 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.270297 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-multus-conf-dir\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.271163 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.270334 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kntd8\" (UniqueName: \"kubernetes.io/projected/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-kube-api-access-kntd8\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.271163 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.270353 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-etc-kubernetes\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.272039 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.272022 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 30 17:00:56.272167 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.272140 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 30 17:00:56.272167 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.272157 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ssts6\"" Jul 30 17:00:56.274416 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.274398 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 30 17:00:56.297159 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.297133 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cclln" Jul 30 17:00:56.305762 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.305736 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cclln" Jul 30 17:00:56.360036 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.359699 2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 30 17:00:56.370629 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.370601 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-etc-sysconfig\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.370793 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.370635 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-etc-tuned\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.370793 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.370703 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-etc-sysconfig\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.370793 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.370751 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b08e8de2-4dd8-4cde-b485-dc15f87d3915-cni-binary-copy\") pod \"multus-additional-cni-plugins-8zvvk\" (UID: \"b08e8de2-4dd8-4cde-b485-dc15f87d3915\") " pod="openshift-multus/multus-additional-cni-plugins-8zvvk" Jul 30 17:00:56.370793 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.370785 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3-konnectivity-ca\") pod \"konnectivity-agent-wvmx2\" (UID: \"c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3\") " pod="kube-system/konnectivity-agent-wvmx2" Jul 30 17:00:56.371007 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.370807 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-systemd-units\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.371007 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.370824 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-host-run-netns\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.371007 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.370844 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-log-socket\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.371007 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.370875 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ba7595c-0626-4561-8f94-ef72a6621ef1-ovn-node-metrics-cert\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.371007 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.370936 2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 30 17:00:56.371007 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.370969 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtjw9\" (UniqueName: \"kubernetes.io/projected/70b71d45-9729-44bd-a29a-11e4a77e8937-kube-api-access-vtjw9\") pod \"aws-ebs-csi-driver-node-nssxg\" (UID: \"70b71d45-9729-44bd-a29a-11e4a77e8937\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nssxg" Jul 30 17:00:56.371007 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.370999 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-tmp\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.371404 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371024 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-multus-cni-dir\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.371404 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371047 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-host-run-k8s-cni-cncf-io\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.371404 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371069 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6tcs\" (UniqueName: \"kubernetes.io/projected/3ffbe09e-50f3-487b-8c82-5b6f992c5410-kube-api-access-p6tcs\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.371404 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371100 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-run-systemd\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.371404 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371126 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc5tn\" (UniqueName: \"kubernetes.io/projected/3ba7595c-0626-4561-8f94-ef72a6621ef1-kube-api-access-zc5tn\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.371404 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371154 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/70b71d45-9729-44bd-a29a-11e4a77e8937-device-dir\") pod \"aws-ebs-csi-driver-node-nssxg\" (UID: \"70b71d45-9729-44bd-a29a-11e4a77e8937\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nssxg" Jul 30 17:00:56.371404 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371181 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-etc-sysctl-conf\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.371404 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371209 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-host-run-multus-certs\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.371404 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371232 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/681ff1ad-fa48-420e-9501-d18e7a57a773-kubelet-config\") pod \"global-pull-secret-syncer-jhw42\" (UID: \"681ff1ad-fa48-420e-9501-d18e7a57a773\") " pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:00:56.371404 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371261 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-etc-modprobe-d\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.371404 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371280 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-multus-cni-dir\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.371404 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371295 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j9dv\" (UniqueName: \"kubernetes.io/projected/5dfaaf6d-53e5-4884-94e1-ff75d93560b5-kube-api-access-6j9dv\") pod \"iptables-alerter-6t9xr\" (UID: \"5dfaaf6d-53e5-4884-94e1-ff75d93560b5\") " pod="openshift-network-operator/iptables-alerter-6t9xr" Jul 30 17:00:56.371404 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371322 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l7ch\" (UniqueName: \"kubernetes.io/projected/41759fa3-9219-4210-9e10-5bf02dc9fb96-kube-api-access-2l7ch\") pod \"node-resolver-tb5cb\" (UID: \"41759fa3-9219-4210-9e10-5bf02dc9fb96\") " pod="openshift-dns/node-resolver-tb5cb" Jul 30 17:00:56.371404 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371348 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/70b71d45-9729-44bd-a29a-11e4a77e8937-registration-dir\") pod \"aws-ebs-csi-driver-node-nssxg\" (UID: \"70b71d45-9729-44bd-a29a-11e4a77e8937\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nssxg" Jul 30 17:00:56.371404 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371373 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/33961af5-8f26-48ff-98de-e0340507e385-host\") pod \"node-ca-4wsb4\" (UID: \"33961af5-8f26-48ff-98de-e0340507e385\") " pod="openshift-image-registry/node-ca-4wsb4" Jul 30 17:00:56.371404 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371395 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fdebda4-24ac-4c03-a395-a0e29dc51625-metrics-certs\") pod \"network-metrics-daemon-8vjz8\" (UID: \"3fdebda4-24ac-4c03-a395-a0e29dc51625\") " pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:00:56.371404 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371406 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/70b71d45-9729-44bd-a29a-11e4a77e8937-device-dir\") pod \"aws-ebs-csi-driver-node-nssxg\" (UID: \"70b71d45-9729-44bd-a29a-11e4a77e8937\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nssxg" Jul 30 17:00:56.372264 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371416 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-host-run-k8s-cni-cncf-io\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.372264 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371418 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5dfaaf6d-53e5-4884-94e1-ff75d93560b5-host-slash\") pod \"iptables-alerter-6t9xr\" (UID: \"5dfaaf6d-53e5-4884-94e1-ff75d93560b5\") " pod="openshift-network-operator/iptables-alerter-6t9xr" Jul 30 17:00:56.372264 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371438 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3-konnectivity-ca\") pod \"konnectivity-agent-wvmx2\" (UID: \"c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3\") " pod="kube-system/konnectivity-agent-wvmx2" Jul 30 17:00:56.372264 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371451 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-sys\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.372264 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371468 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b08e8de2-4dd8-4cde-b485-dc15f87d3915-cni-binary-copy\") pod \"multus-additional-cni-plugins-8zvvk\" (UID: \"b08e8de2-4dd8-4cde-b485-dc15f87d3915\") " pod="openshift-multus/multus-additional-cni-plugins-8zvvk" Jul 30 17:00:56.372264 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371505 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/70b71d45-9729-44bd-a29a-11e4a77e8937-registration-dir\") pod \"aws-ebs-csi-driver-node-nssxg\" (UID: \"70b71d45-9729-44bd-a29a-11e4a77e8937\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nssxg" Jul 30 17:00:56.372264 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:56.371544 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 17:00:56.372264 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371548 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-sys\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.372264 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371584 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ffbe09e-50f3-487b-8c82-5b6f992c5410-cni-binary-copy\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.372264 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371602 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/33961af5-8f26-48ff-98de-e0340507e385-host\") pod \"node-ca-4wsb4\" (UID: \"33961af5-8f26-48ff-98de-e0340507e385\") " pod="openshift-image-registry/node-ca-4wsb4" Jul 30 17:00:56.372264 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371629 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-hostroot\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.372264 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371625 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-etc-sysctl-conf\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.372264 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371645 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-host-run-multus-certs\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.372264 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371687 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b08e8de2-4dd8-4cde-b485-dc15f87d3915-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8zvvk\" (UID: \"b08e8de2-4dd8-4cde-b485-dc15f87d3915\") " pod="openshift-multus/multus-additional-cni-plugins-8zvvk" Jul 30 17:00:56.372264 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371696 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-etc-modprobe-d\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.372264 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371713 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/33961af5-8f26-48ff-98de-e0340507e385-serviceca\") pod \"node-ca-4wsb4\" (UID: \"33961af5-8f26-48ff-98de-e0340507e385\") " pod="openshift-image-registry/node-ca-4wsb4" Jul 30 17:00:56.372264 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:56.371744 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fdebda4-24ac-4c03-a395-a0e29dc51625-metrics-certs podName:3fdebda4-24ac-4c03-a395-a0e29dc51625 nodeName:}" failed. No retries permitted until 2026-07-30 17:00:56.871721645 +0000 UTC m=+3.004568599 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3fdebda4-24ac-4c03-a395-a0e29dc51625-metrics-certs") pod "network-metrics-daemon-8vjz8" (UID: "3fdebda4-24ac-4c03-a395-a0e29dc51625") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 17:00:56.372979 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371769 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-host\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.372979 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371798 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-hostroot\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.372979 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371847 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/70b71d45-9729-44bd-a29a-11e4a77e8937-socket-dir\") pod \"aws-ebs-csi-driver-node-nssxg\" (UID: \"70b71d45-9729-44bd-a29a-11e4a77e8937\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nssxg" Jul 30 17:00:56.372979 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371880 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-var-lib-kubelet\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.372979 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371930 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-host-run-netns\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.372979 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371961 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b08e8de2-4dd8-4cde-b485-dc15f87d3915-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8zvvk\" (UID: \"b08e8de2-4dd8-4cde-b485-dc15f87d3915\") " pod="openshift-multus/multus-additional-cni-plugins-8zvvk" Jul 30 17:00:56.372979 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.371990 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-var-lib-kubelet\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.372979 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372017 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-host\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.372979 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372033 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-host-run-ovn-kubernetes\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.372979 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372063 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-run\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.372979 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372087 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8whx9\" (UniqueName: \"kubernetes.io/projected/b08e8de2-4dd8-4cde-b485-dc15f87d3915-kube-api-access-8whx9\") pod \"multus-additional-cni-plugins-8zvvk\" (UID: \"b08e8de2-4dd8-4cde-b485-dc15f87d3915\") " pod="openshift-multus/multus-additional-cni-plugins-8zvvk" Jul 30 17:00:56.372979 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372131 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/70b71d45-9729-44bd-a29a-11e4a77e8937-socket-dir\") pod \"aws-ebs-csi-driver-node-nssxg\" (UID: \"70b71d45-9729-44bd-a29a-11e4a77e8937\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nssxg" Jul 30 17:00:56.372979 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372136 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5dfaaf6d-53e5-4884-94e1-ff75d93560b5-iptables-alerter-script\") pod \"iptables-alerter-6t9xr\" (UID: \"5dfaaf6d-53e5-4884-94e1-ff75d93560b5\") " pod="openshift-network-operator/iptables-alerter-6t9xr" Jul 30 17:00:56.372979 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372160 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-node-log\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.372979 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372181 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-host-cni-bin\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.372979 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372206 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3ba7595c-0626-4561-8f94-ef72a6621ef1-env-overrides\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.372979 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372233 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-etc-systemd\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.373738 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372291 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b08e8de2-4dd8-4cde-b485-dc15f87d3915-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8zvvk\" (UID: \"b08e8de2-4dd8-4cde-b485-dc15f87d3915\") " pod="openshift-multus/multus-additional-cni-plugins-8zvvk" Jul 30 17:00:56.373738 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372306 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b08e8de2-4dd8-4cde-b485-dc15f87d3915-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8zvvk\" (UID: \"b08e8de2-4dd8-4cde-b485-dc15f87d3915\") " pod="openshift-multus/multus-additional-cni-plugins-8zvvk" Jul 30 17:00:56.373738 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372317 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/33961af5-8f26-48ff-98de-e0340507e385-serviceca\") pod \"node-ca-4wsb4\" (UID: \"33961af5-8f26-48ff-98de-e0340507e385\") " pod="openshift-image-registry/node-ca-4wsb4" Jul 30 17:00:56.373738 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372296 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-system-cni-dir\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.373738 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372343 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-etc-systemd\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.373738 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372344 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-system-cni-dir\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.373738 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372368 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-multus-socket-dir-parent\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.373738 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372384 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-run\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.373738 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372417 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41759fa3-9219-4210-9e10-5bf02dc9fb96-tmp-dir\") pod \"node-resolver-tb5cb\" (UID: \"41759fa3-9219-4210-9e10-5bf02dc9fb96\") " pod="openshift-dns/node-resolver-tb5cb" Jul 30 17:00:56.373738 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372420 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-host-run-netns\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.373738 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372464 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b08e8de2-4dd8-4cde-b485-dc15f87d3915-cnibin\") pod \"multus-additional-cni-plugins-8zvvk\" (UID: \"b08e8de2-4dd8-4cde-b485-dc15f87d3915\") " pod="openshift-multus/multus-additional-cni-plugins-8zvvk" Jul 30 17:00:56.373738 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372468 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-multus-socket-dir-parent\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.373738 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372508 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3ba7595c-0626-4561-8f94-ef72a6621ef1-ovnkube-config\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.373738 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372551 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-etc-sysctl-d\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.373738 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372561 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b08e8de2-4dd8-4cde-b485-dc15f87d3915-cnibin\") pod \"multus-additional-cni-plugins-8zvvk\" (UID: \"b08e8de2-4dd8-4cde-b485-dc15f87d3915\") " pod="openshift-multus/multus-additional-cni-plugins-8zvvk" Jul 30 17:00:56.373738 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372587 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ffbe09e-50f3-487b-8c82-5b6f992c5410-cni-binary-copy\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.373738 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372600 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/70b71d45-9729-44bd-a29a-11e4a77e8937-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nssxg\" (UID: \"70b71d45-9729-44bd-a29a-11e4a77e8937\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nssxg" Jul 30 17:00:56.373738 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372629 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-lib-modules\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.374685 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372672 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-etc-sysctl-d\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.374685 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372678 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/70b71d45-9729-44bd-a29a-11e4a77e8937-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nssxg\" (UID: \"70b71d45-9729-44bd-a29a-11e4a77e8937\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nssxg" Jul 30 17:00:56.374685 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372724 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-host-var-lib-kubelet\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.374685 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372806 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b08e8de2-4dd8-4cde-b485-dc15f87d3915-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8zvvk\" (UID: \"b08e8de2-4dd8-4cde-b485-dc15f87d3915\") " pod="openshift-multus/multus-additional-cni-plugins-8zvvk" Jul 30 17:00:56.374685 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372814 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-lib-modules\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.374685 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372839 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3-agent-certs\") pod \"konnectivity-agent-wvmx2\" (UID: \"c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3\") " pod="kube-system/konnectivity-agent-wvmx2" Jul 30 17:00:56.374685 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372843 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-host-var-lib-kubelet\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.374685 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372872 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjnt9\" (UniqueName: \"kubernetes.io/projected/33961af5-8f26-48ff-98de-e0340507e385-kube-api-access-wjnt9\") pod \"node-ca-4wsb4\" (UID: \"33961af5-8f26-48ff-98de-e0340507e385\") " pod="openshift-image-registry/node-ca-4wsb4" Jul 30 17:00:56.374685 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372896 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z2lz\" (UniqueName: \"kubernetes.io/projected/3fdebda4-24ac-4c03-a395-a0e29dc51625-kube-api-access-6z2lz\") pod \"network-metrics-daemon-8vjz8\" (UID: \"3fdebda4-24ac-4c03-a395-a0e29dc51625\") " pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:00:56.374685 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372912 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/70b71d45-9729-44bd-a29a-11e4a77e8937-etc-selinux\") pod \"aws-ebs-csi-driver-node-nssxg\" (UID: \"70b71d45-9729-44bd-a29a-11e4a77e8937\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nssxg" Jul 30 17:00:56.374685 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372933 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-os-release\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.374685 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372957 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-host-var-lib-cni-bin\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.374685 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.372984 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b08e8de2-4dd8-4cde-b485-dc15f87d3915-os-release\") pod \"multus-additional-cni-plugins-8zvvk\" (UID: \"b08e8de2-4dd8-4cde-b485-dc15f87d3915\") " pod="openshift-multus/multus-additional-cni-plugins-8zvvk" Jul 30 17:00:56.374685 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373011 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-var-lib-openvswitch\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.374685 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373038 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-run-openvswitch\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.374685 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373062 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3ba7595c-0626-4561-8f94-ef72a6621ef1-ovnkube-script-lib\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.374685 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373090 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/70b71d45-9729-44bd-a29a-11e4a77e8937-sys-fs\") pod \"aws-ebs-csi-driver-node-nssxg\" (UID: \"70b71d45-9729-44bd-a29a-11e4a77e8937\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nssxg" Jul 30 17:00:56.375486 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373127 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/41759fa3-9219-4210-9e10-5bf02dc9fb96-hosts-file\") pod \"node-resolver-tb5cb\" (UID: \"41759fa3-9219-4210-9e10-5bf02dc9fb96\") " pod="openshift-dns/node-resolver-tb5cb" Jul 30 17:00:56.375486 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373154 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-host-kubelet\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.375486 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373192 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-cnibin\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.375486 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373219 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-host-var-lib-cni-multus\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.375486 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373244 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-multus-conf-dir\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.375486 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373269 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-host-cni-netd\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.375486 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373306 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kntd8\" (UniqueName: \"kubernetes.io/projected/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-kube-api-access-kntd8\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.375486 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373349 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b08e8de2-4dd8-4cde-b485-dc15f87d3915-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8zvvk\" (UID: \"b08e8de2-4dd8-4cde-b485-dc15f87d3915\") " pod="openshift-multus/multus-additional-cni-plugins-8zvvk" Jul 30 17:00:56.375486 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373398 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/70b71d45-9729-44bd-a29a-11e4a77e8937-etc-selinux\") pod \"aws-ebs-csi-driver-node-nssxg\" (UID: \"70b71d45-9729-44bd-a29a-11e4a77e8937\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nssxg" Jul 30 17:00:56.375486 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373432 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-etc-kubernetes\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.375486 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373431 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-cnibin\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.375486 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373492 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/70b71d45-9729-44bd-a29a-11e4a77e8937-sys-fs\") pod \"aws-ebs-csi-driver-node-nssxg\" (UID: \"70b71d45-9729-44bd-a29a-11e4a77e8937\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nssxg" Jul 30 17:00:56.375486 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373512 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-os-release\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.375486 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373529 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b08e8de2-4dd8-4cde-b485-dc15f87d3915-system-cni-dir\") pod \"multus-additional-cni-plugins-8zvvk\" (UID: \"b08e8de2-4dd8-4cde-b485-dc15f87d3915\") " pod="openshift-multus/multus-additional-cni-plugins-8zvvk" Jul 30 17:00:56.375486 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373551 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-host-var-lib-cni-multus\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.375486 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373552 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-host-var-lib-cni-bin\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.375486 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373561 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-host-slash\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.376010 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373623 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b08e8de2-4dd8-4cde-b485-dc15f87d3915-os-release\") pod \"multus-additional-cni-plugins-8zvvk\" (UID: \"b08e8de2-4dd8-4cde-b485-dc15f87d3915\") " pod="openshift-multus/multus-additional-cni-plugins-8zvvk" Jul 30 17:00:56.376010 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373632 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-etc-openvswitch\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.376010 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373657 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b08e8de2-4dd8-4cde-b485-dc15f87d3915-system-cni-dir\") pod \"multus-additional-cni-plugins-8zvvk\" (UID: \"b08e8de2-4dd8-4cde-b485-dc15f87d3915\") " pod="openshift-multus/multus-additional-cni-plugins-8zvvk" Jul 30 17:00:56.376010 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373687 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-run-ovn\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.376010 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373688 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-multus-conf-dir\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.376010 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373706 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.376010 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373752 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-etc-kubernetes\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.376010 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373780 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/681ff1ad-fa48-420e-9501-d18e7a57a773-dbus\") pod \"global-pull-secret-syncer-jhw42\" (UID: \"681ff1ad-fa48-420e-9501-d18e7a57a773\") " pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:00:56.376010 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373799 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3ffbe09e-50f3-487b-8c82-5b6f992c5410-multus-daemon-config\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.376010 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373848 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-etc-kubernetes\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.376010 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373923 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98f9n\" (UniqueName: \"kubernetes.io/projected/8400548d-00fa-439c-b7b9-3157adfd8f76-kube-api-access-98f9n\") pod \"network-check-target-hwbcz\" (UID: \"8400548d-00fa-439c-b7b9-3157adfd8f76\") " pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:00:56.376010 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373935 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ffbe09e-50f3-487b-8c82-5b6f992c5410-etc-kubernetes\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.376010 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.373962 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/681ff1ad-fa48-420e-9501-d18e7a57a773-original-pull-secret\") pod \"global-pull-secret-syncer-jhw42\" (UID: \"681ff1ad-fa48-420e-9501-d18e7a57a773\") " pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:00:56.376010 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.374316 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3ffbe09e-50f3-487b-8c82-5b6f992c5410-multus-daemon-config\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.376010 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.374885 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-etc-tuned\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.376010 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.374925 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-tmp\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.376010 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.375645 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3-agent-certs\") pod \"konnectivity-agent-wvmx2\" (UID: \"c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3\") " pod="kube-system/konnectivity-agent-wvmx2" Jul 30 17:00:56.381498 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:56.381376 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 17:00:56.381498 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:56.381407 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 17:00:56.381498 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:56.381425 2570 projected.go:196] Error preparing data for projected volume kube-api-access-98f9n for pod openshift-network-diagnostics/network-check-target-hwbcz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 17:00:56.381923 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:56.381513 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8400548d-00fa-439c-b7b9-3157adfd8f76-kube-api-access-98f9n podName:8400548d-00fa-439c-b7b9-3157adfd8f76 nodeName:}" failed. No retries permitted until 2026-07-30 17:00:56.881490103 +0000 UTC m=+3.014337062 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-98f9n" (UniqueName: "kubernetes.io/projected/8400548d-00fa-439c-b7b9-3157adfd8f76-kube-api-access-98f9n") pod "network-check-target-hwbcz" (UID: "8400548d-00fa-439c-b7b9-3157adfd8f76") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 17:00:56.383223 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.383196 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtjw9\" (UniqueName: \"kubernetes.io/projected/70b71d45-9729-44bd-a29a-11e4a77e8937-kube-api-access-vtjw9\") pod \"aws-ebs-csi-driver-node-nssxg\" (UID: \"70b71d45-9729-44bd-a29a-11e4a77e8937\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nssxg" Jul 30 17:00:56.383371 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.383356 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6tcs\" (UniqueName: \"kubernetes.io/projected/3ffbe09e-50f3-487b-8c82-5b6f992c5410-kube-api-access-p6tcs\") pod \"multus-ssvk2\" (UID: \"3ffbe09e-50f3-487b-8c82-5b6f992c5410\") " pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.383791 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.383770 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjnt9\" (UniqueName: \"kubernetes.io/projected/33961af5-8f26-48ff-98de-e0340507e385-kube-api-access-wjnt9\") pod \"node-ca-4wsb4\" (UID: \"33961af5-8f26-48ff-98de-e0340507e385\") " pod="openshift-image-registry/node-ca-4wsb4" Jul 30 17:00:56.384132 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.384109 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8whx9\" (UniqueName: \"kubernetes.io/projected/b08e8de2-4dd8-4cde-b485-dc15f87d3915-kube-api-access-8whx9\") pod \"multus-additional-cni-plugins-8zvvk\" (UID: \"b08e8de2-4dd8-4cde-b485-dc15f87d3915\") " pod="openshift-multus/multus-additional-cni-plugins-8zvvk" Jul 30 17:00:56.384882 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.384860 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z2lz\" (UniqueName: \"kubernetes.io/projected/3fdebda4-24ac-4c03-a395-a0e29dc51625-kube-api-access-6z2lz\") pod \"network-metrics-daemon-8vjz8\" (UID: \"3fdebda4-24ac-4c03-a395-a0e29dc51625\") " pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:00:56.384971 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.384936 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kntd8\" (UniqueName: \"kubernetes.io/projected/6d100ab6-7f70-4ec4-a23f-58b7badc9b93-kube-api-access-kntd8\") pod \"tuned-v2thn\" (UID: \"6d100ab6-7f70-4ec4-a23f-58b7badc9b93\") " pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.446200 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.446169 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 17:00:56.462682 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.462627 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-120.ec2.internal" event={"ID":"3492ed6927be9f82b217829acc311662","Type":"ContainerStarted","Data":"13dec8541233644708107a6663dab0068eef89e0f506e55d94956d623c3ce9f8"} Jul 30 17:00:56.463717 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.463693 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal" event={"ID":"d53d46ebf7b711813c5a52cde689ce59","Type":"ContainerStarted","Data":"ae3dea4ee407dab4828bba8093b4f54cebfea9e6c659bb6cf9ddc911a4846cac"} Jul 30 17:00:56.474825 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.474792 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-var-lib-openvswitch\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.474825 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.474827 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-run-openvswitch\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.475087 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.474844 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3ba7595c-0626-4561-8f94-ef72a6621ef1-ovnkube-script-lib\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.475087 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.474864 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/41759fa3-9219-4210-9e10-5bf02dc9fb96-hosts-file\") pod \"node-resolver-tb5cb\" (UID: \"41759fa3-9219-4210-9e10-5bf02dc9fb96\") " pod="openshift-dns/node-resolver-tb5cb" Jul 30 17:00:56.475087 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.474920 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/41759fa3-9219-4210-9e10-5bf02dc9fb96-hosts-file\") pod \"node-resolver-tb5cb\" (UID: \"41759fa3-9219-4210-9e10-5bf02dc9fb96\") " pod="openshift-dns/node-resolver-tb5cb" Jul 30 17:00:56.475087 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.474917 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-var-lib-openvswitch\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.475087 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.474918 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-run-openvswitch\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.475087 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.474966 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-host-kubelet\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.475087 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475004 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-host-cni-netd\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.475087 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475030 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-host-slash\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.475087 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475058 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-host-cni-netd\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.475087 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475060 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-etc-openvswitch\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.475458 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475097 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-run-ovn\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.475458 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475036 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-host-kubelet\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.475458 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475099 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-etc-openvswitch\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.475458 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475132 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.475458 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475151 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-run-ovn\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.475458 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475162 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/681ff1ad-fa48-420e-9501-d18e7a57a773-dbus\") pod \"global-pull-secret-syncer-jhw42\" (UID: \"681ff1ad-fa48-420e-9501-d18e7a57a773\") " pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:00:56.475458 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475135 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-host-slash\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.475458 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475210 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/681ff1ad-fa48-420e-9501-d18e7a57a773-original-pull-secret\") pod \"global-pull-secret-syncer-jhw42\" (UID: \"681ff1ad-fa48-420e-9501-d18e7a57a773\") " pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:00:56.475458 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475216 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/681ff1ad-fa48-420e-9501-d18e7a57a773-dbus\") pod \"global-pull-secret-syncer-jhw42\" (UID: \"681ff1ad-fa48-420e-9501-d18e7a57a773\") " pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:00:56.475458 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475171 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.475458 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475273 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-systemd-units\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.475458 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475298 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-host-run-netns\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.475458 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:56.475310 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 17:00:56.475458 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475314 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-systemd-units\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.475458 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475318 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-log-socket\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.475458 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475342 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-host-run-netns\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.475458 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475346 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-log-socket\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.475458 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475352 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ba7595c-0626-4561-8f94-ef72a6621ef1-ovn-node-metrics-cert\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.476334 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:56.475388 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/681ff1ad-fa48-420e-9501-d18e7a57a773-original-pull-secret podName:681ff1ad-fa48-420e-9501-d18e7a57a773 nodeName:}" failed. No retries permitted until 2026-07-30 17:00:56.975367044 +0000 UTC m=+3.108213995 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/681ff1ad-fa48-420e-9501-d18e7a57a773-original-pull-secret") pod "global-pull-secret-syncer-jhw42" (UID: "681ff1ad-fa48-420e-9501-d18e7a57a773") : object "kube-system"/"original-pull-secret" not registered Jul 30 17:00:56.476334 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475452 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-run-systemd\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.476334 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475481 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc5tn\" (UniqueName: \"kubernetes.io/projected/3ba7595c-0626-4561-8f94-ef72a6621ef1-kube-api-access-zc5tn\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.476334 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475511 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/681ff1ad-fa48-420e-9501-d18e7a57a773-kubelet-config\") pod \"global-pull-secret-syncer-jhw42\" (UID: \"681ff1ad-fa48-420e-9501-d18e7a57a773\") " pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:00:56.476334 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475539 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j9dv\" (UniqueName: \"kubernetes.io/projected/5dfaaf6d-53e5-4884-94e1-ff75d93560b5-kube-api-access-6j9dv\") pod \"iptables-alerter-6t9xr\" (UID: \"5dfaaf6d-53e5-4884-94e1-ff75d93560b5\") " pod="openshift-network-operator/iptables-alerter-6t9xr" Jul 30 17:00:56.476334 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475559 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3ba7595c-0626-4561-8f94-ef72a6621ef1-ovnkube-script-lib\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.476334 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475598 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l7ch\" (UniqueName: \"kubernetes.io/projected/41759fa3-9219-4210-9e10-5bf02dc9fb96-kube-api-access-2l7ch\") pod \"node-resolver-tb5cb\" (UID: \"41759fa3-9219-4210-9e10-5bf02dc9fb96\") " pod="openshift-dns/node-resolver-tb5cb" Jul 30 17:00:56.476334 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475635 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5dfaaf6d-53e5-4884-94e1-ff75d93560b5-host-slash\") pod \"iptables-alerter-6t9xr\" (UID: \"5dfaaf6d-53e5-4884-94e1-ff75d93560b5\") " pod="openshift-network-operator/iptables-alerter-6t9xr" Jul 30 17:00:56.476334 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475660 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-host-run-ovn-kubernetes\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.476334 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475678 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5dfaaf6d-53e5-4884-94e1-ff75d93560b5-iptables-alerter-script\") pod \"iptables-alerter-6t9xr\" (UID: \"5dfaaf6d-53e5-4884-94e1-ff75d93560b5\") " pod="openshift-network-operator/iptables-alerter-6t9xr" Jul 30 17:00:56.476334 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475703 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/681ff1ad-fa48-420e-9501-d18e7a57a773-kubelet-config\") pod \"global-pull-secret-syncer-jhw42\" (UID: \"681ff1ad-fa48-420e-9501-d18e7a57a773\") " pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:00:56.476334 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475704 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-node-log\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.476334 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475743 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-host-run-ovn-kubernetes\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.476334 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475754 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5dfaaf6d-53e5-4884-94e1-ff75d93560b5-host-slash\") pod \"iptables-alerter-6t9xr\" (UID: \"5dfaaf6d-53e5-4884-94e1-ff75d93560b5\") " pod="openshift-network-operator/iptables-alerter-6t9xr" Jul 30 17:00:56.476334 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475773 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-run-systemd\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.476334 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475760 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-host-cni-bin\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.476859 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475798 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-host-cni-bin\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.476859 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475798 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3ba7595c-0626-4561-8f94-ef72a6621ef1-node-log\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.476859 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475812 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3ba7595c-0626-4561-8f94-ef72a6621ef1-env-overrides\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.476859 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475844 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41759fa3-9219-4210-9e10-5bf02dc9fb96-tmp-dir\") pod \"node-resolver-tb5cb\" (UID: \"41759fa3-9219-4210-9e10-5bf02dc9fb96\") " pod="openshift-dns/node-resolver-tb5cb" Jul 30 17:00:56.476859 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.475866 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3ba7595c-0626-4561-8f94-ef72a6621ef1-ovnkube-config\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.476859 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.476196 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41759fa3-9219-4210-9e10-5bf02dc9fb96-tmp-dir\") pod \"node-resolver-tb5cb\" (UID: \"41759fa3-9219-4210-9e10-5bf02dc9fb96\") " pod="openshift-dns/node-resolver-tb5cb" Jul 30 17:00:56.476859 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.476368 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5dfaaf6d-53e5-4884-94e1-ff75d93560b5-iptables-alerter-script\") pod \"iptables-alerter-6t9xr\" (UID: \"5dfaaf6d-53e5-4884-94e1-ff75d93560b5\") " pod="openshift-network-operator/iptables-alerter-6t9xr" Jul 30 17:00:56.477408 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.477378 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3ba7595c-0626-4561-8f94-ef72a6621ef1-env-overrides\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.477555 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.477528 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3ba7595c-0626-4561-8f94-ef72a6621ef1-ovnkube-config\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.477919 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.477882 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ba7595c-0626-4561-8f94-ef72a6621ef1-ovn-node-metrics-cert\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.484017 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.483985 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l7ch\" (UniqueName: \"kubernetes.io/projected/41759fa3-9219-4210-9e10-5bf02dc9fb96-kube-api-access-2l7ch\") pod \"node-resolver-tb5cb\" (UID: \"41759fa3-9219-4210-9e10-5bf02dc9fb96\") " pod="openshift-dns/node-resolver-tb5cb" Jul 30 17:00:56.484387 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.484362 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc5tn\" (UniqueName: \"kubernetes.io/projected/3ba7595c-0626-4561-8f94-ef72a6621ef1-kube-api-access-zc5tn\") pod \"ovnkube-node-77btm\" (UID: \"3ba7595c-0626-4561-8f94-ef72a6621ef1\") " pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.484447 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.484423 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j9dv\" (UniqueName: \"kubernetes.io/projected/5dfaaf6d-53e5-4884-94e1-ff75d93560b5-kube-api-access-6j9dv\") pod \"iptables-alerter-6t9xr\" (UID: \"5dfaaf6d-53e5-4884-94e1-ff75d93560b5\") " pod="openshift-network-operator/iptables-alerter-6t9xr" Jul 30 17:00:56.565624 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.565494 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8zvvk" Jul 30 17:00:56.572934 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.572714 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v2thn" Jul 30 17:00:56.584913 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.584881 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nssxg" Jul 30 17:00:56.586049 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.585965 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wvmx2" Jul 30 17:00:56.598139 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.590760 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4wsb4" Jul 30 17:00:56.598878 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.598386 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ssvk2" Jul 30 17:00:56.603890 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.603862 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6t9xr" Jul 30 17:00:56.611302 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.611273 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:00:56.615326 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.615289 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tb5cb" Jul 30 17:00:56.625771 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:56.625727 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70b71d45_9729_44bd_a29a_11e4a77e8937.slice/crio-10a2d5307213947a7c93c088686eae3fbff7807e46b480dacc3ccf6f406c1d60 WatchSource:0}: Error finding container 10a2d5307213947a7c93c088686eae3fbff7807e46b480dacc3ccf6f406c1d60: Status 404 returned error can't find the container with id 10a2d5307213947a7c93c088686eae3fbff7807e46b480dacc3ccf6f406c1d60 Jul 30 17:00:56.627752 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:56.627722 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ffbe09e_50f3_487b_8c82_5b6f992c5410.slice/crio-4e459a884f6194fbcb4c8da102d0ee9495145f84c1a544c064cbacd5d2d1fc13 WatchSource:0}: Error finding container 4e459a884f6194fbcb4c8da102d0ee9495145f84c1a544c064cbacd5d2d1fc13: Status 404 returned error can't find the container with id 4e459a884f6194fbcb4c8da102d0ee9495145f84c1a544c064cbacd5d2d1fc13 Jul 30 17:00:56.630468 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:56.630441 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc29dde6b_4cd2_45b3_8c4c_ec991ed5adb3.slice/crio-dde885b2e392e0036d40e1346205af2e154215efbaa264ee1ed57941dec5f137 WatchSource:0}: Error finding container dde885b2e392e0036d40e1346205af2e154215efbaa264ee1ed57941dec5f137: Status 404 returned error can't find the container with id dde885b2e392e0036d40e1346205af2e154215efbaa264ee1ed57941dec5f137 Jul 30 17:00:56.640506 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:56.640473 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33961af5_8f26_48ff_98de_e0340507e385.slice/crio-3c7c55ec7a7a954c19f0f74928b5655b04e0dbe6be6a683f5aca2c9fcdd94d90 WatchSource:0}: Error finding container 3c7c55ec7a7a954c19f0f74928b5655b04e0dbe6be6a683f5aca2c9fcdd94d90: Status 404 returned error can't find the container with id 3c7c55ec7a7a954c19f0f74928b5655b04e0dbe6be6a683f5aca2c9fcdd94d90 Jul 30 17:00:56.646498 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:00:56.646463 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41759fa3_9219_4210_9e10_5bf02dc9fb96.slice/crio-f3f889c0872ad4b162a24d90ecdad7d0cad6c15b460afeb1b372c9338715d382 WatchSource:0}: Error finding container f3f889c0872ad4b162a24d90ecdad7d0cad6c15b460afeb1b372c9338715d382: Status 404 returned error can't find the container with id f3f889c0872ad4b162a24d90ecdad7d0cad6c15b460afeb1b372c9338715d382 Jul 30 17:00:56.673354 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.673125 2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 17:00:56.880457 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.880353 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fdebda4-24ac-4c03-a395-a0e29dc51625-metrics-certs\") pod \"network-metrics-daemon-8vjz8\" (UID: \"3fdebda4-24ac-4c03-a395-a0e29dc51625\") " pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:00:56.880646 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:56.880508 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 17:00:56.880646 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:56.880581 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fdebda4-24ac-4c03-a395-a0e29dc51625-metrics-certs podName:3fdebda4-24ac-4c03-a395-a0e29dc51625 nodeName:}" failed. No retries permitted until 2026-07-30 17:00:57.880560475 +0000 UTC m=+4.013407434 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3fdebda4-24ac-4c03-a395-a0e29dc51625-metrics-certs") pod "network-metrics-daemon-8vjz8" (UID: "3fdebda4-24ac-4c03-a395-a0e29dc51625") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 17:00:56.980765 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.980724 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98f9n\" (UniqueName: \"kubernetes.io/projected/8400548d-00fa-439c-b7b9-3157adfd8f76-kube-api-access-98f9n\") pod \"network-check-target-hwbcz\" (UID: \"8400548d-00fa-439c-b7b9-3157adfd8f76\") " pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:00:56.980765 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:56.980774 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/681ff1ad-fa48-420e-9501-d18e7a57a773-original-pull-secret\") pod \"global-pull-secret-syncer-jhw42\" (UID: \"681ff1ad-fa48-420e-9501-d18e7a57a773\") " pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:00:56.981155 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:56.980951 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 17:00:56.981155 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:56.980956 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 17:00:56.981155 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:56.980984 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 17:00:56.981155 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:56.980997 2570 projected.go:196] Error preparing data for projected volume kube-api-access-98f9n for pod openshift-network-diagnostics/network-check-target-hwbcz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 17:00:56.981155 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:56.981017 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/681ff1ad-fa48-420e-9501-d18e7a57a773-original-pull-secret podName:681ff1ad-fa48-420e-9501-d18e7a57a773 nodeName:}" failed. No retries permitted until 2026-07-30 17:00:57.980996042 +0000 UTC m=+4.113842979 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/681ff1ad-fa48-420e-9501-d18e7a57a773-original-pull-secret") pod "global-pull-secret-syncer-jhw42" (UID: "681ff1ad-fa48-420e-9501-d18e7a57a773") : object "kube-system"/"original-pull-secret" not registered Jul 30 17:00:56.981155 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:56.981050 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8400548d-00fa-439c-b7b9-3157adfd8f76-kube-api-access-98f9n podName:8400548d-00fa-439c-b7b9-3157adfd8f76 nodeName:}" failed. No retries permitted until 2026-07-30 17:00:57.981031268 +0000 UTC m=+4.113878214 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-98f9n" (UniqueName: "kubernetes.io/projected/8400548d-00fa-439c-b7b9-3157adfd8f76-kube-api-access-98f9n") pod "network-check-target-hwbcz" (UID: "8400548d-00fa-439c-b7b9-3157adfd8f76") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 17:00:57.308546 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:57.308414 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 16:55:56 +0000 UTC" deadline="2028-02-15 05:02:41.721079209 +0000 UTC" Jul 30 17:00:57.308546 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:57.308481 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13548h1m44.412603868s" Jul 30 17:00:57.469335 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:57.469194 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6t9xr" event={"ID":"5dfaaf6d-53e5-4884-94e1-ff75d93560b5","Type":"ContainerStarted","Data":"3e31a41fc908e2aa2f502ecd41ac41dd83a4894cf888a21924ab34c96766134c"} Jul 30 17:00:57.472043 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:57.471999 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wvmx2" event={"ID":"c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3","Type":"ContainerStarted","Data":"dde885b2e392e0036d40e1346205af2e154215efbaa264ee1ed57941dec5f137"} Jul 30 17:00:57.475018 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:57.474975 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nssxg" event={"ID":"70b71d45-9729-44bd-a29a-11e4a77e8937","Type":"ContainerStarted","Data":"10a2d5307213947a7c93c088686eae3fbff7807e46b480dacc3ccf6f406c1d60"} Jul 30 17:00:57.477280 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:57.477242 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v2thn" event={"ID":"6d100ab6-7f70-4ec4-a23f-58b7badc9b93","Type":"ContainerStarted","Data":"c9cbd329916e2170b18524b60415b725935ffd5ea3435f49133f586ed782cc84"} Jul 30 17:00:57.478855 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:57.478796 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tb5cb" event={"ID":"41759fa3-9219-4210-9e10-5bf02dc9fb96","Type":"ContainerStarted","Data":"f3f889c0872ad4b162a24d90ecdad7d0cad6c15b460afeb1b372c9338715d382"} Jul 30 17:00:57.480732 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:57.480627 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77btm" event={"ID":"3ba7595c-0626-4561-8f94-ef72a6621ef1","Type":"ContainerStarted","Data":"da4047be9df62a8e8ca1e0ee439f4d945959558ccbef6728060f3c93c2a1e62d"} Jul 30 17:00:57.482629 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:57.482544 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ssvk2" event={"ID":"3ffbe09e-50f3-487b-8c82-5b6f992c5410","Type":"ContainerStarted","Data":"4e459a884f6194fbcb4c8da102d0ee9495145f84c1a544c064cbacd5d2d1fc13"} Jul 30 17:00:57.484360 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:57.484289 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zvvk" event={"ID":"b08e8de2-4dd8-4cde-b485-dc15f87d3915","Type":"ContainerStarted","Data":"1335bcf3c6251a46a56e9a82b3a37c801455067df3d6d88624207e696a4ae032"} Jul 30 17:00:57.486231 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:57.486171 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4wsb4" event={"ID":"33961af5-8f26-48ff-98de-e0340507e385","Type":"ContainerStarted","Data":"3c7c55ec7a7a954c19f0f74928b5655b04e0dbe6be6a683f5aca2c9fcdd94d90"} Jul 30 17:00:57.888851 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:57.888809 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fdebda4-24ac-4c03-a395-a0e29dc51625-metrics-certs\") pod \"network-metrics-daemon-8vjz8\" (UID: \"3fdebda4-24ac-4c03-a395-a0e29dc51625\") " pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:00:57.889051 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:57.889009 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 17:00:57.889113 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:57.889083 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fdebda4-24ac-4c03-a395-a0e29dc51625-metrics-certs podName:3fdebda4-24ac-4c03-a395-a0e29dc51625 nodeName:}" failed. No retries permitted until 2026-07-30 17:00:59.889061787 +0000 UTC m=+6.021908747 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3fdebda4-24ac-4c03-a395-a0e29dc51625-metrics-certs") pod "network-metrics-daemon-8vjz8" (UID: "3fdebda4-24ac-4c03-a395-a0e29dc51625") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 17:00:57.990144 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:57.990100 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98f9n\" (UniqueName: \"kubernetes.io/projected/8400548d-00fa-439c-b7b9-3157adfd8f76-kube-api-access-98f9n\") pod \"network-check-target-hwbcz\" (UID: \"8400548d-00fa-439c-b7b9-3157adfd8f76\") " pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:00:57.990344 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:57.990156 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/681ff1ad-fa48-420e-9501-d18e7a57a773-original-pull-secret\") pod \"global-pull-secret-syncer-jhw42\" (UID: \"681ff1ad-fa48-420e-9501-d18e7a57a773\") " pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:00:57.990344 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:57.990289 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 17:00:57.990465 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:57.990352 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 17:00:57.990465 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:57.990382 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 17:00:57.990465 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:57.990400 2570 projected.go:196] Error preparing data for projected volume kube-api-access-98f9n for pod openshift-network-diagnostics/network-check-target-hwbcz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 17:00:57.990465 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:57.990361 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/681ff1ad-fa48-420e-9501-d18e7a57a773-original-pull-secret podName:681ff1ad-fa48-420e-9501-d18e7a57a773 nodeName:}" failed. No retries permitted until 2026-07-30 17:00:59.990339479 +0000 UTC m=+6.123186444 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/681ff1ad-fa48-420e-9501-d18e7a57a773-original-pull-secret") pod "global-pull-secret-syncer-jhw42" (UID: "681ff1ad-fa48-420e-9501-d18e7a57a773") : object "kube-system"/"original-pull-secret" not registered Jul 30 17:00:57.990696 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:57.990478 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8400548d-00fa-439c-b7b9-3157adfd8f76-kube-api-access-98f9n podName:8400548d-00fa-439c-b7b9-3157adfd8f76 nodeName:}" failed. No retries permitted until 2026-07-30 17:00:59.990459109 +0000 UTC m=+6.123306052 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-98f9n" (UniqueName: "kubernetes.io/projected/8400548d-00fa-439c-b7b9-3157adfd8f76-kube-api-access-98f9n") pod "network-check-target-hwbcz" (UID: "8400548d-00fa-439c-b7b9-3157adfd8f76") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 17:00:58.309683 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:58.309607 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 16:55:56 +0000 UTC" deadline="2028-04-06 02:30:08.717504044 +0000 UTC" Jul 30 17:00:58.309683 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:58.309680 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14769h29m10.407830717s" Jul 30 17:00:58.459324 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:58.459264 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:00:58.459527 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:58.459431 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8vjz8" podUID="3fdebda4-24ac-4c03-a395-a0e29dc51625" Jul 30 17:00:58.459972 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:58.459925 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:00:58.460086 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:58.460054 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwbcz" podUID="8400548d-00fa-439c-b7b9-3157adfd8f76" Jul 30 17:00:58.460289 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:58.460168 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:00:58.460289 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:58.460257 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhw42" podUID="681ff1ad-fa48-420e-9501-d18e7a57a773" Jul 30 17:00:59.910320 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:00:59.910282 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fdebda4-24ac-4c03-a395-a0e29dc51625-metrics-certs\") pod \"network-metrics-daemon-8vjz8\" (UID: \"3fdebda4-24ac-4c03-a395-a0e29dc51625\") " pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:00:59.910846 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:59.910517 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 17:00:59.910846 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:00:59.910612 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fdebda4-24ac-4c03-a395-a0e29dc51625-metrics-certs podName:3fdebda4-24ac-4c03-a395-a0e29dc51625 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:03.910569521 +0000 UTC m=+10.043416477 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3fdebda4-24ac-4c03-a395-a0e29dc51625-metrics-certs") pod "network-metrics-daemon-8vjz8" (UID: "3fdebda4-24ac-4c03-a395-a0e29dc51625") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 17:01:00.011833 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:00.010854 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98f9n\" (UniqueName: \"kubernetes.io/projected/8400548d-00fa-439c-b7b9-3157adfd8f76-kube-api-access-98f9n\") pod \"network-check-target-hwbcz\" (UID: \"8400548d-00fa-439c-b7b9-3157adfd8f76\") " pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:01:00.011833 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:00.010912 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/681ff1ad-fa48-420e-9501-d18e7a57a773-original-pull-secret\") pod \"global-pull-secret-syncer-jhw42\" (UID: \"681ff1ad-fa48-420e-9501-d18e7a57a773\") " pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:01:00.011833 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:00.011116 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 17:01:00.011833 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:00.011195 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/681ff1ad-fa48-420e-9501-d18e7a57a773-original-pull-secret podName:681ff1ad-fa48-420e-9501-d18e7a57a773 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:04.011172582 +0000 UTC m=+10.144019521 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/681ff1ad-fa48-420e-9501-d18e7a57a773-original-pull-secret") pod "global-pull-secret-syncer-jhw42" (UID: "681ff1ad-fa48-420e-9501-d18e7a57a773") : object "kube-system"/"original-pull-secret" not registered Jul 30 17:01:00.011833 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:00.011322 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 17:01:00.011833 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:00.011341 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 17:01:00.011833 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:00.011355 2570 projected.go:196] Error preparing data for projected volume kube-api-access-98f9n for pod openshift-network-diagnostics/network-check-target-hwbcz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 17:01:00.011833 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:00.011408 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8400548d-00fa-439c-b7b9-3157adfd8f76-kube-api-access-98f9n podName:8400548d-00fa-439c-b7b9-3157adfd8f76 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:04.011385513 +0000 UTC m=+10.144232451 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-98f9n" (UniqueName: "kubernetes.io/projected/8400548d-00fa-439c-b7b9-3157adfd8f76-kube-api-access-98f9n") pod "network-check-target-hwbcz" (UID: "8400548d-00fa-439c-b7b9-3157adfd8f76") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 17:01:00.459393 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:00.459312 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:01:00.459951 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:00.459453 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwbcz" podUID="8400548d-00fa-439c-b7b9-3157adfd8f76" Jul 30 17:01:00.459951 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:00.459601 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:01:00.459951 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:00.459739 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8vjz8" podUID="3fdebda4-24ac-4c03-a395-a0e29dc51625" Jul 30 17:01:00.459951 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:00.459312 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:01:00.459951 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:00.459832 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhw42" podUID="681ff1ad-fa48-420e-9501-d18e7a57a773" Jul 30 17:01:02.459314 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:02.458792 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:01:02.459314 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:02.458792 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:01:02.459314 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:02.458951 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhw42" podUID="681ff1ad-fa48-420e-9501-d18e7a57a773" Jul 30 17:01:02.459314 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:02.459009 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:01:02.459314 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:02.459111 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwbcz" podUID="8400548d-00fa-439c-b7b9-3157adfd8f76" Jul 30 17:01:02.459314 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:02.459199 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8vjz8" podUID="3fdebda4-24ac-4c03-a395-a0e29dc51625" Jul 30 17:01:03.942135 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:03.942087 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fdebda4-24ac-4c03-a395-a0e29dc51625-metrics-certs\") pod \"network-metrics-daemon-8vjz8\" (UID: \"3fdebda4-24ac-4c03-a395-a0e29dc51625\") " pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:01:03.942698 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:03.942268 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 17:01:03.942698 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:03.942357 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fdebda4-24ac-4c03-a395-a0e29dc51625-metrics-certs podName:3fdebda4-24ac-4c03-a395-a0e29dc51625 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:11.942334734 +0000 UTC m=+18.075181669 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3fdebda4-24ac-4c03-a395-a0e29dc51625-metrics-certs") pod "network-metrics-daemon-8vjz8" (UID: "3fdebda4-24ac-4c03-a395-a0e29dc51625") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 17:01:04.042740 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:04.042706 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98f9n\" (UniqueName: \"kubernetes.io/projected/8400548d-00fa-439c-b7b9-3157adfd8f76-kube-api-access-98f9n\") pod \"network-check-target-hwbcz\" (UID: \"8400548d-00fa-439c-b7b9-3157adfd8f76\") " pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:01:04.042740 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:04.042751 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/681ff1ad-fa48-420e-9501-d18e7a57a773-original-pull-secret\") pod \"global-pull-secret-syncer-jhw42\" (UID: \"681ff1ad-fa48-420e-9501-d18e7a57a773\") " pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:01:04.042971 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:04.042867 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 17:01:04.042971 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:04.042899 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 17:01:04.042971 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:04.042927 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 17:01:04.042971 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:04.042936 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/681ff1ad-fa48-420e-9501-d18e7a57a773-original-pull-secret podName:681ff1ad-fa48-420e-9501-d18e7a57a773 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:12.042915659 +0000 UTC m=+18.175762617 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/681ff1ad-fa48-420e-9501-d18e7a57a773-original-pull-secret") pod "global-pull-secret-syncer-jhw42" (UID: "681ff1ad-fa48-420e-9501-d18e7a57a773") : object "kube-system"/"original-pull-secret" not registered Jul 30 17:01:04.042971 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:04.042941 2570 projected.go:196] Error preparing data for projected volume kube-api-access-98f9n for pod openshift-network-diagnostics/network-check-target-hwbcz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 17:01:04.043246 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:04.042990 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8400548d-00fa-439c-b7b9-3157adfd8f76-kube-api-access-98f9n podName:8400548d-00fa-439c-b7b9-3157adfd8f76 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:12.042977946 +0000 UTC m=+18.175824884 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-98f9n" (UniqueName: "kubernetes.io/projected/8400548d-00fa-439c-b7b9-3157adfd8f76-kube-api-access-98f9n") pod "network-check-target-hwbcz" (UID: "8400548d-00fa-439c-b7b9-3157adfd8f76") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 17:01:04.459285 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:04.459243 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:01:04.459474 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:04.459368 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwbcz" podUID="8400548d-00fa-439c-b7b9-3157adfd8f76" Jul 30 17:01:04.459534 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:04.459510 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:01:04.459724 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:04.459619 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhw42" podUID="681ff1ad-fa48-420e-9501-d18e7a57a773" Jul 30 17:01:04.459724 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:04.459655 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:01:04.459917 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:04.459767 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8vjz8" podUID="3fdebda4-24ac-4c03-a395-a0e29dc51625" Jul 30 17:01:06.458428 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:06.458393 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:01:06.458923 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:06.458461 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:01:06.458923 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:06.458468 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:01:06.458923 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:06.458595 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8vjz8" podUID="3fdebda4-24ac-4c03-a395-a0e29dc51625" Jul 30 17:01:06.458923 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:06.458724 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhw42" podUID="681ff1ad-fa48-420e-9501-d18e7a57a773" Jul 30 17:01:06.458923 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:06.458801 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwbcz" podUID="8400548d-00fa-439c-b7b9-3157adfd8f76" Jul 30 17:01:08.458589 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:08.458540 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:01:08.459038 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:08.458559 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:01:08.459038 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:08.458694 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhw42" podUID="681ff1ad-fa48-420e-9501-d18e7a57a773" Jul 30 17:01:08.459038 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:08.458540 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:01:08.459038 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:08.458851 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8vjz8" podUID="3fdebda4-24ac-4c03-a395-a0e29dc51625" Jul 30 17:01:08.459038 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:08.458933 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwbcz" podUID="8400548d-00fa-439c-b7b9-3157adfd8f76" Jul 30 17:01:10.458578 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:10.458524 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:01:10.459015 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:10.458593 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:01:10.459015 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:10.458655 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:01:10.459015 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:10.458675 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhw42" podUID="681ff1ad-fa48-420e-9501-d18e7a57a773" Jul 30 17:01:10.459015 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:10.458747 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwbcz" podUID="8400548d-00fa-439c-b7b9-3157adfd8f76" Jul 30 17:01:10.459015 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:10.458833 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8vjz8" podUID="3fdebda4-24ac-4c03-a395-a0e29dc51625" Jul 30 17:01:12.004255 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:12.004223 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fdebda4-24ac-4c03-a395-a0e29dc51625-metrics-certs\") pod \"network-metrics-daemon-8vjz8\" (UID: \"3fdebda4-24ac-4c03-a395-a0e29dc51625\") " pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:01:12.004652 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:12.004371 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 17:01:12.004652 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:12.004430 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fdebda4-24ac-4c03-a395-a0e29dc51625-metrics-certs podName:3fdebda4-24ac-4c03-a395-a0e29dc51625 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:28.004414711 +0000 UTC m=+34.137261644 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3fdebda4-24ac-4c03-a395-a0e29dc51625-metrics-certs") pod "network-metrics-daemon-8vjz8" (UID: "3fdebda4-24ac-4c03-a395-a0e29dc51625") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 17:01:12.104798 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:12.104766 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98f9n\" (UniqueName: \"kubernetes.io/projected/8400548d-00fa-439c-b7b9-3157adfd8f76-kube-api-access-98f9n\") pod \"network-check-target-hwbcz\" (UID: \"8400548d-00fa-439c-b7b9-3157adfd8f76\") " pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:01:12.104798 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:12.104804 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/681ff1ad-fa48-420e-9501-d18e7a57a773-original-pull-secret\") pod \"global-pull-secret-syncer-jhw42\" (UID: \"681ff1ad-fa48-420e-9501-d18e7a57a773\") " pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:01:12.105042 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:12.104924 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 17:01:12.105042 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:12.104938 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 17:01:12.105042 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:12.104954 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 17:01:12.105042 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:12.104967 2570 projected.go:196] Error preparing data for projected volume kube-api-access-98f9n for pod openshift-network-diagnostics/network-check-target-hwbcz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 17:01:12.105042 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:12.104990 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/681ff1ad-fa48-420e-9501-d18e7a57a773-original-pull-secret podName:681ff1ad-fa48-420e-9501-d18e7a57a773 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:28.104971332 +0000 UTC m=+34.237818304 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/681ff1ad-fa48-420e-9501-d18e7a57a773-original-pull-secret") pod "global-pull-secret-syncer-jhw42" (UID: "681ff1ad-fa48-420e-9501-d18e7a57a773") : object "kube-system"/"original-pull-secret" not registered Jul 30 17:01:12.105042 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:12.105005 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8400548d-00fa-439c-b7b9-3157adfd8f76-kube-api-access-98f9n podName:8400548d-00fa-439c-b7b9-3157adfd8f76 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:28.104997062 +0000 UTC m=+34.237843996 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-98f9n" (UniqueName: "kubernetes.io/projected/8400548d-00fa-439c-b7b9-3157adfd8f76-kube-api-access-98f9n") pod "network-check-target-hwbcz" (UID: "8400548d-00fa-439c-b7b9-3157adfd8f76") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 17:01:12.458772 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:12.458736 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:01:12.458939 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:12.458739 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:01:12.458939 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:12.458877 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwbcz" podUID="8400548d-00fa-439c-b7b9-3157adfd8f76" Jul 30 17:01:12.459058 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:12.458745 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:01:12.459058 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:12.458960 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhw42" podUID="681ff1ad-fa48-420e-9501-d18e7a57a773" Jul 30 17:01:12.459160 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:12.459069 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8vjz8" podUID="3fdebda4-24ac-4c03-a395-a0e29dc51625" Jul 30 17:01:14.461898 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:14.461637 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:01:14.462344 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:14.461649 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:01:14.462344 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:14.462012 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8vjz8" podUID="3fdebda4-24ac-4c03-a395-a0e29dc51625" Jul 30 17:01:14.462344 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:14.461666 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:01:14.462344 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:14.462083 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwbcz" podUID="8400548d-00fa-439c-b7b9-3157adfd8f76" Jul 30 17:01:14.462344 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:14.462137 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhw42" podUID="681ff1ad-fa48-420e-9501-d18e7a57a773" Jul 30 17:01:16.458414 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:16.458131 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:01:16.459383 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:16.458247 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:01:16.459383 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:16.458291 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:01:16.459383 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:16.458539 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwbcz" podUID="8400548d-00fa-439c-b7b9-3157adfd8f76" Jul 30 17:01:16.459383 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:16.458657 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhw42" podUID="681ff1ad-fa48-420e-9501-d18e7a57a773" Jul 30 17:01:16.459383 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:16.458729 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8vjz8" podUID="3fdebda4-24ac-4c03-a395-a0e29dc51625" Jul 30 17:01:16.529810 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:16.529775 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nssxg" event={"ID":"70b71d45-9729-44bd-a29a-11e4a77e8937","Type":"ContainerStarted","Data":"14334c2a7c334fe379d5ab6c45bdf798b1f69f2fa021a0da294033f2a266f8d5"} Jul 30 17:01:16.533192 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:16.533128 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v2thn" event={"ID":"6d100ab6-7f70-4ec4-a23f-58b7badc9b93","Type":"ContainerStarted","Data":"3022455201b0d952d44606289f01ca827ef1fdf7f74275ee042e737fb183fe78"} Jul 30 17:01:16.534616 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:16.534580 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-120.ec2.internal" event={"ID":"3492ed6927be9f82b217829acc311662","Type":"ContainerStarted","Data":"c0d2679b3ba9379cd66ff0063ec4887d82351f0d7ddb01b095882eae741eda91"} Jul 30 17:01:16.535974 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:16.535950 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tb5cb" event={"ID":"41759fa3-9219-4210-9e10-5bf02dc9fb96","Type":"ContainerStarted","Data":"f1c682bd6c88ca3b75d68ca4d04b0538017f2b6b3ef7818fcb75323355fe356f"} Jul 30 17:01:16.538331 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:16.538311 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/ovn-acl-logging/0.log" Jul 30 17:01:16.538668 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:16.538647 2570 generic.go:356] "Generic (PLEG): container finished" podID="3ba7595c-0626-4561-8f94-ef72a6621ef1" containerID="5c270137f323943f44c46b8b0de63e385e4937060bc041837be0c958192cacb5" exitCode=1 Jul 30 17:01:16.538757 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:16.538731 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77btm" event={"ID":"3ba7595c-0626-4561-8f94-ef72a6621ef1","Type":"ContainerStarted","Data":"c3d49d6b50b39c6fec289c02fb66d63e40a1170c6880b3b645314a6a9e124dde"} Jul 30 17:01:16.538903 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:16.538824 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77btm" event={"ID":"3ba7595c-0626-4561-8f94-ef72a6621ef1","Type":"ContainerStarted","Data":"c9306e6f82f28c21f4e6c15156b251e2d48c1c7f940f92c536d30f20e573ea3c"} Jul 30 17:01:16.538903 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:16.538878 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77btm" event={"ID":"3ba7595c-0626-4561-8f94-ef72a6621ef1","Type":"ContainerDied","Data":"5c270137f323943f44c46b8b0de63e385e4937060bc041837be0c958192cacb5"} Jul 30 17:01:16.538988 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:16.538926 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77btm" event={"ID":"3ba7595c-0626-4561-8f94-ef72a6621ef1","Type":"ContainerStarted","Data":"fee381ceaead84aa505ffaa97f8ad07b9ef3193b061db6d4d59d34dd74f16975"} Jul 30 17:01:16.540392 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:16.540362 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ssvk2" event={"ID":"3ffbe09e-50f3-487b-8c82-5b6f992c5410","Type":"ContainerStarted","Data":"d6ab24f8539dfc9efc66d985249c54e437d5fad05bf5bd02254a144274cfff42"} Jul 30 17:01:16.542021 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:16.541994 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zvvk" event={"ID":"b08e8de2-4dd8-4cde-b485-dc15f87d3915","Type":"ContainerStarted","Data":"0b5451cf32d21aae0532ce5700b6522fe8863e1c43c64413381f4520a0a315c0"} Jul 30 17:01:16.543697 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:16.543669 2570 generic.go:356] "Generic (PLEG): container finished" podID="d53d46ebf7b711813c5a52cde689ce59" containerID="0c7f015c491bbd0ebd297596bae95f31d1ed0f57887a2d9216045d3a7173f606" exitCode=0 Jul 30 17:01:16.543815 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:16.543749 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal" event={"ID":"d53d46ebf7b711813c5a52cde689ce59","Type":"ContainerDied","Data":"0c7f015c491bbd0ebd297596bae95f31d1ed0f57887a2d9216045d3a7173f606"} Jul 30 17:01:16.545268 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:16.545245 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4wsb4" event={"ID":"33961af5-8f26-48ff-98de-e0340507e385","Type":"ContainerStarted","Data":"fb350a9271fcc809f29c62e94681ff48e674bef381564bc5838567dcd9014c85"} Jul 30 17:01:16.546583 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:16.546543 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wvmx2" event={"ID":"c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3","Type":"ContainerStarted","Data":"3a7099cc3578f0f82315a4bb1cce50e56a3fa7849811c23376eed9924999b867"} Jul 30 17:01:16.554818 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:16.554768 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-v2thn" podStartSLOduration=2.275777389 podStartE2EDuration="21.554752756s" totalImagesPullingTime="19.278975367s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:16.554236042 +0000 UTC m=+22.687082998" watchObservedRunningTime="2026-07-30 17:01:16.554752756 +0000 UTC m=+22.687599715" Jul 30 17:01:16.576910 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:16.576859 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ssvk2" podStartSLOduration=2.061896655 podStartE2EDuration="21.576841813s" totalImagesPullingTime="19.514945158s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:16.576502365 +0000 UTC m=+22.709349320" watchObservedRunningTime="2026-07-30 17:01:16.576841813 +0000 UTC m=+22.709688768" Jul 30 17:01:16.592971 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:16.592912 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tb5cb" podStartSLOduration=2.359475467 podStartE2EDuration="21.592893406s" totalImagesPullingTime="19.233417939s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:16.592453067 +0000 UTC m=+22.725300024" watchObservedRunningTime="2026-07-30 17:01:16.592893406 +0000 UTC m=+22.725740362" Jul 30 17:01:16.622932 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:16.622718 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wvmx2" podStartSLOduration=2.380994029 podStartE2EDuration="21.622698901s" totalImagesPullingTime="19.241704872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:00:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:16.622597587 +0000 UTC m=+22.755444544" watchObservedRunningTime="2026-07-30 17:01:16.622698901 +0000 UTC m=+22.755545859" Jul 30 17:01:16.623477 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:16.623446 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-120.ec2.internal" podStartSLOduration=20.623434735 podStartE2EDuration="20.623434735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:16.606114622 +0000 UTC m=+22.738961579" watchObservedRunningTime="2026-07-30 17:01:16.623434735 +0000 UTC m=+22.756281694" Jul 30 17:01:16.689189 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:16.689139 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4wsb4" podStartSLOduration=2.461732356 podStartE2EDuration="21.689122366s" totalImagesPullingTime="19.22739001s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:16.688808982 +0000 UTC m=+22.821655940" watchObservedRunningTime="2026-07-30 17:01:16.689122366 +0000 UTC m=+22.821969329" Jul 30 17:01:16.836414 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:16.836329 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:17.013983 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:17.013953 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:17.178912 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:17.178885 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:17.393488 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:17.393457 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:17.551396 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:17.551369 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/ovn-acl-logging/0.log" Jul 30 17:01:17.551831 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:17.551805 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77btm" event={"ID":"3ba7595c-0626-4561-8f94-ef72a6621ef1","Type":"ContainerStarted","Data":"ac2e96501413dc21ad2ae8f5f1f968944a81f0526cb0f45ce958e9af291ff891"} Jul 30 17:01:17.551954 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:17.551936 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77btm" event={"ID":"3ba7595c-0626-4561-8f94-ef72a6621ef1","Type":"ContainerStarted","Data":"e35ad09c0b4163d8f67116a41b0420da23095c79282737d2d48b8ecf0cb7f893"} Jul 30 17:01:17.553260 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:17.553231 2570 generic.go:356] "Generic (PLEG): container finished" podID="b08e8de2-4dd8-4cde-b485-dc15f87d3915" containerID="0b5451cf32d21aae0532ce5700b6522fe8863e1c43c64413381f4520a0a315c0" exitCode=0 Jul 30 17:01:17.553379 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:17.553295 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zvvk" event={"ID":"b08e8de2-4dd8-4cde-b485-dc15f87d3915","Type":"ContainerDied","Data":"0b5451cf32d21aae0532ce5700b6522fe8863e1c43c64413381f4520a0a315c0"} Jul 30 17:01:17.555068 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:17.555048 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal" event={"ID":"d53d46ebf7b711813c5a52cde689ce59","Type":"ContainerStarted","Data":"b73f582bcad0817a50ad0395b36459002179fcc3f0ec3d8ebbbc153e77c80392"} Jul 30 17:01:17.556586 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:17.556559 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6t9xr" event={"ID":"5dfaaf6d-53e5-4884-94e1-ff75d93560b5","Type":"ContainerStarted","Data":"1691572f3c738835bc7ba36e0843e15e738e154a19ee71dc745d2b55966404a9"} Jul 30 17:01:17.582270 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:17.582240 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:17.587048 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:17.587002 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal" podStartSLOduration=21.586987754 podStartE2EDuration="21.586987754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:17.586627293 +0000 UTC m=+23.719474249" watchObservedRunningTime="2026-07-30 17:01:17.586987754 +0000 UTC m=+23.719834708" Jul 30 17:01:18.458786 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:18.458751 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:01:18.459126 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:18.458752 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:01:18.459126 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:18.458751 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:01:18.459126 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:18.458882 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhw42" podUID="681ff1ad-fa48-420e-9501-d18e7a57a773" Jul 30 17:01:18.459126 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:18.458981 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwbcz" podUID="8400548d-00fa-439c-b7b9-3157adfd8f76" Jul 30 17:01:18.459126 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:18.459079 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8vjz8" podUID="3fdebda4-24ac-4c03-a395-a0e29dc51625" Jul 30 17:01:18.585113 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:18.585080 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:18.747207 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:18.747176 2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 30 17:01:18.765812 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:18.765767 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wvmx2" Jul 30 17:01:18.766603 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:18.766522 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wvmx2" Jul 30 17:01:18.784982 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:18.784926 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6t9xr" podStartSLOduration=8.689437481 podStartE2EDuration="23.784906393s" totalImagesPullingTime="15.095468912s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:17.605055704 +0000 UTC m=+23.737902656" watchObservedRunningTime="2026-07-30 17:01:18.784906393 +0000 UTC m=+24.917753350" Jul 30 17:01:18.984584 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:18.984480 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:19.190856 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:19.190821 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:19.292023 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:19.291932 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:19.332973 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:19.332862 2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-30T17:01:18.747199638Z","UUID":"47c00214-0924-4e1c-a0b1-8986f04cede6","Handler":null,"Name":"","Endpoint":""} Jul 30 17:01:19.334603 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:19.334575 2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 30 17:01:19.334753 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:19.334624 2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 30 17:01:19.391248 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:19.391211 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:19.563363 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:19.563274 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nssxg" event={"ID":"70b71d45-9729-44bd-a29a-11e4a77e8937","Type":"ContainerStarted","Data":"72d698f81be80e8211302526d763207c2328d3efed1cba62e8e7bf41772c3d1b"} Jul 30 17:01:19.566872 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:19.566840 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/ovn-acl-logging/0.log" Jul 30 17:01:19.567305 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:19.567274 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77btm" event={"ID":"3ba7595c-0626-4561-8f94-ef72a6621ef1","Type":"ContainerStarted","Data":"b6e1eb4017c66e5e2d355c1a1fcb8ec56110f420febf63999e689099831a396b"} Jul 30 17:01:19.567482 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:19.567459 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wvmx2" Jul 30 17:01:19.568031 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:19.568015 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wvmx2" Jul 30 17:01:19.795126 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:19.795087 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:19.895668 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:19.895583 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:20.179266 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:20.179231 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:20.403330 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:20.403300 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:20.458729 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:20.458645 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:01:20.458895 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:20.458646 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:01:20.458895 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:20.458785 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8vjz8" podUID="3fdebda4-24ac-4c03-a395-a0e29dc51625" Jul 30 17:01:20.458895 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:20.458648 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:01:20.458895 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:20.458845 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhw42" podUID="681ff1ad-fa48-420e-9501-d18e7a57a773" Jul 30 17:01:20.458895 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:20.458887 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwbcz" podUID="8400548d-00fa-439c-b7b9-3157adfd8f76" Jul 30 17:01:20.582338 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:20.582303 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:20.988641 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:20.988607 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:21.190743 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:21.190699 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:21.244922 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:21.244842 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:21.387024 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:21.386987 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:22.462274 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:22.462029 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:01:22.463084 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:22.462071 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:01:22.463084 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:22.462300 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8vjz8" podUID="3fdebda4-24ac-4c03-a395-a0e29dc51625" Jul 30 17:01:22.463084 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:22.462387 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwbcz" podUID="8400548d-00fa-439c-b7b9-3157adfd8f76" Jul 30 17:01:22.463084 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:22.462094 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:01:22.463084 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:22.462476 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhw42" podUID="681ff1ad-fa48-420e-9501-d18e7a57a773" Jul 30 17:01:22.576606 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:22.576572 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nssxg" event={"ID":"70b71d45-9729-44bd-a29a-11e4a77e8937","Type":"ContainerStarted","Data":"cfba6e939b37e509cd75005a3799e7bf8a0e6b6b62049cb86735ac7beff48e4a"} Jul 30 17:01:22.580132 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:22.580107 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/ovn-acl-logging/0.log" Jul 30 17:01:22.580508 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:22.580486 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77btm" event={"ID":"3ba7595c-0626-4561-8f94-ef72a6621ef1","Type":"ContainerStarted","Data":"efe004fc2253067813adc4043dfe406cb83accb136b8acda54e63eec0c1c6eef"} Jul 30 17:01:22.580707 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:22.580685 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:01:22.580973 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:22.580954 2570 scope.go:117] "RemoveContainer" containerID="5c270137f323943f44c46b8b0de63e385e4937060bc041837be0c958192cacb5" Jul 30 17:01:22.582590 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:22.582544 2570 generic.go:356] "Generic (PLEG): container finished" podID="b08e8de2-4dd8-4cde-b485-dc15f87d3915" containerID="567837f53e9d2bbac65e2cd6fc1c8c58f0ec542808fcb993f9b5d123c3638dbc" exitCode=0 Jul 30 17:01:22.582688 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:22.582618 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zvvk" event={"ID":"b08e8de2-4dd8-4cde-b485-dc15f87d3915","Type":"ContainerDied","Data":"567837f53e9d2bbac65e2cd6fc1c8c58f0ec542808fcb993f9b5d123c3638dbc"} Jul 30 17:01:22.591968 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:22.591918 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nssxg" podStartSLOduration=2.758506854 podStartE2EDuration="27.591901453s" totalImagesPullingTime="24.833394599s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:22.591834479 +0000 UTC m=+28.724681432" watchObservedRunningTime="2026-07-30 17:01:22.591901453 +0000 UTC m=+28.724748419" Jul 30 17:01:22.601181 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:22.601157 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:01:22.704111 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:22.704074 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:22.768761 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:22.768725 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:22.981377 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:22.981133 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:23.186885 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:23.186857 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:23.397454 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:23.397371 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:23.587606 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:23.587570 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:23.588892 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:23.588873 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/ovn-acl-logging/0.log" Jul 30 17:01:23.589307 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:23.589280 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77btm" event={"ID":"3ba7595c-0626-4561-8f94-ef72a6621ef1","Type":"ContainerStarted","Data":"5429a4ad4408084f7ad10284d4d05f7f2a5a6af9a8d2f5269e3e3f3abbdae8d8"} Jul 30 17:01:23.589307 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:23.589299 2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 30 17:01:23.589671 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:23.589649 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:01:23.605128 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:23.605102 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:01:23.619502 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:23.619454 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-77btm" podStartSLOduration=9.362017963 podStartE2EDuration="28.619437391s" totalImagesPullingTime="19.257419428s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:23.617893339 +0000 UTC m=+29.750740294" watchObservedRunningTime="2026-07-30 17:01:23.619437391 +0000 UTC m=+29.752284348" Jul 30 17:01:23.904269 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:23.904231 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:01:24.459338 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:24.459304 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:01:24.459509 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:24.459375 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:01:24.459509 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:24.459384 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwbcz" podUID="8400548d-00fa-439c-b7b9-3157adfd8f76" Jul 30 17:01:24.459509 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:24.459479 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8vjz8" podUID="3fdebda4-24ac-4c03-a395-a0e29dc51625" Jul 30 17:01:24.459670 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:24.459522 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:01:24.459670 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:24.459596 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhw42" podUID="681ff1ad-fa48-420e-9501-d18e7a57a773" Jul 30 17:01:24.593829 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:24.593798 2570 generic.go:356] "Generic (PLEG): container finished" podID="b08e8de2-4dd8-4cde-b485-dc15f87d3915" containerID="d3b971df17fe1dc6f10c3290735a71ac53a23f6304c06071c826598c7733f937" exitCode=0 Jul 30 17:01:24.594206 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:24.593880 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zvvk" event={"ID":"b08e8de2-4dd8-4cde-b485-dc15f87d3915","Type":"ContainerDied","Data":"d3b971df17fe1dc6f10c3290735a71ac53a23f6304c06071c826598c7733f937"} Jul 30 17:01:24.792986 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:24.792905 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:24.983985 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:24.983954 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:25.190520 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:25.190489 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:25.388711 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:25.388676 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:25.777300 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:25.777269 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:26.178483 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:26.178450 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:26.461141 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:26.461051 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:01:26.461141 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:26.461092 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:01:26.461363 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:26.461166 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:01:26.461363 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:26.461188 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8vjz8" podUID="3fdebda4-24ac-4c03-a395-a0e29dc51625" Jul 30 17:01:26.461363 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:26.461297 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhw42" podUID="681ff1ad-fa48-420e-9501-d18e7a57a773" Jul 30 17:01:26.461363 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:26.461357 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwbcz" podUID="8400548d-00fa-439c-b7b9-3157adfd8f76" Jul 30 17:01:26.600826 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:26.600791 2570 generic.go:356] "Generic (PLEG): container finished" podID="b08e8de2-4dd8-4cde-b485-dc15f87d3915" containerID="985938ecc58d58f642ed0597ff2b2a5861b77e52975d8fcd26be480995f73eaf" exitCode=0 Jul 30 17:01:26.601003 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:26.600847 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zvvk" event={"ID":"b08e8de2-4dd8-4cde-b485-dc15f87d3915","Type":"ContainerDied","Data":"985938ecc58d58f642ed0597ff2b2a5861b77e52975d8fcd26be480995f73eaf"} Jul 30 17:01:26.601100 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:26.601079 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:26.985214 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:26.985183 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:27.093165 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:27.093132 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:27.193707 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:27.193673 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:27.250293 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:27.250215 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:28.030619 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:28.030583 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fdebda4-24ac-4c03-a395-a0e29dc51625-metrics-certs\") pod \"network-metrics-daemon-8vjz8\" (UID: \"3fdebda4-24ac-4c03-a395-a0e29dc51625\") " pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:01:28.031128 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:28.030742 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 17:01:28.031128 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:28.030815 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fdebda4-24ac-4c03-a395-a0e29dc51625-metrics-certs podName:3fdebda4-24ac-4c03-a395-a0e29dc51625 nodeName:}" failed. No retries permitted until 2026-07-30 17:02:00.030797051 +0000 UTC m=+66.163643986 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3fdebda4-24ac-4c03-a395-a0e29dc51625-metrics-certs") pod "network-metrics-daemon-8vjz8" (UID: "3fdebda4-24ac-4c03-a395-a0e29dc51625") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 17:01:28.132161 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:28.132085 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98f9n\" (UniqueName: \"kubernetes.io/projected/8400548d-00fa-439c-b7b9-3157adfd8f76-kube-api-access-98f9n\") pod \"network-check-target-hwbcz\" (UID: \"8400548d-00fa-439c-b7b9-3157adfd8f76\") " pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:01:28.132345 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:28.132184 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/681ff1ad-fa48-420e-9501-d18e7a57a773-original-pull-secret\") pod \"global-pull-secret-syncer-jhw42\" (UID: \"681ff1ad-fa48-420e-9501-d18e7a57a773\") " pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:01:28.132411 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:28.132380 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 17:01:28.132459 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:28.132423 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 17:01:28.132506 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:28.132458 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 17:01:28.132506 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:28.132462 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/681ff1ad-fa48-420e-9501-d18e7a57a773-original-pull-secret podName:681ff1ad-fa48-420e-9501-d18e7a57a773 nodeName:}" failed. No retries permitted until 2026-07-30 17:02:00.132434788 +0000 UTC m=+66.265281739 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/681ff1ad-fa48-420e-9501-d18e7a57a773-original-pull-secret") pod "global-pull-secret-syncer-jhw42" (UID: "681ff1ad-fa48-420e-9501-d18e7a57a773") : object "kube-system"/"original-pull-secret" not registered Jul 30 17:01:28.132506 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:28.132473 2570 projected.go:196] Error preparing data for projected volume kube-api-access-98f9n for pod openshift-network-diagnostics/network-check-target-hwbcz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 17:01:28.132675 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:28.132534 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8400548d-00fa-439c-b7b9-3157adfd8f76-kube-api-access-98f9n podName:8400548d-00fa-439c-b7b9-3157adfd8f76 nodeName:}" failed. No retries permitted until 2026-07-30 17:02:00.132514425 +0000 UTC m=+66.265361378 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-98f9n" (UniqueName: "kubernetes.io/projected/8400548d-00fa-439c-b7b9-3157adfd8f76-kube-api-access-98f9n") pod "network-check-target-hwbcz" (UID: "8400548d-00fa-439c-b7b9-3157adfd8f76") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 17:01:28.458721 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:28.458684 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:01:28.458929 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:28.458684 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:01:28.458929 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:28.458820 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:01:28.458929 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:28.458820 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhw42" podUID="681ff1ad-fa48-420e-9501-d18e7a57a773" Jul 30 17:01:28.459099 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:28.458929 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwbcz" podUID="8400548d-00fa-439c-b7b9-3157adfd8f76" Jul 30 17:01:28.459099 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:28.459028 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8vjz8" podUID="3fdebda4-24ac-4c03-a395-a0e29dc51625" Jul 30 17:01:28.955472 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:28.955432 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:30.458811 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:30.458777 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:01:30.458811 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:30.458794 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:01:30.459348 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:30.458970 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwbcz" podUID="8400548d-00fa-439c-b7b9-3157adfd8f76" Jul 30 17:01:30.459348 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:30.459037 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhw42" podUID="681ff1ad-fa48-420e-9501-d18e7a57a773" Jul 30 17:01:30.459348 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:30.459063 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:01:30.459348 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:30.459175 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8vjz8" podUID="3fdebda4-24ac-4c03-a395-a0e29dc51625" Jul 30 17:01:32.458900 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:32.458865 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:01:32.458900 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:32.458893 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:01:32.459311 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:32.458865 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:01:32.459311 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:32.458980 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwbcz" podUID="8400548d-00fa-439c-b7b9-3157adfd8f76" Jul 30 17:01:32.459311 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:32.459031 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhw42" podUID="681ff1ad-fa48-420e-9501-d18e7a57a773" Jul 30 17:01:32.459311 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:32.459143 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8vjz8" podUID="3fdebda4-24ac-4c03-a395-a0e29dc51625" Jul 30 17:01:32.620974 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:32.620938 2570 generic.go:356] "Generic (PLEG): container finished" podID="b08e8de2-4dd8-4cde-b485-dc15f87d3915" containerID="1faccb61579aba27c3a967efe910ac07df3fed633870f22adc66df80fc9450be" exitCode=0 Jul 30 17:01:32.621129 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:32.620993 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zvvk" event={"ID":"b08e8de2-4dd8-4cde-b485-dc15f87d3915","Type":"ContainerDied","Data":"1faccb61579aba27c3a967efe910ac07df3fed633870f22adc66df80fc9450be"} Jul 30 17:01:33.626698 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:33.626659 2570 generic.go:356] "Generic (PLEG): container finished" podID="b08e8de2-4dd8-4cde-b485-dc15f87d3915" containerID="779851e8b52144b16c02febf0c53adaca7590e09cee4f282d35dc1c024a61e16" exitCode=0 Jul 30 17:01:33.627099 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:33.626705 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zvvk" event={"ID":"b08e8de2-4dd8-4cde-b485-dc15f87d3915","Type":"ContainerDied","Data":"779851e8b52144b16c02febf0c53adaca7590e09cee4f282d35dc1c024a61e16"} Jul 30 17:01:34.458871 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:34.458832 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:01:34.459076 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:34.458905 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:01:34.459076 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:34.458918 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwbcz" podUID="8400548d-00fa-439c-b7b9-3157adfd8f76" Jul 30 17:01:34.459076 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:34.459000 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8vjz8" podUID="3fdebda4-24ac-4c03-a395-a0e29dc51625" Jul 30 17:01:34.459076 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:34.459026 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:01:34.459076 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:34.459074 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhw42" podUID="681ff1ad-fa48-420e-9501-d18e7a57a773" Jul 30 17:01:34.631869 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:34.631832 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zvvk" event={"ID":"b08e8de2-4dd8-4cde-b485-dc15f87d3915","Type":"ContainerStarted","Data":"a95d9eb178eb25f7cbb2966f6933a0a076678a95deec6f88dd19fcaff89eb4b1"} Jul 30 17:01:34.656254 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:34.656196 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8zvvk" podStartSLOduration=9.602343771 podStartE2EDuration="40.656181409s" totalImagesPullingTime="31.053837638s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:54 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:34.655166296 +0000 UTC m=+40.788013252" watchObservedRunningTime="2026-07-30 17:01:34.656181409 +0000 UTC m=+40.789028364" Jul 30 17:01:35.977827 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:35.977789 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:36.070952 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:36.070913 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:36.171713 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:36.171673 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:36.269893 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:36.269801 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:36.345658 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:36.345627 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:36.459212 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:36.459170 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:01:36.459212 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:36.459205 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:01:36.459466 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:36.459170 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:01:36.459466 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:36.459303 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8vjz8" podUID="3fdebda4-24ac-4c03-a395-a0e29dc51625" Jul 30 17:01:36.459466 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:36.459386 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhw42" podUID="681ff1ad-fa48-420e-9501-d18e7a57a773" Jul 30 17:01:36.459609 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:36.459478 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwbcz" podUID="8400548d-00fa-439c-b7b9-3157adfd8f76" Jul 30 17:01:37.141029 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:37.140990 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8vjz8"] Jul 30 17:01:37.141488 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:37.141122 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:01:37.141488 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:37.141232 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8vjz8" podUID="3fdebda4-24ac-4c03-a395-a0e29dc51625" Jul 30 17:01:37.144705 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:37.144659 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jhw42"] Jul 30 17:01:37.144705 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:37.144728 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hwbcz"] Jul 30 17:01:37.144970 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:37.144811 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:01:37.144970 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:37.144908 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwbcz" podUID="8400548d-00fa-439c-b7b9-3157adfd8f76" Jul 30 17:01:37.145118 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:37.145100 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:01:37.145214 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:37.145192 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhw42" podUID="681ff1ad-fa48-420e-9501-d18e7a57a773" Jul 30 17:01:38.458375 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:38.458339 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:01:38.458790 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:38.458347 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:01:38.458790 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:38.458440 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwbcz" podUID="8400548d-00fa-439c-b7b9-3157adfd8f76" Jul 30 17:01:38.458790 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:38.458523 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8vjz8" podUID="3fdebda4-24ac-4c03-a395-a0e29dc51625" Jul 30 17:01:38.458790 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:38.458353 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:01:38.458790 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:38.458622 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhw42" podUID="681ff1ad-fa48-420e-9501-d18e7a57a773" Jul 30 17:01:40.461346 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.461314 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:01:40.461851 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.461409 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:01:40.461851 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.461435 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:01:40.461851 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:40.461428 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwbcz" podUID="8400548d-00fa-439c-b7b9-3157adfd8f76" Jul 30 17:01:40.461851 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:40.461515 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8vjz8" podUID="3fdebda4-24ac-4c03-a395-a0e29dc51625" Jul 30 17:01:40.461851 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:40.461611 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhw42" podUID="681ff1ad-fa48-420e-9501-d18e7a57a773" Jul 30 17:01:40.675278 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.675250 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeReady" Jul 30 17:01:40.675478 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.675437 2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 30 17:01:40.722604 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.722511 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mhm6l"] Jul 30 17:01:40.727746 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.727715 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tktgh"] Jul 30 17:01:40.727939 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.727856 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mhm6l" Jul 30 17:01:40.730006 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.729978 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 30 17:01:40.730173 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.730157 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 30 17:01:40.730251 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.730194 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hmptn\"" Jul 30 17:01:40.730251 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.730203 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 30 17:01:40.734153 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.733813 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tktgh" Jul 30 17:01:40.734153 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.734020 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mhm6l"] Jul 30 17:01:40.736198 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.736178 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 30 17:01:40.736296 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.736188 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 30 17:01:40.736296 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.736253 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 30 17:01:40.736296 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.736287 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 30 17:01:40.736419 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.736390 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5tlpk\"" Jul 30 17:01:40.738045 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.738027 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tktgh"] Jul 30 17:01:40.823221 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.823189 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7t2wd"] Jul 30 17:01:40.823434 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.823413 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbfzj\" (UniqueName: \"kubernetes.io/projected/f9d07348-83de-40fd-a5f7-1e47c44b306c-kube-api-access-dbfzj\") pod \"ingress-canary-mhm6l\" (UID: \"f9d07348-83de-40fd-a5f7-1e47c44b306c\") " pod="openshift-ingress-canary/ingress-canary-mhm6l" Jul 30 17:01:40.823502 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.823464 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9d07348-83de-40fd-a5f7-1e47c44b306c-cert\") pod \"ingress-canary-mhm6l\" (UID: \"f9d07348-83de-40fd-a5f7-1e47c44b306c\") " pod="openshift-ingress-canary/ingress-canary-mhm6l" Jul 30 17:01:40.835714 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.835685 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7t2wd" Jul 30 17:01:40.836705 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.836683 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7t2wd"] Jul 30 17:01:40.840831 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.840750 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 30 17:01:40.840969 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.840915 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 30 17:01:40.841213 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.841164 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-72fd8\"" Jul 30 17:01:40.924785 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.924744 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4f88bc24-37c8-4a16-9f26-67effbdbc720-data-volume\") pod \"insights-runtime-extractor-tktgh\" (UID: \"4f88bc24-37c8-4a16-9f26-67effbdbc720\") " pod="openshift-insights/insights-runtime-extractor-tktgh" Jul 30 17:01:40.924785 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.924784 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4f88bc24-37c8-4a16-9f26-67effbdbc720-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tktgh\" (UID: \"4f88bc24-37c8-4a16-9f26-67effbdbc720\") " pod="openshift-insights/insights-runtime-extractor-tktgh" Jul 30 17:01:40.925011 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.924804 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2svr9\" (UniqueName: \"kubernetes.io/projected/4f88bc24-37c8-4a16-9f26-67effbdbc720-kube-api-access-2svr9\") pod \"insights-runtime-extractor-tktgh\" (UID: \"4f88bc24-37c8-4a16-9f26-67effbdbc720\") " pod="openshift-insights/insights-runtime-extractor-tktgh" Jul 30 17:01:40.925011 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.924889 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbfzj\" (UniqueName: \"kubernetes.io/projected/f9d07348-83de-40fd-a5f7-1e47c44b306c-kube-api-access-dbfzj\") pod \"ingress-canary-mhm6l\" (UID: \"f9d07348-83de-40fd-a5f7-1e47c44b306c\") " pod="openshift-ingress-canary/ingress-canary-mhm6l" Jul 30 17:01:40.925011 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.924925 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4f88bc24-37c8-4a16-9f26-67effbdbc720-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tktgh\" (UID: \"4f88bc24-37c8-4a16-9f26-67effbdbc720\") " pod="openshift-insights/insights-runtime-extractor-tktgh" Jul 30 17:01:40.925011 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.924959 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9d07348-83de-40fd-a5f7-1e47c44b306c-cert\") pod \"ingress-canary-mhm6l\" (UID: \"f9d07348-83de-40fd-a5f7-1e47c44b306c\") " pod="openshift-ingress-canary/ingress-canary-mhm6l" Jul 30 17:01:40.925145 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.925039 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4f88bc24-37c8-4a16-9f26-67effbdbc720-crio-socket\") pod \"insights-runtime-extractor-tktgh\" (UID: \"4f88bc24-37c8-4a16-9f26-67effbdbc720\") " pod="openshift-insights/insights-runtime-extractor-tktgh" Jul 30 17:01:40.928129 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.928097 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:40.929218 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.929200 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9d07348-83de-40fd-a5f7-1e47c44b306c-cert\") pod \"ingress-canary-mhm6l\" (UID: \"f9d07348-83de-40fd-a5f7-1e47c44b306c\") " pod="openshift-ingress-canary/ingress-canary-mhm6l" Jul 30 17:01:40.933078 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:40.933052 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbfzj\" (UniqueName: \"kubernetes.io/projected/f9d07348-83de-40fd-a5f7-1e47c44b306c-kube-api-access-dbfzj\") pod \"ingress-canary-mhm6l\" (UID: \"f9d07348-83de-40fd-a5f7-1e47c44b306c\") " pod="openshift-ingress-canary/ingress-canary-mhm6l" Jul 30 17:01:41.026121 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.026028 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18095718-fd6d-4d25-ad02-25c48c851ab0-metrics-tls\") pod \"dns-default-7t2wd\" (UID: \"18095718-fd6d-4d25-ad02-25c48c851ab0\") " pod="openshift-dns/dns-default-7t2wd" Jul 30 17:01:41.026121 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.026071 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4f88bc24-37c8-4a16-9f26-67effbdbc720-data-volume\") pod \"insights-runtime-extractor-tktgh\" (UID: \"4f88bc24-37c8-4a16-9f26-67effbdbc720\") " pod="openshift-insights/insights-runtime-extractor-tktgh" Jul 30 17:01:41.026321 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.026135 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4f88bc24-37c8-4a16-9f26-67effbdbc720-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tktgh\" (UID: \"4f88bc24-37c8-4a16-9f26-67effbdbc720\") " pod="openshift-insights/insights-runtime-extractor-tktgh" Jul 30 17:01:41.026321 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.026166 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2svr9\" (UniqueName: \"kubernetes.io/projected/4f88bc24-37c8-4a16-9f26-67effbdbc720-kube-api-access-2svr9\") pod \"insights-runtime-extractor-tktgh\" (UID: \"4f88bc24-37c8-4a16-9f26-67effbdbc720\") " pod="openshift-insights/insights-runtime-extractor-tktgh" Jul 30 17:01:41.026321 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.026226 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtmqm\" (UniqueName: \"kubernetes.io/projected/18095718-fd6d-4d25-ad02-25c48c851ab0-kube-api-access-vtmqm\") pod \"dns-default-7t2wd\" (UID: \"18095718-fd6d-4d25-ad02-25c48c851ab0\") " pod="openshift-dns/dns-default-7t2wd" Jul 30 17:01:41.026321 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.026252 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4f88bc24-37c8-4a16-9f26-67effbdbc720-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tktgh\" (UID: \"4f88bc24-37c8-4a16-9f26-67effbdbc720\") " pod="openshift-insights/insights-runtime-extractor-tktgh" Jul 30 17:01:41.026321 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.026305 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18095718-fd6d-4d25-ad02-25c48c851ab0-tmp-dir\") pod \"dns-default-7t2wd\" (UID: \"18095718-fd6d-4d25-ad02-25c48c851ab0\") " pod="openshift-dns/dns-default-7t2wd" Jul 30 17:01:41.026582 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.026384 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/18095718-fd6d-4d25-ad02-25c48c851ab0-config-volume\") pod \"dns-default-7t2wd\" (UID: \"18095718-fd6d-4d25-ad02-25c48c851ab0\") " pod="openshift-dns/dns-default-7t2wd" Jul 30 17:01:41.026582 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.026465 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4f88bc24-37c8-4a16-9f26-67effbdbc720-data-volume\") pod \"insights-runtime-extractor-tktgh\" (UID: \"4f88bc24-37c8-4a16-9f26-67effbdbc720\") " pod="openshift-insights/insights-runtime-extractor-tktgh" Jul 30 17:01:41.026582 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.026477 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4f88bc24-37c8-4a16-9f26-67effbdbc720-crio-socket\") pod \"insights-runtime-extractor-tktgh\" (UID: \"4f88bc24-37c8-4a16-9f26-67effbdbc720\") " pod="openshift-insights/insights-runtime-extractor-tktgh" Jul 30 17:01:41.026714 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.026657 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4f88bc24-37c8-4a16-9f26-67effbdbc720-crio-socket\") pod \"insights-runtime-extractor-tktgh\" (UID: \"4f88bc24-37c8-4a16-9f26-67effbdbc720\") " pod="openshift-insights/insights-runtime-extractor-tktgh" Jul 30 17:01:41.026762 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.026744 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4f88bc24-37c8-4a16-9f26-67effbdbc720-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tktgh\" (UID: \"4f88bc24-37c8-4a16-9f26-67effbdbc720\") " pod="openshift-insights/insights-runtime-extractor-tktgh" Jul 30 17:01:41.028663 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.028646 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4f88bc24-37c8-4a16-9f26-67effbdbc720-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tktgh\" (UID: \"4f88bc24-37c8-4a16-9f26-67effbdbc720\") " pod="openshift-insights/insights-runtime-extractor-tktgh" Jul 30 17:01:41.034295 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.034272 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2svr9\" (UniqueName: \"kubernetes.io/projected/4f88bc24-37c8-4a16-9f26-67effbdbc720-kube-api-access-2svr9\") pod \"insights-runtime-extractor-tktgh\" (UID: \"4f88bc24-37c8-4a16-9f26-67effbdbc720\") " pod="openshift-insights/insights-runtime-extractor-tktgh" Jul 30 17:01:41.039206 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.039182 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mhm6l" Jul 30 17:01:41.046386 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.046356 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tktgh" Jul 30 17:01:41.127303 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.127271 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18095718-fd6d-4d25-ad02-25c48c851ab0-metrics-tls\") pod \"dns-default-7t2wd\" (UID: \"18095718-fd6d-4d25-ad02-25c48c851ab0\") " pod="openshift-dns/dns-default-7t2wd" Jul 30 17:01:41.127447 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.127323 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtmqm\" (UniqueName: \"kubernetes.io/projected/18095718-fd6d-4d25-ad02-25c48c851ab0-kube-api-access-vtmqm\") pod \"dns-default-7t2wd\" (UID: \"18095718-fd6d-4d25-ad02-25c48c851ab0\") " pod="openshift-dns/dns-default-7t2wd" Jul 30 17:01:41.127447 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.127354 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18095718-fd6d-4d25-ad02-25c48c851ab0-tmp-dir\") pod \"dns-default-7t2wd\" (UID: \"18095718-fd6d-4d25-ad02-25c48c851ab0\") " pod="openshift-dns/dns-default-7t2wd" Jul 30 17:01:41.127447 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.127374 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/18095718-fd6d-4d25-ad02-25c48c851ab0-config-volume\") pod \"dns-default-7t2wd\" (UID: \"18095718-fd6d-4d25-ad02-25c48c851ab0\") " pod="openshift-dns/dns-default-7t2wd" Jul 30 17:01:41.127791 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.127764 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18095718-fd6d-4d25-ad02-25c48c851ab0-tmp-dir\") pod \"dns-default-7t2wd\" (UID: \"18095718-fd6d-4d25-ad02-25c48c851ab0\") " pod="openshift-dns/dns-default-7t2wd" Jul 30 17:01:41.127942 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.127918 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/18095718-fd6d-4d25-ad02-25c48c851ab0-config-volume\") pod \"dns-default-7t2wd\" (UID: \"18095718-fd6d-4d25-ad02-25c48c851ab0\") " pod="openshift-dns/dns-default-7t2wd" Jul 30 17:01:41.129577 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.129543 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18095718-fd6d-4d25-ad02-25c48c851ab0-metrics-tls\") pod \"dns-default-7t2wd\" (UID: \"18095718-fd6d-4d25-ad02-25c48c851ab0\") " pod="openshift-dns/dns-default-7t2wd" Jul 30 17:01:41.135829 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.135803 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtmqm\" (UniqueName: \"kubernetes.io/projected/18095718-fd6d-4d25-ad02-25c48c851ab0-kube-api-access-vtmqm\") pod \"dns-default-7t2wd\" (UID: \"18095718-fd6d-4d25-ad02-25c48c851ab0\") " pod="openshift-dns/dns-default-7t2wd" Jul 30 17:01:41.146821 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.146783 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7t2wd" Jul 30 17:01:41.243414 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.243153 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tktgh"] Jul 30 17:01:41.247021 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.246992 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mhm6l"] Jul 30 17:01:41.247766 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:01:41.247739 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f88bc24_37c8_4a16_9f26_67effbdbc720.slice/crio-460ba2c3d4f121f33c78fc30c7dd6c73a5542cd4d70e501e4cc7ce9437ae72cb WatchSource:0}: Error finding container 460ba2c3d4f121f33c78fc30c7dd6c73a5542cd4d70e501e4cc7ce9437ae72cb: Status 404 returned error can't find the container with id 460ba2c3d4f121f33c78fc30c7dd6c73a5542cd4d70e501e4cc7ce9437ae72cb Jul 30 17:01:41.250604 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:01:41.250579 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9d07348_83de_40fd_a5f7_1e47c44b306c.slice/crio-4d608a8305bf5b3b9435b3a09ae58a4d144a3b19b37a6f1999a76ee3bd765811 WatchSource:0}: Error finding container 4d608a8305bf5b3b9435b3a09ae58a4d144a3b19b37a6f1999a76ee3bd765811: Status 404 returned error can't find the container with id 4d608a8305bf5b3b9435b3a09ae58a4d144a3b19b37a6f1999a76ee3bd765811 Jul 30 17:01:41.310451 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.310339 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7t2wd"] Jul 30 17:01:41.313576 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:01:41.313534 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18095718_fd6d_4d25_ad02_25c48c851ab0.slice/crio-fe0416d21474e4dc72f719b87557be2842d5d1ffc90e2f7044a8635949762f4b WatchSource:0}: Error finding container fe0416d21474e4dc72f719b87557be2842d5d1ffc90e2f7044a8635949762f4b: Status 404 returned error can't find the container with id fe0416d21474e4dc72f719b87557be2842d5d1ffc90e2f7044a8635949762f4b Jul 30 17:01:41.649187 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.649086 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7t2wd" event={"ID":"18095718-fd6d-4d25-ad02-25c48c851ab0","Type":"ContainerStarted","Data":"fe0416d21474e4dc72f719b87557be2842d5d1ffc90e2f7044a8635949762f4b"} Jul 30 17:01:41.650200 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.650168 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tktgh" event={"ID":"4f88bc24-37c8-4a16-9f26-67effbdbc720","Type":"ContainerStarted","Data":"460ba2c3d4f121f33c78fc30c7dd6c73a5542cd4d70e501e4cc7ce9437ae72cb"} Jul 30 17:01:41.651124 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.651102 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mhm6l" event={"ID":"f9d07348-83de-40fd-a5f7-1e47c44b306c","Type":"ContainerStarted","Data":"4d608a8305bf5b3b9435b3a09ae58a4d144a3b19b37a6f1999a76ee3bd765811"} Jul 30 17:01:41.745370 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.745284 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:41.846239 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:41.846146 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:42.458788 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:42.458669 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:01:42.458788 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:42.458722 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:01:42.459133 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:42.459087 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:01:42.462593 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:42.462543 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 30 17:01:42.462736 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:42.462676 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 30 17:01:42.462889 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:42.462866 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w7mtp\"" Jul 30 17:01:42.462967 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:42.462910 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 30 17:01:42.463126 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:42.463108 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 30 17:01:42.463184 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:42.462568 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hqjnm\"" Jul 30 17:01:42.487378 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:42.487343 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:42.540289 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:42.540200 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:42.959660 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:42.959624 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:43.064521 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:43.064475 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:43.079866 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:43.079833 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pzpn6"] Jul 30 17:01:43.109775 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:43.109738 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pzpn6"] Jul 30 17:01:43.109954 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:43.109901 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pzpn6" Jul 30 17:01:43.112200 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:43.112166 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 30 17:01:43.112200 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:43.112190 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-s9s4x\"" Jul 30 17:01:43.129861 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:43.129824 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:43.245358 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:43.245273 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7a164ac8-9291-4a03-9a80-2f325fde4954-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-pzpn6\" (UID: \"7a164ac8-9291-4a03-9a80-2f325fde4954\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pzpn6" Jul 30 17:01:43.346351 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:43.346309 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7a164ac8-9291-4a03-9a80-2f325fde4954-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-pzpn6\" (UID: \"7a164ac8-9291-4a03-9a80-2f325fde4954\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pzpn6" Jul 30 17:01:43.350676 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:43.350607 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7a164ac8-9291-4a03-9a80-2f325fde4954-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-pzpn6\" (UID: \"7a164ac8-9291-4a03-9a80-2f325fde4954\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pzpn6" Jul 30 17:01:43.388806 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:43.388754 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:43.422921 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:43.422883 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pzpn6" Jul 30 17:01:44.921830 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:44.921785 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:45.022821 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:45.022760 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:45.647232 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:45.647171 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:45.748500 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:45.748446 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:48.277283 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:48.277083 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pzpn6"] Jul 30 17:01:48.344120 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:01:48.344092 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a164ac8_9291_4a03_9a80_2f325fde4954.slice/crio-5d91e85e678d4306554a7a960bad49acde2156b702ca5d5197d038496a17838d WatchSource:0}: Error finding container 5d91e85e678d4306554a7a960bad49acde2156b702ca5d5197d038496a17838d: Status 404 returned error can't find the container with id 5d91e85e678d4306554a7a960bad49acde2156b702ca5d5197d038496a17838d Jul 30 17:01:48.671320 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:48.671284 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7t2wd" event={"ID":"18095718-fd6d-4d25-ad02-25c48c851ab0","Type":"ContainerStarted","Data":"8b2432a4543df6c4caf8c992e8cf99a780c45e2040c7fa2dcb703e08f2c83b03"} Jul 30 17:01:48.671514 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:48.671373 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7t2wd" event={"ID":"18095718-fd6d-4d25-ad02-25c48c851ab0","Type":"ContainerStarted","Data":"565849347ee0d1a16cd4b09538e415a6ee714eee97ab1ee40134c76b7a766223"} Jul 30 17:01:48.671514 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:48.671408 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7t2wd" Jul 30 17:01:48.672841 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:48.672817 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tktgh" event={"ID":"4f88bc24-37c8-4a16-9f26-67effbdbc720","Type":"ContainerStarted","Data":"ebba2e5c702f0bf9c5cd135a31e6fe3cedfbddf75e376fd00397e6906ecd4ee8"} Jul 30 17:01:48.674357 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:48.674331 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mhm6l" event={"ID":"f9d07348-83de-40fd-a5f7-1e47c44b306c","Type":"ContainerStarted","Data":"ba854fe839e357e3dba079d6d98ae8850ae683e598925b1f8aae435b15a2b4dc"} Jul 30 17:01:48.675541 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:48.675517 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pzpn6" event={"ID":"7a164ac8-9291-4a03-9a80-2f325fde4954","Type":"ContainerStarted","Data":"5d91e85e678d4306554a7a960bad49acde2156b702ca5d5197d038496a17838d"} Jul 30 17:01:48.687744 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:48.687694 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7t2wd" podStartSLOduration=1.867983584 podStartE2EDuration="8.687679389s" totalImagesPullingTime="6.819695805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:48.686329378 +0000 UTC m=+54.819176333" watchObservedRunningTime="2026-07-30 17:01:48.687679389 +0000 UTC m=+54.820526397" Jul 30 17:01:48.705358 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:48.705301 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mhm6l" podStartSLOduration=1.8230954750000001 podStartE2EDuration="8.705283246s" totalImagesPullingTime="6.882187771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:48.70461667 +0000 UTC m=+54.837463627" watchObservedRunningTime="2026-07-30 17:01:48.705283246 +0000 UTC m=+54.838130202" Jul 30 17:01:48.906137 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:48.906079 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:49.004173 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:49.004093 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:49.684334 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:49.684068 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pzpn6" event={"ID":"7a164ac8-9291-4a03-9a80-2f325fde4954","Type":"ContainerStarted","Data":"e1e472ad2605c9be9a501479fd750e29c6f291bb0336995b74626bbdd3b81d1c"} Jul 30 17:01:49.700622 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:49.700570 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pzpn6" podStartSLOduration=5.55345906 podStartE2EDuration="6.700531165s" totalImagesPullingTime="1.147072105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:01:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:49.69981657 +0000 UTC m=+55.832663528" watchObservedRunningTime="2026-07-30 17:01:49.700531165 +0000 UTC m=+55.833378122" Jul 30 17:01:49.818509 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:49.818420 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:49.918877 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:49.918839 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:50.196853 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:50.196815 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:50.446379 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:50.446345 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:50.689095 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:50.689056 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pzpn6" Jul 30 17:01:50.695211 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:50.695184 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pzpn6" Jul 30 17:01:50.712228 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:50.712193 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-6t9lf"] Jul 30 17:01:50.720866 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:50.720824 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-6t9lf" Jul 30 17:01:50.724331 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:50.723739 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 30 17:01:50.724331 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:50.723763 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-qvks9\"" Jul 30 17:01:50.724331 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:50.724188 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 30 17:01:50.738606 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:50.729413 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-6t9lf"] Jul 30 17:01:50.753684 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:50.748484 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:50.802865 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:50.802831 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm44m\" (UniqueName: \"kubernetes.io/projected/eff18f41-6541-4186-aba6-26e3505c3613-kube-api-access-tm44m\") pod \"downloads-7c97dc4555-6t9lf\" (UID: \"eff18f41-6541-4186-aba6-26e3505c3613\") " pod="openshift-console/downloads-7c97dc4555-6t9lf" Jul 30 17:01:50.838084 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:50.838022 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:50.904240 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:50.904197 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm44m\" (UniqueName: \"kubernetes.io/projected/eff18f41-6541-4186-aba6-26e3505c3613-kube-api-access-tm44m\") pod \"downloads-7c97dc4555-6t9lf\" (UID: \"eff18f41-6541-4186-aba6-26e3505c3613\") " pod="openshift-console/downloads-7c97dc4555-6t9lf" Jul 30 17:01:50.914823 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:50.914789 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm44m\" (UniqueName: \"kubernetes.io/projected/eff18f41-6541-4186-aba6-26e3505c3613-kube-api-access-tm44m\") pod \"downloads-7c97dc4555-6t9lf\" (UID: \"eff18f41-6541-4186-aba6-26e3505c3613\") " pod="openshift-console/downloads-7c97dc4555-6t9lf" Jul 30 17:01:51.053961 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:51.053872 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-6t9lf" Jul 30 17:01:51.160630 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:51.158415 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-p8cg5"] Jul 30 17:01:51.163925 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:51.163898 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-p8cg5" Jul 30 17:01:51.166514 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:51.166476 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 30 17:01:51.166856 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:51.166833 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 30 17:01:51.166969 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:51.166897 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 30 17:01:51.167500 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:51.167470 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 30 17:01:51.167755 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:51.167731 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-kxwfx\"" Jul 30 17:01:51.167855 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:51.167735 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 30 17:01:51.173731 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:51.173703 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-p8cg5"] Jul 30 17:01:51.190133 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:51.190095 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:51.207330 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:51.207293 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db4kf\" (UniqueName: \"kubernetes.io/projected/b03a0311-edc6-4935-86c6-70d02a37d27c-kube-api-access-db4kf\") pod \"prometheus-operator-84d69f794d-p8cg5\" (UID: \"b03a0311-edc6-4935-86c6-70d02a37d27c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-p8cg5" Jul 30 17:01:51.207516 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:51.207379 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b03a0311-edc6-4935-86c6-70d02a37d27c-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-p8cg5\" (UID: \"b03a0311-edc6-4935-86c6-70d02a37d27c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-p8cg5" Jul 30 17:01:51.207516 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:51.207421 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b03a0311-edc6-4935-86c6-70d02a37d27c-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-p8cg5\" (UID: \"b03a0311-edc6-4935-86c6-70d02a37d27c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-p8cg5" Jul 30 17:01:51.207516 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:51.207497 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b03a0311-edc6-4935-86c6-70d02a37d27c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-p8cg5\" (UID: \"b03a0311-edc6-4935-86c6-70d02a37d27c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-p8cg5" Jul 30 17:01:51.292115 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:51.292079 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:51.308489 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:51.308404 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b03a0311-edc6-4935-86c6-70d02a37d27c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-p8cg5\" (UID: \"b03a0311-edc6-4935-86c6-70d02a37d27c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-p8cg5" Jul 30 17:01:51.308663 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:51.308579 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db4kf\" (UniqueName: \"kubernetes.io/projected/b03a0311-edc6-4935-86c6-70d02a37d27c-kube-api-access-db4kf\") pod \"prometheus-operator-84d69f794d-p8cg5\" (UID: \"b03a0311-edc6-4935-86c6-70d02a37d27c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-p8cg5" Jul 30 17:01:51.308663 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:51.308653 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b03a0311-edc6-4935-86c6-70d02a37d27c-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-p8cg5\" (UID: \"b03a0311-edc6-4935-86c6-70d02a37d27c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-p8cg5" Jul 30 17:01:51.308785 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:51.308702 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b03a0311-edc6-4935-86c6-70d02a37d27c-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-p8cg5\" (UID: \"b03a0311-edc6-4935-86c6-70d02a37d27c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-p8cg5" Jul 30 17:01:51.309350 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:51.309327 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b03a0311-edc6-4935-86c6-70d02a37d27c-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-p8cg5\" (UID: \"b03a0311-edc6-4935-86c6-70d02a37d27c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-p8cg5" Jul 30 17:01:51.310877 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:51.310849 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b03a0311-edc6-4935-86c6-70d02a37d27c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-p8cg5\" (UID: \"b03a0311-edc6-4935-86c6-70d02a37d27c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-p8cg5" Jul 30 17:01:51.311130 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:51.311110 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b03a0311-edc6-4935-86c6-70d02a37d27c-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-p8cg5\" (UID: \"b03a0311-edc6-4935-86c6-70d02a37d27c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-p8cg5" Jul 30 17:01:51.317192 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:51.317166 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-db4kf\" (UniqueName: \"kubernetes.io/projected/b03a0311-edc6-4935-86c6-70d02a37d27c-kube-api-access-db4kf\") pod \"prometheus-operator-84d69f794d-p8cg5\" (UID: \"b03a0311-edc6-4935-86c6-70d02a37d27c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-p8cg5" Jul 30 17:01:51.388534 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:51.388502 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:51.475435 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:51.475396 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-p8cg5" Jul 30 17:01:51.493249 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:51.493212 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:51.606838 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:51.606744 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:51.706929 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:51.706895 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:51.808019 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:51.807979 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:52.027107 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:52.027072 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:52.127430 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:52.127395 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:52.191808 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:52.191768 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-p8cg5"] Jul 30 17:01:52.197087 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:01:52.197052 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb03a0311_edc6_4935_86c6_70d02a37d27c.slice/crio-e9bd1d4b6847d815e0b7686b6574840c1b9e0bd76c80a1c366d6be9818238c3e WatchSource:0}: Error finding container e9bd1d4b6847d815e0b7686b6574840c1b9e0bd76c80a1c366d6be9818238c3e: Status 404 returned error can't find the container with id e9bd1d4b6847d815e0b7686b6574840c1b9e0bd76c80a1c366d6be9818238c3e Jul 30 17:01:52.223271 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:52.223239 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-6t9lf"] Jul 30 17:01:52.227200 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:01:52.227172 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeff18f41_6541_4186_aba6_26e3505c3613.slice/crio-a7661594fe97ed349def1611fe23d1e5bb337d00b124d94aaa58006c514205fb WatchSource:0}: Error finding container a7661594fe97ed349def1611fe23d1e5bb337d00b124d94aaa58006c514205fb: Status 404 returned error can't find the container with id a7661594fe97ed349def1611fe23d1e5bb337d00b124d94aaa58006c514205fb Jul 30 17:01:52.232565 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:52.232532 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:52.333387 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:52.333304 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:52.433101 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:52.433067 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:52.533593 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:52.533540 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:52.701882 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:52.701845 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tktgh" event={"ID":"4f88bc24-37c8-4a16-9f26-67effbdbc720","Type":"ContainerStarted","Data":"1e3e75f7e4c20c2a9b1b10ae73b874328b4a77fc85c2b85b3d74ff18c65bbd7d"} Jul 30 17:01:52.703620 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:52.703583 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-p8cg5" event={"ID":"b03a0311-edc6-4935-86c6-70d02a37d27c","Type":"ContainerStarted","Data":"e9bd1d4b6847d815e0b7686b6574840c1b9e0bd76c80a1c366d6be9818238c3e"} Jul 30 17:01:52.705704 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:52.705674 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-6t9lf" event={"ID":"eff18f41-6541-4186-aba6-26e3505c3613","Type":"ContainerStarted","Data":"a7661594fe97ed349def1611fe23d1e5bb337d00b124d94aaa58006c514205fb"} Jul 30 17:01:54.351662 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:54.351620 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:54.454280 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:54.454210 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:54.627973 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:54.627893 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:54.715375 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:54.715329 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-p8cg5" event={"ID":"b03a0311-edc6-4935-86c6-70d02a37d27c","Type":"ContainerStarted","Data":"a1d7ff75bb830a071c1581aaa4ff4cfbbbeedf0470ceb209670497e884020b26"} Jul 30 17:01:54.715543 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:54.715407 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-p8cg5" event={"ID":"b03a0311-edc6-4935-86c6-70d02a37d27c","Type":"ContainerStarted","Data":"897a0bdd0ce41872d09790e43027f97dd290063e42de0a3272d64cad3e07cf74"} Jul 30 17:01:54.730035 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:54.729998 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:54.736259 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:54.736189 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-p8cg5" podStartSLOduration=2.270546676 podStartE2EDuration="3.736167613s" totalImagesPullingTime="1.465620937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:54.734842462 +0000 UTC m=+60.867689419" watchObservedRunningTime="2026-07-30 17:01:54.736167613 +0000 UTC m=+60.869014549" Jul 30 17:01:54.832836 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:54.832801 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:55.614086 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:55.614057 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-77btm" Jul 30 17:01:55.815284 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:55.815250 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:55.916985 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:55.916936 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:56.245849 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.245763 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:56.356699 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.356662 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:56.485593 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.485530 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:56.496112 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.496030 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-bddfd"] Jul 30 17:01:56.521151 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.521103 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-bddfd"] Jul 30 17:01:56.521337 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.521282 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bddfd" Jul 30 17:01:56.524098 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.524044 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-npf8k\"" Jul 30 17:01:56.524098 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.524072 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 30 17:01:56.524301 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.524149 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 30 17:01:56.531707 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.531671 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wkkz5"] Jul 30 17:01:56.536096 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.536071 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wkkz5" Jul 30 17:01:56.539185 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.539151 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-m27tn\"" Jul 30 17:01:56.539328 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.539277 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 30 17:01:56.539715 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.539696 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 30 17:01:56.539956 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.539937 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 30 17:01:56.543671 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.543580 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-c9bw7"] Jul 30 17:01:56.547267 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.547241 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c9bw7" Jul 30 17:01:56.551647 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.551613 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-jcxs8\"" Jul 30 17:01:56.551647 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.551613 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 30 17:01:56.551849 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.551640 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 30 17:01:56.553262 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.553237 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 30 17:01:56.556874 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.556847 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ded37f1c-e05e-4b86-ba0f-e534666e7809-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-bddfd\" (UID: \"ded37f1c-e05e-4b86-ba0f-e534666e7809\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bddfd" Jul 30 17:01:56.556996 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.556898 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ded37f1c-e05e-4b86-ba0f-e534666e7809-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-bddfd\" (UID: \"ded37f1c-e05e-4b86-ba0f-e534666e7809\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bddfd" Jul 30 17:01:56.556996 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.556926 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ded37f1c-e05e-4b86-ba0f-e534666e7809-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-bddfd\" (UID: \"ded37f1c-e05e-4b86-ba0f-e534666e7809\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bddfd" Jul 30 17:01:56.556996 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.556964 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnn4l\" (UniqueName: \"kubernetes.io/projected/ded37f1c-e05e-4b86-ba0f-e534666e7809-kube-api-access-xnn4l\") pod \"openshift-state-metrics-b8f49f5c6-bddfd\" (UID: \"ded37f1c-e05e-4b86-ba0f-e534666e7809\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bddfd" Jul 30 17:01:56.561701 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.561672 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-c9bw7"] Jul 30 17:01:56.588896 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.588849 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:56.657940 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.657911 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b64c71e9-273c-41c0-abba-77b6cc09aaaa-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-c9bw7\" (UID: \"b64c71e9-273c-41c0-abba-77b6cc09aaaa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c9bw7" Jul 30 17:01:56.657940 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.657948 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b64c71e9-273c-41c0-abba-77b6cc09aaaa-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-c9bw7\" (UID: \"b64c71e9-273c-41c0-abba-77b6cc09aaaa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c9bw7" Jul 30 17:01:56.658436 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.658049 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/010f3382-7f6e-4077-8123-783989ce2bb7-sys\") pod \"node-exporter-wkkz5\" (UID: \"010f3382-7f6e-4077-8123-783989ce2bb7\") " pod="openshift-monitoring/node-exporter-wkkz5" Jul 30 17:01:56.658436 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.658110 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ded37f1c-e05e-4b86-ba0f-e534666e7809-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-bddfd\" (UID: \"ded37f1c-e05e-4b86-ba0f-e534666e7809\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bddfd" Jul 30 17:01:56.658436 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.658147 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/010f3382-7f6e-4077-8123-783989ce2bb7-metrics-client-ca\") pod \"node-exporter-wkkz5\" (UID: \"010f3382-7f6e-4077-8123-783989ce2bb7\") " pod="openshift-monitoring/node-exporter-wkkz5" Jul 30 17:01:56.658436 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.658183 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/010f3382-7f6e-4077-8123-783989ce2bb7-node-exporter-wtmp\") pod \"node-exporter-wkkz5\" (UID: \"010f3382-7f6e-4077-8123-783989ce2bb7\") " pod="openshift-monitoring/node-exporter-wkkz5" Jul 30 17:01:56.658436 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.658207 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/010f3382-7f6e-4077-8123-783989ce2bb7-node-exporter-tls\") pod \"node-exporter-wkkz5\" (UID: \"010f3382-7f6e-4077-8123-783989ce2bb7\") " pod="openshift-monitoring/node-exporter-wkkz5" Jul 30 17:01:56.658436 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.658230 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b64c71e9-273c-41c0-abba-77b6cc09aaaa-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-c9bw7\" (UID: \"b64c71e9-273c-41c0-abba-77b6cc09aaaa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c9bw7" Jul 30 17:01:56.658436 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.658293 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/010f3382-7f6e-4077-8123-783989ce2bb7-root\") pod \"node-exporter-wkkz5\" (UID: \"010f3382-7f6e-4077-8123-783989ce2bb7\") " pod="openshift-monitoring/node-exporter-wkkz5" Jul 30 17:01:56.658436 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.658335 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/010f3382-7f6e-4077-8123-783989ce2bb7-node-exporter-accelerators-collector-config\") pod \"node-exporter-wkkz5\" (UID: \"010f3382-7f6e-4077-8123-783989ce2bb7\") " pod="openshift-monitoring/node-exporter-wkkz5" Jul 30 17:01:56.658436 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.658415 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/010f3382-7f6e-4077-8123-783989ce2bb7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wkkz5\" (UID: \"010f3382-7f6e-4077-8123-783989ce2bb7\") " pod="openshift-monitoring/node-exporter-wkkz5" Jul 30 17:01:56.658922 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.658456 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/010f3382-7f6e-4077-8123-783989ce2bb7-node-exporter-textfile\") pod \"node-exporter-wkkz5\" (UID: \"010f3382-7f6e-4077-8123-783989ce2bb7\") " pod="openshift-monitoring/node-exporter-wkkz5" Jul 30 17:01:56.658922 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.658684 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ded37f1c-e05e-4b86-ba0f-e534666e7809-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-bddfd\" (UID: \"ded37f1c-e05e-4b86-ba0f-e534666e7809\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bddfd" Jul 30 17:01:56.658922 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.658726 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ded37f1c-e05e-4b86-ba0f-e534666e7809-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-bddfd\" (UID: \"ded37f1c-e05e-4b86-ba0f-e534666e7809\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bddfd" Jul 30 17:01:56.658922 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.658768 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnn4l\" (UniqueName: \"kubernetes.io/projected/ded37f1c-e05e-4b86-ba0f-e534666e7809-kube-api-access-xnn4l\") pod \"openshift-state-metrics-b8f49f5c6-bddfd\" (UID: \"ded37f1c-e05e-4b86-ba0f-e534666e7809\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bddfd" Jul 30 17:01:56.658922 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.658794 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b64c71e9-273c-41c0-abba-77b6cc09aaaa-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-c9bw7\" (UID: \"b64c71e9-273c-41c0-abba-77b6cc09aaaa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c9bw7" Jul 30 17:01:56.658922 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.658821 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b64c71e9-273c-41c0-abba-77b6cc09aaaa-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-c9bw7\" (UID: \"b64c71e9-273c-41c0-abba-77b6cc09aaaa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c9bw7" Jul 30 17:01:56.658922 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.658834 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ded37f1c-e05e-4b86-ba0f-e534666e7809-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-bddfd\" (UID: \"ded37f1c-e05e-4b86-ba0f-e534666e7809\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bddfd" Jul 30 17:01:56.658922 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.658849 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f45fs\" (UniqueName: \"kubernetes.io/projected/b64c71e9-273c-41c0-abba-77b6cc09aaaa-kube-api-access-f45fs\") pod \"kube-state-metrics-56d9f944b4-c9bw7\" (UID: \"b64c71e9-273c-41c0-abba-77b6cc09aaaa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c9bw7" Jul 30 17:01:56.658922 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.658903 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xczmz\" (UniqueName: \"kubernetes.io/projected/010f3382-7f6e-4077-8123-783989ce2bb7-kube-api-access-xczmz\") pod \"node-exporter-wkkz5\" (UID: \"010f3382-7f6e-4077-8123-783989ce2bb7\") " pod="openshift-monitoring/node-exporter-wkkz5" Jul 30 17:01:56.659522 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:56.659342 2570 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 30 17:01:56.659522 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:56.659405 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ded37f1c-e05e-4b86-ba0f-e534666e7809-openshift-state-metrics-tls podName:ded37f1c-e05e-4b86-ba0f-e534666e7809 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:57.159385293 +0000 UTC m=+63.292232229 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ded37f1c-e05e-4b86-ba0f-e534666e7809-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-bddfd" (UID: "ded37f1c-e05e-4b86-ba0f-e534666e7809") : secret "openshift-state-metrics-tls" not found Jul 30 17:01:56.661798 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.661774 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ded37f1c-e05e-4b86-ba0f-e534666e7809-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-bddfd\" (UID: \"ded37f1c-e05e-4b86-ba0f-e534666e7809\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bddfd" Jul 30 17:01:56.667982 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.667935 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnn4l\" (UniqueName: \"kubernetes.io/projected/ded37f1c-e05e-4b86-ba0f-e534666e7809-kube-api-access-xnn4l\") pod \"openshift-state-metrics-b8f49f5c6-bddfd\" (UID: \"ded37f1c-e05e-4b86-ba0f-e534666e7809\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bddfd" Jul 30 17:01:56.680795 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.680761 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:56.759925 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.759836 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b64c71e9-273c-41c0-abba-77b6cc09aaaa-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-c9bw7\" (UID: \"b64c71e9-273c-41c0-abba-77b6cc09aaaa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c9bw7" Jul 30 17:01:56.759925 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.759876 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b64c71e9-273c-41c0-abba-77b6cc09aaaa-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-c9bw7\" (UID: \"b64c71e9-273c-41c0-abba-77b6cc09aaaa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c9bw7" Jul 30 17:01:56.759925 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.759927 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/010f3382-7f6e-4077-8123-783989ce2bb7-sys\") pod \"node-exporter-wkkz5\" (UID: \"010f3382-7f6e-4077-8123-783989ce2bb7\") " pod="openshift-monitoring/node-exporter-wkkz5" Jul 30 17:01:56.760192 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.759962 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/010f3382-7f6e-4077-8123-783989ce2bb7-metrics-client-ca\") pod \"node-exporter-wkkz5\" (UID: \"010f3382-7f6e-4077-8123-783989ce2bb7\") " pod="openshift-monitoring/node-exporter-wkkz5" Jul 30 17:01:56.760192 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.759991 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/010f3382-7f6e-4077-8123-783989ce2bb7-node-exporter-wtmp\") pod \"node-exporter-wkkz5\" (UID: \"010f3382-7f6e-4077-8123-783989ce2bb7\") " pod="openshift-monitoring/node-exporter-wkkz5" Jul 30 17:01:56.760192 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.760015 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/010f3382-7f6e-4077-8123-783989ce2bb7-node-exporter-tls\") pod \"node-exporter-wkkz5\" (UID: \"010f3382-7f6e-4077-8123-783989ce2bb7\") " pod="openshift-monitoring/node-exporter-wkkz5" Jul 30 17:01:56.760192 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.760038 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b64c71e9-273c-41c0-abba-77b6cc09aaaa-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-c9bw7\" (UID: \"b64c71e9-273c-41c0-abba-77b6cc09aaaa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c9bw7" Jul 30 17:01:56.760192 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.760049 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/010f3382-7f6e-4077-8123-783989ce2bb7-sys\") pod \"node-exporter-wkkz5\" (UID: \"010f3382-7f6e-4077-8123-783989ce2bb7\") " pod="openshift-monitoring/node-exporter-wkkz5" Jul 30 17:01:56.760192 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.760070 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/010f3382-7f6e-4077-8123-783989ce2bb7-root\") pod \"node-exporter-wkkz5\" (UID: \"010f3382-7f6e-4077-8123-783989ce2bb7\") " pod="openshift-monitoring/node-exporter-wkkz5" Jul 30 17:01:56.760192 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.760114 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/010f3382-7f6e-4077-8123-783989ce2bb7-root\") pod \"node-exporter-wkkz5\" (UID: \"010f3382-7f6e-4077-8123-783989ce2bb7\") " pod="openshift-monitoring/node-exporter-wkkz5" Jul 30 17:01:56.760192 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.760140 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/010f3382-7f6e-4077-8123-783989ce2bb7-node-exporter-accelerators-collector-config\") pod \"node-exporter-wkkz5\" (UID: \"010f3382-7f6e-4077-8123-783989ce2bb7\") " pod="openshift-monitoring/node-exporter-wkkz5" Jul 30 17:01:56.760192 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.760189 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/010f3382-7f6e-4077-8123-783989ce2bb7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wkkz5\" (UID: \"010f3382-7f6e-4077-8123-783989ce2bb7\") " pod="openshift-monitoring/node-exporter-wkkz5" Jul 30 17:01:56.760637 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.760220 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/010f3382-7f6e-4077-8123-783989ce2bb7-node-exporter-textfile\") pod \"node-exporter-wkkz5\" (UID: \"010f3382-7f6e-4077-8123-783989ce2bb7\") " pod="openshift-monitoring/node-exporter-wkkz5" Jul 30 17:01:56.760637 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.760238 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/010f3382-7f6e-4077-8123-783989ce2bb7-node-exporter-wtmp\") pod \"node-exporter-wkkz5\" (UID: \"010f3382-7f6e-4077-8123-783989ce2bb7\") " pod="openshift-monitoring/node-exporter-wkkz5" Jul 30 17:01:56.760637 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.760266 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b64c71e9-273c-41c0-abba-77b6cc09aaaa-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-c9bw7\" (UID: \"b64c71e9-273c-41c0-abba-77b6cc09aaaa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c9bw7" Jul 30 17:01:56.760637 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.760292 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b64c71e9-273c-41c0-abba-77b6cc09aaaa-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-c9bw7\" (UID: \"b64c71e9-273c-41c0-abba-77b6cc09aaaa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c9bw7" Jul 30 17:01:56.760637 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.760319 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f45fs\" (UniqueName: \"kubernetes.io/projected/b64c71e9-273c-41c0-abba-77b6cc09aaaa-kube-api-access-f45fs\") pod \"kube-state-metrics-56d9f944b4-c9bw7\" (UID: \"b64c71e9-273c-41c0-abba-77b6cc09aaaa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c9bw7" Jul 30 17:01:56.760637 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.760334 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b64c71e9-273c-41c0-abba-77b6cc09aaaa-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-c9bw7\" (UID: \"b64c71e9-273c-41c0-abba-77b6cc09aaaa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c9bw7" Jul 30 17:01:56.760637 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.760352 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xczmz\" (UniqueName: \"kubernetes.io/projected/010f3382-7f6e-4077-8123-783989ce2bb7-kube-api-access-xczmz\") pod \"node-exporter-wkkz5\" (UID: \"010f3382-7f6e-4077-8123-783989ce2bb7\") " pod="openshift-monitoring/node-exporter-wkkz5" Jul 30 17:01:56.760637 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.760621 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/010f3382-7f6e-4077-8123-783989ce2bb7-metrics-client-ca\") pod \"node-exporter-wkkz5\" (UID: \"010f3382-7f6e-4077-8123-783989ce2bb7\") " pod="openshift-monitoring/node-exporter-wkkz5" Jul 30 17:01:56.761052 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.760835 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/010f3382-7f6e-4077-8123-783989ce2bb7-node-exporter-accelerators-collector-config\") pod \"node-exporter-wkkz5\" (UID: \"010f3382-7f6e-4077-8123-783989ce2bb7\") " pod="openshift-monitoring/node-exporter-wkkz5" Jul 30 17:01:56.761122 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.761071 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/010f3382-7f6e-4077-8123-783989ce2bb7-node-exporter-textfile\") pod \"node-exporter-wkkz5\" (UID: \"010f3382-7f6e-4077-8123-783989ce2bb7\") " pod="openshift-monitoring/node-exporter-wkkz5" Jul 30 17:01:56.761632 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.761264 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b64c71e9-273c-41c0-abba-77b6cc09aaaa-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-c9bw7\" (UID: \"b64c71e9-273c-41c0-abba-77b6cc09aaaa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c9bw7" Jul 30 17:01:56.761632 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.761371 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b64c71e9-273c-41c0-abba-77b6cc09aaaa-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-c9bw7\" (UID: \"b64c71e9-273c-41c0-abba-77b6cc09aaaa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c9bw7" Jul 30 17:01:56.762826 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.762806 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/010f3382-7f6e-4077-8123-783989ce2bb7-node-exporter-tls\") pod \"node-exporter-wkkz5\" (UID: \"010f3382-7f6e-4077-8123-783989ce2bb7\") " pod="openshift-monitoring/node-exporter-wkkz5" Jul 30 17:01:56.762951 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.762915 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b64c71e9-273c-41c0-abba-77b6cc09aaaa-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-c9bw7\" (UID: \"b64c71e9-273c-41c0-abba-77b6cc09aaaa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c9bw7" Jul 30 17:01:56.763437 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.763412 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/010f3382-7f6e-4077-8123-783989ce2bb7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wkkz5\" (UID: \"010f3382-7f6e-4077-8123-783989ce2bb7\") " pod="openshift-monitoring/node-exporter-wkkz5" Jul 30 17:01:56.763843 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.763821 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b64c71e9-273c-41c0-abba-77b6cc09aaaa-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-c9bw7\" (UID: \"b64c71e9-273c-41c0-abba-77b6cc09aaaa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c9bw7" Jul 30 17:01:56.769104 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.769081 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xczmz\" (UniqueName: \"kubernetes.io/projected/010f3382-7f6e-4077-8123-783989ce2bb7-kube-api-access-xczmz\") pod \"node-exporter-wkkz5\" (UID: \"010f3382-7f6e-4077-8123-783989ce2bb7\") " pod="openshift-monitoring/node-exporter-wkkz5" Jul 30 17:01:56.769225 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.769153 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f45fs\" (UniqueName: \"kubernetes.io/projected/b64c71e9-273c-41c0-abba-77b6cc09aaaa-kube-api-access-f45fs\") pod \"kube-state-metrics-56d9f944b4-c9bw7\" (UID: \"b64c71e9-273c-41c0-abba-77b6cc09aaaa\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c9bw7" Jul 30 17:01:56.782738 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.782706 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:56.847871 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.847838 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wkkz5" Jul 30 17:01:56.859050 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:01:56.859013 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod010f3382_7f6e_4077_8123_783989ce2bb7.slice/crio-ee1fa261d61b9c728dad340d9a241a724245c7787222a2e62d7b785a702859fb WatchSource:0}: Error finding container ee1fa261d61b9c728dad340d9a241a724245c7787222a2e62d7b785a702859fb: Status 404 returned error can't find the container with id ee1fa261d61b9c728dad340d9a241a724245c7787222a2e62d7b785a702859fb Jul 30 17:01:56.860055 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:56.859853 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c9bw7" Jul 30 17:01:57.017884 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.017794 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-c9bw7"] Jul 30 17:01:57.021148 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:01:57.021113 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb64c71e9_273c_41c0_abba_77b6cc09aaaa.slice/crio-652a25b903cb38b1e2686951f4b7c2bd0ba78136daafd5c0030f990576bdac46 WatchSource:0}: Error finding container 652a25b903cb38b1e2686951f4b7c2bd0ba78136daafd5c0030f990576bdac46: Status 404 returned error can't find the container with id 652a25b903cb38b1e2686951f4b7c2bd0ba78136daafd5c0030f990576bdac46 Jul 30 17:01:57.163244 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.163205 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ded37f1c-e05e-4b86-ba0f-e534666e7809-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-bddfd\" (UID: \"ded37f1c-e05e-4b86-ba0f-e534666e7809\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bddfd" Jul 30 17:01:57.165633 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.165611 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ded37f1c-e05e-4b86-ba0f-e534666e7809-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-bddfd\" (UID: \"ded37f1c-e05e-4b86-ba0f-e534666e7809\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bddfd" Jul 30 17:01:57.248518 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.248478 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:57.349419 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.349272 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:57.434454 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.434417 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bddfd" Jul 30 17:01:57.573461 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.573396 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:57.596687 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.596645 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 30 17:01:57.600415 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.600263 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.602838 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.602667 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 30 17:01:57.603261 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.603074 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vkwkd\"" Jul 30 17:01:57.603491 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.603359 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 30 17:01:57.603864 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.603741 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 30 17:01:57.603864 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.603777 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 30 17:01:57.603864 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.603788 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 30 17:01:57.604061 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.603880 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 30 17:01:57.604061 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.603989 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 30 17:01:57.604061 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.604020 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 30 17:01:57.604212 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.604073 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 30 17:01:57.609745 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.609707 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-bddfd"] Jul 30 17:01:57.616461 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.616432 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 30 17:01:57.669509 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.668834 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.669509 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.668914 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.669509 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.668957 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.669509 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.669020 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.669509 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.669057 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-web-config\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.669509 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.669091 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpjcf\" (UniqueName: \"kubernetes.io/projected/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-kube-api-access-zpjcf\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.669509 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.669120 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-config-out\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.669509 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.669161 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-config-volume\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.669509 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.669186 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.669509 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.669218 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.669509 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.669244 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.669509 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.669280 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.669509 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.669322 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.686737 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.686649 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:57.744382 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.744341 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c9bw7" event={"ID":"b64c71e9-273c-41c0-abba-77b6cc09aaaa","Type":"ContainerStarted","Data":"652a25b903cb38b1e2686951f4b7c2bd0ba78136daafd5c0030f990576bdac46"} Jul 30 17:01:57.749712 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.749675 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tktgh" event={"ID":"4f88bc24-37c8-4a16-9f26-67effbdbc720","Type":"ContainerStarted","Data":"0e2e4986d1f5b2b74439cea3034af4e9096f983171d139b7a13fecddf87d85b8"} Jul 30 17:01:57.753323 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.753168 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wkkz5" event={"ID":"010f3382-7f6e-4077-8123-783989ce2bb7","Type":"ContainerStarted","Data":"ee1fa261d61b9c728dad340d9a241a724245c7787222a2e62d7b785a702859fb"} Jul 30 17:01:57.769971 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.769927 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.770292 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.770272 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-web-config\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.770432 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.770405 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpjcf\" (UniqueName: \"kubernetes.io/projected/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-kube-api-access-zpjcf\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.770568 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.770531 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-config-out\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.770695 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.770680 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-config-volume\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.770804 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.770788 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.770928 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.770912 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.771053 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.771038 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.771195 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.771179 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.771353 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.771336 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.771498 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.771481 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.771746 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.771727 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.773021 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.772620 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.773700 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.773359 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.774291 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.773953 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.774676 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:01:57.774658 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-alertmanager-trusted-ca-bundle podName:d88ddf41-ef6c-4f51-b06a-71a3c3cde73a nodeName:}" failed. No retries permitted until 2026-07-30 17:01:58.274631879 +0000 UTC m=+64.407478821 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "d88ddf41-ef6c-4f51-b06a-71a3c3cde73a") : configmap references non-existent config key: ca-bundle.crt Jul 30 17:01:57.775786 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.775761 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-config-volume\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.779436 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.779283 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.779953 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.779796 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-web-config\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.779953 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.779830 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.779953 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.779909 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.780163 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.780020 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-config-out\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.780163 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.780049 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.780163 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.780143 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:57.780762 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.780720 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.782279 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.782258 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.790820 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.790758 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpjcf\" (UniqueName: \"kubernetes.io/projected/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-kube-api-access-zpjcf\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:57.829289 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:01:57.829249 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podded37f1c_e05e_4b86_ba0f_e534666e7809.slice/crio-ba1ae4b6f60b8b215f02e9a800d66d1012c1a20c514720b7fe163abafe35ff97 WatchSource:0}: Error finding container ba1ae4b6f60b8b215f02e9a800d66d1012c1a20c514720b7fe163abafe35ff97: Status 404 returned error can't find the container with id ba1ae4b6f60b8b215f02e9a800d66d1012c1a20c514720b7fe163abafe35ff97 Jul 30 17:01:57.923544 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:57.923513 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:58.023688 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.023630 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:58.277787 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.277750 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:58.278872 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.278841 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:58.514754 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.514728 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:01:58.519349 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.519296 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tktgh" podStartSLOduration=3.299608888 podStartE2EDuration="18.519273348s" totalImagesPullingTime="15.21966446s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:01:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:57.775123151 +0000 UTC m=+63.907970108" watchObservedRunningTime="2026-07-30 17:01:58.519273348 +0000 UTC m=+64.652120305" Jul 30 17:01:58.519580 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.519560 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7"] Jul 30 17:01:58.523750 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.523592 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" Jul 30 17:01:58.526783 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.526303 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 30 17:01:58.526783 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.526375 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 30 17:01:58.526783 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.526676 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 30 17:01:58.526951 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.526849 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-cfhgl\"" Jul 30 17:01:58.526951 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.526899 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7dhpck05v1kuj\"" Jul 30 17:01:58.526951 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.526910 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 30 17:01:58.527360 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.527215 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 30 17:01:58.540060 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.539821 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7"] Jul 30 17:01:58.581405 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.581338 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/667c2a81-0d30-431d-8799-dfba176558ab-secret-grpc-tls\") pod \"thanos-querier-7cbc9d5bb8-9wxz7\" (UID: \"667c2a81-0d30-431d-8799-dfba176558ab\") " pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" Jul 30 17:01:58.581579 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.581438 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/667c2a81-0d30-431d-8799-dfba176558ab-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7cbc9d5bb8-9wxz7\" (UID: \"667c2a81-0d30-431d-8799-dfba176558ab\") " pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" Jul 30 17:01:58.581579 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.581484 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/667c2a81-0d30-431d-8799-dfba176558ab-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7cbc9d5bb8-9wxz7\" (UID: \"667c2a81-0d30-431d-8799-dfba176558ab\") " pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" Jul 30 17:01:58.581579 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.581520 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/667c2a81-0d30-431d-8799-dfba176558ab-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7cbc9d5bb8-9wxz7\" (UID: \"667c2a81-0d30-431d-8799-dfba176558ab\") " pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" Jul 30 17:01:58.581579 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.581575 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/667c2a81-0d30-431d-8799-dfba176558ab-secret-thanos-querier-tls\") pod \"thanos-querier-7cbc9d5bb8-9wxz7\" (UID: \"667c2a81-0d30-431d-8799-dfba176558ab\") " pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" Jul 30 17:01:58.582094 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.581612 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/667c2a81-0d30-431d-8799-dfba176558ab-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7cbc9d5bb8-9wxz7\" (UID: \"667c2a81-0d30-431d-8799-dfba176558ab\") " pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" Jul 30 17:01:58.582094 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.581665 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/667c2a81-0d30-431d-8799-dfba176558ab-metrics-client-ca\") pod \"thanos-querier-7cbc9d5bb8-9wxz7\" (UID: \"667c2a81-0d30-431d-8799-dfba176558ab\") " pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" Jul 30 17:01:58.582094 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.581693 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sdsx\" (UniqueName: \"kubernetes.io/projected/667c2a81-0d30-431d-8799-dfba176558ab-kube-api-access-2sdsx\") pod \"thanos-querier-7cbc9d5bb8-9wxz7\" (UID: \"667c2a81-0d30-431d-8799-dfba176558ab\") " pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" Jul 30 17:01:58.683398 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.682975 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/667c2a81-0d30-431d-8799-dfba176558ab-secret-grpc-tls\") pod \"thanos-querier-7cbc9d5bb8-9wxz7\" (UID: \"667c2a81-0d30-431d-8799-dfba176558ab\") " pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" Jul 30 17:01:58.683398 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.683056 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/667c2a81-0d30-431d-8799-dfba176558ab-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7cbc9d5bb8-9wxz7\" (UID: \"667c2a81-0d30-431d-8799-dfba176558ab\") " pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" Jul 30 17:01:58.683398 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.683098 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/667c2a81-0d30-431d-8799-dfba176558ab-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7cbc9d5bb8-9wxz7\" (UID: \"667c2a81-0d30-431d-8799-dfba176558ab\") " pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" Jul 30 17:01:58.683398 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.683137 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/667c2a81-0d30-431d-8799-dfba176558ab-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7cbc9d5bb8-9wxz7\" (UID: \"667c2a81-0d30-431d-8799-dfba176558ab\") " pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" Jul 30 17:01:58.683398 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.683172 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/667c2a81-0d30-431d-8799-dfba176558ab-secret-thanos-querier-tls\") pod \"thanos-querier-7cbc9d5bb8-9wxz7\" (UID: \"667c2a81-0d30-431d-8799-dfba176558ab\") " pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" Jul 30 17:01:58.683398 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.683206 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/667c2a81-0d30-431d-8799-dfba176558ab-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7cbc9d5bb8-9wxz7\" (UID: \"667c2a81-0d30-431d-8799-dfba176558ab\") " pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" Jul 30 17:01:58.683398 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.683250 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/667c2a81-0d30-431d-8799-dfba176558ab-metrics-client-ca\") pod \"thanos-querier-7cbc9d5bb8-9wxz7\" (UID: \"667c2a81-0d30-431d-8799-dfba176558ab\") " pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" Jul 30 17:01:58.683398 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.683274 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sdsx\" (UniqueName: \"kubernetes.io/projected/667c2a81-0d30-431d-8799-dfba176558ab-kube-api-access-2sdsx\") pod \"thanos-querier-7cbc9d5bb8-9wxz7\" (UID: \"667c2a81-0d30-431d-8799-dfba176558ab\") " pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" Jul 30 17:01:58.684580 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.684365 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/667c2a81-0d30-431d-8799-dfba176558ab-metrics-client-ca\") pod \"thanos-querier-7cbc9d5bb8-9wxz7\" (UID: \"667c2a81-0d30-431d-8799-dfba176558ab\") " pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" Jul 30 17:01:58.687311 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.686590 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7t2wd" Jul 30 17:01:58.687757 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.687727 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/667c2a81-0d30-431d-8799-dfba176558ab-secret-thanos-querier-tls\") pod \"thanos-querier-7cbc9d5bb8-9wxz7\" (UID: \"667c2a81-0d30-431d-8799-dfba176558ab\") " pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" Jul 30 17:01:58.690290 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.688489 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/667c2a81-0d30-431d-8799-dfba176558ab-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7cbc9d5bb8-9wxz7\" (UID: \"667c2a81-0d30-431d-8799-dfba176558ab\") " pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" Jul 30 17:01:58.690290 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.688619 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/667c2a81-0d30-431d-8799-dfba176558ab-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7cbc9d5bb8-9wxz7\" (UID: \"667c2a81-0d30-431d-8799-dfba176558ab\") " pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" Jul 30 17:01:58.690290 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.689379 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/667c2a81-0d30-431d-8799-dfba176558ab-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7cbc9d5bb8-9wxz7\" (UID: \"667c2a81-0d30-431d-8799-dfba176558ab\") " pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" Jul 30 17:01:58.690290 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.689641 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/667c2a81-0d30-431d-8799-dfba176558ab-secret-grpc-tls\") pod \"thanos-querier-7cbc9d5bb8-9wxz7\" (UID: \"667c2a81-0d30-431d-8799-dfba176558ab\") " pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" Jul 30 17:01:58.693020 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.692914 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/667c2a81-0d30-431d-8799-dfba176558ab-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7cbc9d5bb8-9wxz7\" (UID: \"667c2a81-0d30-431d-8799-dfba176558ab\") " pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" Jul 30 17:01:58.693288 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.693247 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sdsx\" (UniqueName: \"kubernetes.io/projected/667c2a81-0d30-431d-8799-dfba176558ab-kube-api-access-2sdsx\") pod \"thanos-querier-7cbc9d5bb8-9wxz7\" (UID: \"667c2a81-0d30-431d-8799-dfba176558ab\") " pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" Jul 30 17:01:58.713226 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.713192 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 30 17:01:58.762636 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.762228 2570 generic.go:356] "Generic (PLEG): container finished" podID="010f3382-7f6e-4077-8123-783989ce2bb7" containerID="07ea88d931874194ad7885761f2c69218ba74205587c885adc128f35c2a92fac" exitCode=0 Jul 30 17:01:58.762636 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.762321 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wkkz5" event={"ID":"010f3382-7f6e-4077-8123-783989ce2bb7","Type":"ContainerDied","Data":"07ea88d931874194ad7885761f2c69218ba74205587c885adc128f35c2a92fac"} Jul 30 17:01:58.764309 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.764195 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a","Type":"ContainerStarted","Data":"ed9bff217f2fd4df9a76b0adb570fe79da154f640ca917b1e1a14150b2fec3ed"} Jul 30 17:01:58.770256 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.770116 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bddfd" event={"ID":"ded37f1c-e05e-4b86-ba0f-e534666e7809","Type":"ContainerStarted","Data":"640eb545201cc1b79b4fb63887b77cede1b7a02294b3122e13e066f17dc64248"} Jul 30 17:01:58.770256 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.770202 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bddfd" event={"ID":"ded37f1c-e05e-4b86-ba0f-e534666e7809","Type":"ContainerStarted","Data":"7ae94fd7311ecc7cb5ac8b9b6260d3a3396816d538944da79d6db8ddf8914d19"} Jul 30 17:01:58.770572 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.770486 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bddfd" event={"ID":"ded37f1c-e05e-4b86-ba0f-e534666e7809","Type":"ContainerStarted","Data":"ba1ae4b6f60b8b215f02e9a800d66d1012c1a20c514720b7fe163abafe35ff97"} Jul 30 17:01:58.773404 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.773285 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c9bw7" event={"ID":"b64c71e9-273c-41c0-abba-77b6cc09aaaa","Type":"ContainerStarted","Data":"840195c5733cd7a40fc27f825ea9657ca9975eb2ebd5cd8e4cfe211bbdf61091"} Jul 30 17:01:58.773404 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.773338 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c9bw7" event={"ID":"b64c71e9-273c-41c0-abba-77b6cc09aaaa","Type":"ContainerStarted","Data":"ac02006fcad747ccdf15ea36fbdcf6872bb697b103487e1c708bdc82a2ad8f77"} Jul 30 17:01:58.773404 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.773365 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c9bw7" event={"ID":"b64c71e9-273c-41c0-abba-77b6cc09aaaa","Type":"ContainerStarted","Data":"a025b0d84e0ad28255a2a1bc1f083f5118bbfe2897f27f0f8ba4908838220343"} Jul 30 17:01:58.804117 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.804079 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:58.807782 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.807728 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c9bw7" podStartSLOduration=1.381201528 podStartE2EDuration="2.807707193s" totalImagesPullingTime="1.426505665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:58.807086239 +0000 UTC m=+64.939933196" watchObservedRunningTime="2026-07-30 17:01:58.807707193 +0000 UTC m=+64.940554150" Jul 30 17:01:58.836091 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.836061 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" Jul 30 17:01:58.872644 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:58.872530 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:59.022356 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:59.022123 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7"] Jul 30 17:01:59.253107 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:01:59.253068 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod667c2a81_0d30_431d_8799_dfba176558ab.slice/crio-09a76dfea8d80d0fafd88199bea35db5f18e5b8d67851b95359191bfc911bb44 WatchSource:0}: Error finding container 09a76dfea8d80d0fafd88199bea35db5f18e5b8d67851b95359191bfc911bb44: Status 404 returned error can't find the container with id 09a76dfea8d80d0fafd88199bea35db5f18e5b8d67851b95359191bfc911bb44 Jul 30 17:01:59.440727 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:59.440687 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:59.539618 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:59.539525 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:59.638930 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:59.638847 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:01:59.780951 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:59.780453 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wkkz5" event={"ID":"010f3382-7f6e-4077-8123-783989ce2bb7","Type":"ContainerStarted","Data":"cfb5c8321ef2b304caae55bfa8a461463aec7979717f1c4fe56996839d32f69d"} Jul 30 17:01:59.780951 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:59.780518 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wkkz5" event={"ID":"010f3382-7f6e-4077-8123-783989ce2bb7","Type":"ContainerStarted","Data":"4a6ff86ef011e1f4d756ad9f86382d9b4350038c8961acdf0d8a1296892d70da"} Jul 30 17:01:59.783141 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:59.783108 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bddfd" event={"ID":"ded37f1c-e05e-4b86-ba0f-e534666e7809","Type":"ContainerStarted","Data":"770b7d509ce984449446ef86a1f8d2090d83db63516f792e0b9b5889127f706c"} Jul 30 17:01:59.784633 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:59.784532 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" event={"ID":"667c2a81-0d30-431d-8799-dfba176558ab","Type":"ContainerStarted","Data":"09a76dfea8d80d0fafd88199bea35db5f18e5b8d67851b95359191bfc911bb44"} Jul 30 17:01:59.802006 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:01:59.801892 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wkkz5" podStartSLOduration=2.715402662 podStartE2EDuration="3.801870637s" totalImagesPullingTime="1.000360374s" totalInitContainerRuntime="86.107601ms" isStatefulPod=true podCreationTimestamp="2026-07-30 17:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:59.799918651 +0000 UTC m=+65.932765610" watchObservedRunningTime="2026-07-30 17:01:59.801870637 +0000 UTC m=+65.934717592" Jul 30 17:02:00.102439 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:00.102031 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fdebda4-24ac-4c03-a395-a0e29dc51625-metrics-certs\") pod \"network-metrics-daemon-8vjz8\" (UID: \"3fdebda4-24ac-4c03-a395-a0e29dc51625\") " pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:02:00.104481 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:00.104455 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 30 17:02:00.115488 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:00.115424 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fdebda4-24ac-4c03-a395-a0e29dc51625-metrics-certs\") pod \"network-metrics-daemon-8vjz8\" (UID: \"3fdebda4-24ac-4c03-a395-a0e29dc51625\") " pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:02:00.191127 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:00.191085 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hqjnm\"" Jul 30 17:02:00.199764 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:00.199728 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8vjz8" Jul 30 17:02:00.203058 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:00.203025 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/681ff1ad-fa48-420e-9501-d18e7a57a773-original-pull-secret\") pod \"global-pull-secret-syncer-jhw42\" (UID: \"681ff1ad-fa48-420e-9501-d18e7a57a773\") " pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:02:00.203212 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:00.203111 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98f9n\" (UniqueName: \"kubernetes.io/projected/8400548d-00fa-439c-b7b9-3157adfd8f76-kube-api-access-98f9n\") pod \"network-check-target-hwbcz\" (UID: \"8400548d-00fa-439c-b7b9-3157adfd8f76\") " pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:02:00.205747 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:00.205543 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 30 17:02:00.205747 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:00.205638 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 30 17:02:00.216247 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:00.216149 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 30 17:02:00.216493 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:00.216397 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/681ff1ad-fa48-420e-9501-d18e7a57a773-original-pull-secret\") pod \"global-pull-secret-syncer-jhw42\" (UID: \"681ff1ad-fa48-420e-9501-d18e7a57a773\") " pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:02:00.227423 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:00.227355 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98f9n\" (UniqueName: \"kubernetes.io/projected/8400548d-00fa-439c-b7b9-3157adfd8f76-kube-api-access-98f9n\") pod \"network-check-target-hwbcz\" (UID: \"8400548d-00fa-439c-b7b9-3157adfd8f76\") " pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:02:00.360998 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:00.360885 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bddfd" podStartSLOduration=3.057783891 podStartE2EDuration="4.360858427s" totalImagesPullingTime="1.303074536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:59.817722857 +0000 UTC m=+65.950569814" watchObservedRunningTime="2026-07-30 17:02:00.360858427 +0000 UTC m=+66.493705383" Jul 30 17:02:00.361627 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:00.361599 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8vjz8"] Jul 30 17:02:00.365269 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:02:00.365237 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fdebda4_24ac_4c03_a395_a0e29dc51625.slice/crio-c16f02c981a83d96bf308cfdb7f6d11c52b07553e4f9808db3c1de52134dcf79 WatchSource:0}: Error finding container c16f02c981a83d96bf308cfdb7f6d11c52b07553e4f9808db3c1de52134dcf79: Status 404 returned error can't find the container with id c16f02c981a83d96bf308cfdb7f6d11c52b07553e4f9808db3c1de52134dcf79 Jul 30 17:02:00.479673 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:00.479632 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w7mtp\"" Jul 30 17:02:00.487658 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:00.487627 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:02:00.499502 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:00.499276 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhw42" Jul 30 17:02:00.642816 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:00.642786 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:02:00.671489 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:00.671445 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hwbcz"] Jul 30 17:02:00.677756 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:02:00.677722 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8400548d_00fa_439c_b7b9_3157adfd8f76.slice/crio-675774a5b10730a9f688c4ba850b970d8c1ba898e576a5a86ffc2e6f98743563 WatchSource:0}: Error finding container 675774a5b10730a9f688c4ba850b970d8c1ba898e576a5a86ffc2e6f98743563: Status 404 returned error can't find the container with id 675774a5b10730a9f688c4ba850b970d8c1ba898e576a5a86ffc2e6f98743563 Jul 30 17:02:00.689884 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:00.689845 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jhw42"] Jul 30 17:02:00.693820 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:02:00.693788 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod681ff1ad_fa48_420e_9501_d18e7a57a773.slice/crio-8bfefab5c7be0a328a2fd8e12a07290b81979a8477f41f4594f67041b27b5645 WatchSource:0}: Error finding container 8bfefab5c7be0a328a2fd8e12a07290b81979a8477f41f4594f67041b27b5645: Status 404 returned error can't find the container with id 8bfefab5c7be0a328a2fd8e12a07290b81979a8477f41f4594f67041b27b5645 Jul 30 17:02:00.791399 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:00.791362 2570 generic.go:356] "Generic (PLEG): container finished" podID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerID="3d649b47bcf8c076ab6b4f0a6448f1ea7000db55a0c62164d47fea02ee42f8e6" exitCode=0 Jul 30 17:02:00.791900 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:00.791458 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a","Type":"ContainerDied","Data":"3d649b47bcf8c076ab6b4f0a6448f1ea7000db55a0c62164d47fea02ee42f8e6"} Jul 30 17:02:00.793024 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:00.792981 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hwbcz" event={"ID":"8400548d-00fa-439c-b7b9-3157adfd8f76","Type":"ContainerStarted","Data":"675774a5b10730a9f688c4ba850b970d8c1ba898e576a5a86ffc2e6f98743563"} Jul 30 17:02:00.794622 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:00.794594 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8vjz8" event={"ID":"3fdebda4-24ac-4c03-a395-a0e29dc51625","Type":"ContainerStarted","Data":"c16f02c981a83d96bf308cfdb7f6d11c52b07553e4f9808db3c1de52134dcf79"} Jul 30 17:02:00.796098 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:00.796069 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jhw42" event={"ID":"681ff1ad-fa48-420e-9501-d18e7a57a773","Type":"ContainerStarted","Data":"8bfefab5c7be0a328a2fd8e12a07290b81979a8477f41f4594f67041b27b5645"} Jul 30 17:02:01.003386 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.002438 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7cd864494-k4wmt"] Jul 30 17:02:01.007461 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.007385 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7cd864494-k4wmt" Jul 30 17:02:01.011289 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.010857 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-kwqrv\"" Jul 30 17:02:01.011289 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.011103 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 30 17:02:01.011522 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.011423 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 30 17:02:01.011522 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.011489 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 30 17:02:01.011522 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.011504 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7pgsjf142ri7e\"" Jul 30 17:02:01.011693 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.011423 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 30 17:02:01.018149 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.016384 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7cd864494-k4wmt"] Jul 30 17:02:01.114829 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.114466 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvfrl\" (UniqueName: \"kubernetes.io/projected/8faff120-a679-4343-96dd-92e15fd012ac-kube-api-access-hvfrl\") pod \"metrics-server-7cd864494-k4wmt\" (UID: \"8faff120-a679-4343-96dd-92e15fd012ac\") " pod="openshift-monitoring/metrics-server-7cd864494-k4wmt" Jul 30 17:02:01.114829 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.114526 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8faff120-a679-4343-96dd-92e15fd012ac-secret-metrics-server-tls\") pod \"metrics-server-7cd864494-k4wmt\" (UID: \"8faff120-a679-4343-96dd-92e15fd012ac\") " pod="openshift-monitoring/metrics-server-7cd864494-k4wmt" Jul 30 17:02:01.114829 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.114612 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8faff120-a679-4343-96dd-92e15fd012ac-metrics-server-audit-profiles\") pod \"metrics-server-7cd864494-k4wmt\" (UID: \"8faff120-a679-4343-96dd-92e15fd012ac\") " pod="openshift-monitoring/metrics-server-7cd864494-k4wmt" Jul 30 17:02:01.114829 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.114647 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8faff120-a679-4343-96dd-92e15fd012ac-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7cd864494-k4wmt\" (UID: \"8faff120-a679-4343-96dd-92e15fd012ac\") " pod="openshift-monitoring/metrics-server-7cd864494-k4wmt" Jul 30 17:02:01.114829 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.114674 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8faff120-a679-4343-96dd-92e15fd012ac-audit-log\") pod \"metrics-server-7cd864494-k4wmt\" (UID: \"8faff120-a679-4343-96dd-92e15fd012ac\") " pod="openshift-monitoring/metrics-server-7cd864494-k4wmt" Jul 30 17:02:01.114829 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.114698 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8faff120-a679-4343-96dd-92e15fd012ac-client-ca-bundle\") pod \"metrics-server-7cd864494-k4wmt\" (UID: \"8faff120-a679-4343-96dd-92e15fd012ac\") " pod="openshift-monitoring/metrics-server-7cd864494-k4wmt" Jul 30 17:02:01.114829 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.114763 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8faff120-a679-4343-96dd-92e15fd012ac-secret-metrics-server-client-certs\") pod \"metrics-server-7cd864494-k4wmt\" (UID: \"8faff120-a679-4343-96dd-92e15fd012ac\") " pod="openshift-monitoring/metrics-server-7cd864494-k4wmt" Jul 30 17:02:01.216063 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.216023 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvfrl\" (UniqueName: \"kubernetes.io/projected/8faff120-a679-4343-96dd-92e15fd012ac-kube-api-access-hvfrl\") pod \"metrics-server-7cd864494-k4wmt\" (UID: \"8faff120-a679-4343-96dd-92e15fd012ac\") " pod="openshift-monitoring/metrics-server-7cd864494-k4wmt" Jul 30 17:02:01.216254 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.216079 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8faff120-a679-4343-96dd-92e15fd012ac-secret-metrics-server-tls\") pod \"metrics-server-7cd864494-k4wmt\" (UID: \"8faff120-a679-4343-96dd-92e15fd012ac\") " pod="openshift-monitoring/metrics-server-7cd864494-k4wmt" Jul 30 17:02:01.216254 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.216133 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8faff120-a679-4343-96dd-92e15fd012ac-metrics-server-audit-profiles\") pod \"metrics-server-7cd864494-k4wmt\" (UID: \"8faff120-a679-4343-96dd-92e15fd012ac\") " pod="openshift-monitoring/metrics-server-7cd864494-k4wmt" Jul 30 17:02:01.216254 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.216163 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8faff120-a679-4343-96dd-92e15fd012ac-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7cd864494-k4wmt\" (UID: \"8faff120-a679-4343-96dd-92e15fd012ac\") " pod="openshift-monitoring/metrics-server-7cd864494-k4wmt" Jul 30 17:02:01.216254 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.216191 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8faff120-a679-4343-96dd-92e15fd012ac-audit-log\") pod \"metrics-server-7cd864494-k4wmt\" (UID: \"8faff120-a679-4343-96dd-92e15fd012ac\") " pod="openshift-monitoring/metrics-server-7cd864494-k4wmt" Jul 30 17:02:01.216254 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.216217 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8faff120-a679-4343-96dd-92e15fd012ac-client-ca-bundle\") pod \"metrics-server-7cd864494-k4wmt\" (UID: \"8faff120-a679-4343-96dd-92e15fd012ac\") " pod="openshift-monitoring/metrics-server-7cd864494-k4wmt" Jul 30 17:02:01.216479 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.216271 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8faff120-a679-4343-96dd-92e15fd012ac-secret-metrics-server-client-certs\") pod \"metrics-server-7cd864494-k4wmt\" (UID: \"8faff120-a679-4343-96dd-92e15fd012ac\") " pod="openshift-monitoring/metrics-server-7cd864494-k4wmt" Jul 30 17:02:01.216948 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.216909 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8faff120-a679-4343-96dd-92e15fd012ac-audit-log\") pod \"metrics-server-7cd864494-k4wmt\" (UID: \"8faff120-a679-4343-96dd-92e15fd012ac\") " pod="openshift-monitoring/metrics-server-7cd864494-k4wmt" Jul 30 17:02:01.217209 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.217162 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8faff120-a679-4343-96dd-92e15fd012ac-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7cd864494-k4wmt\" (UID: \"8faff120-a679-4343-96dd-92e15fd012ac\") " pod="openshift-monitoring/metrics-server-7cd864494-k4wmt" Jul 30 17:02:01.217790 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.217728 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8faff120-a679-4343-96dd-92e15fd012ac-metrics-server-audit-profiles\") pod \"metrics-server-7cd864494-k4wmt\" (UID: \"8faff120-a679-4343-96dd-92e15fd012ac\") " pod="openshift-monitoring/metrics-server-7cd864494-k4wmt" Jul 30 17:02:01.219592 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.219566 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8faff120-a679-4343-96dd-92e15fd012ac-client-ca-bundle\") pod \"metrics-server-7cd864494-k4wmt\" (UID: \"8faff120-a679-4343-96dd-92e15fd012ac\") " pod="openshift-monitoring/metrics-server-7cd864494-k4wmt" Jul 30 17:02:01.219700 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.219654 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8faff120-a679-4343-96dd-92e15fd012ac-secret-metrics-server-tls\") pod \"metrics-server-7cd864494-k4wmt\" (UID: \"8faff120-a679-4343-96dd-92e15fd012ac\") " pod="openshift-monitoring/metrics-server-7cd864494-k4wmt" Jul 30 17:02:01.220053 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.220030 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8faff120-a679-4343-96dd-92e15fd012ac-secret-metrics-server-client-certs\") pod \"metrics-server-7cd864494-k4wmt\" (UID: \"8faff120-a679-4343-96dd-92e15fd012ac\") " pod="openshift-monitoring/metrics-server-7cd864494-k4wmt" Jul 30 17:02:01.228925 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.228890 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvfrl\" (UniqueName: \"kubernetes.io/projected/8faff120-a679-4343-96dd-92e15fd012ac-kube-api-access-hvfrl\") pod \"metrics-server-7cd864494-k4wmt\" (UID: \"8faff120-a679-4343-96dd-92e15fd012ac\") " pod="openshift-monitoring/metrics-server-7cd864494-k4wmt" Jul 30 17:02:01.264807 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.264708 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:02:01.267697 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.267664 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-vgpzd"] Jul 30 17:02:01.272566 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.272514 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vgpzd" Jul 30 17:02:01.274910 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.274726 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 30 17:02:01.274910 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.274780 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-wgtwl\"" Jul 30 17:02:01.279650 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.279572 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-vgpzd"] Jul 30 17:02:01.328092 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.328060 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7cd864494-k4wmt" Jul 30 17:02:01.418374 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.418215 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cfk9\" (UniqueName: \"kubernetes.io/projected/17e68429-66e4-4fa4-82c8-489bcf812165-kube-api-access-9cfk9\") pod \"monitoring-plugin-68b7fc9574-vgpzd\" (UID: \"17e68429-66e4-4fa4-82c8-489bcf812165\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vgpzd" Jul 30 17:02:01.418374 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.418282 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/17e68429-66e4-4fa4-82c8-489bcf812165-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-vgpzd\" (UID: \"17e68429-66e4-4fa4-82c8-489bcf812165\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vgpzd" Jul 30 17:02:01.510143 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.510094 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:02:01.519269 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.519167 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/17e68429-66e4-4fa4-82c8-489bcf812165-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-vgpzd\" (UID: \"17e68429-66e4-4fa4-82c8-489bcf812165\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vgpzd" Jul 30 17:02:01.519434 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.519278 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cfk9\" (UniqueName: \"kubernetes.io/projected/17e68429-66e4-4fa4-82c8-489bcf812165-kube-api-access-9cfk9\") pod \"monitoring-plugin-68b7fc9574-vgpzd\" (UID: \"17e68429-66e4-4fa4-82c8-489bcf812165\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vgpzd" Jul 30 17:02:01.522802 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.522756 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/17e68429-66e4-4fa4-82c8-489bcf812165-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-vgpzd\" (UID: \"17e68429-66e4-4fa4-82c8-489bcf812165\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vgpzd" Jul 30 17:02:01.530261 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.530202 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cfk9\" (UniqueName: \"kubernetes.io/projected/17e68429-66e4-4fa4-82c8-489bcf812165-kube-api-access-9cfk9\") pod \"monitoring-plugin-68b7fc9574-vgpzd\" (UID: \"17e68429-66e4-4fa4-82c8-489bcf812165\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vgpzd" Jul 30 17:02:01.592471 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.592237 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vgpzd" Jul 30 17:02:01.612335 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.612218 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:02:01.625118 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.625058 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6cd4499d55-d4mv2"] Jul 30 17:02:01.631505 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.631471 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6cd4499d55-d4mv2" Jul 30 17:02:01.634966 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.634939 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 30 17:02:01.635764 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.634939 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 30 17:02:01.635764 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.634960 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-6gdb9\"" Jul 30 17:02:01.635764 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.634991 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 30 17:02:01.635764 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.635024 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 30 17:02:01.636673 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.636653 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 30 17:02:01.640725 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.640699 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 30 17:02:01.644197 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.644169 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6cd4499d55-d4mv2"] Jul 30 17:02:01.721266 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.721229 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5f11093-0de0-48a4-a981-f63982607e72-metrics-client-ca\") pod \"telemeter-client-6cd4499d55-d4mv2\" (UID: \"a5f11093-0de0-48a4-a981-f63982607e72\") " pod="openshift-monitoring/telemeter-client-6cd4499d55-d4mv2" Jul 30 17:02:01.721461 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.721279 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5f11093-0de0-48a4-a981-f63982607e72-serving-certs-ca-bundle\") pod \"telemeter-client-6cd4499d55-d4mv2\" (UID: \"a5f11093-0de0-48a4-a981-f63982607e72\") " pod="openshift-monitoring/telemeter-client-6cd4499d55-d4mv2" Jul 30 17:02:01.721461 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.721369 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a5f11093-0de0-48a4-a981-f63982607e72-federate-client-tls\") pod \"telemeter-client-6cd4499d55-d4mv2\" (UID: \"a5f11093-0de0-48a4-a981-f63982607e72\") " pod="openshift-monitoring/telemeter-client-6cd4499d55-d4mv2" Jul 30 17:02:01.721461 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.721393 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvxm8\" (UniqueName: \"kubernetes.io/projected/a5f11093-0de0-48a4-a981-f63982607e72-kube-api-access-nvxm8\") pod \"telemeter-client-6cd4499d55-d4mv2\" (UID: \"a5f11093-0de0-48a4-a981-f63982607e72\") " pod="openshift-monitoring/telemeter-client-6cd4499d55-d4mv2" Jul 30 17:02:01.721461 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.721411 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a5f11093-0de0-48a4-a981-f63982607e72-secret-telemeter-client\") pod \"telemeter-client-6cd4499d55-d4mv2\" (UID: \"a5f11093-0de0-48a4-a981-f63982607e72\") " pod="openshift-monitoring/telemeter-client-6cd4499d55-d4mv2" Jul 30 17:02:01.721461 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.721448 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5f11093-0de0-48a4-a981-f63982607e72-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cd4499d55-d4mv2\" (UID: \"a5f11093-0de0-48a4-a981-f63982607e72\") " pod="openshift-monitoring/telemeter-client-6cd4499d55-d4mv2" Jul 30 17:02:01.721761 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.721566 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5f11093-0de0-48a4-a981-f63982607e72-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cd4499d55-d4mv2\" (UID: \"a5f11093-0de0-48a4-a981-f63982607e72\") " pod="openshift-monitoring/telemeter-client-6cd4499d55-d4mv2" Jul 30 17:02:01.721761 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.721617 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a5f11093-0de0-48a4-a981-f63982607e72-telemeter-client-tls\") pod \"telemeter-client-6cd4499d55-d4mv2\" (UID: \"a5f11093-0de0-48a4-a981-f63982607e72\") " pod="openshift-monitoring/telemeter-client-6cd4499d55-d4mv2" Jul 30 17:02:01.822195 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.822089 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a5f11093-0de0-48a4-a981-f63982607e72-telemeter-client-tls\") pod \"telemeter-client-6cd4499d55-d4mv2\" (UID: \"a5f11093-0de0-48a4-a981-f63982607e72\") " pod="openshift-monitoring/telemeter-client-6cd4499d55-d4mv2" Jul 30 17:02:01.822195 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.822176 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5f11093-0de0-48a4-a981-f63982607e72-metrics-client-ca\") pod \"telemeter-client-6cd4499d55-d4mv2\" (UID: \"a5f11093-0de0-48a4-a981-f63982607e72\") " pod="openshift-monitoring/telemeter-client-6cd4499d55-d4mv2" Jul 30 17:02:01.822746 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.822207 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5f11093-0de0-48a4-a981-f63982607e72-serving-certs-ca-bundle\") pod \"telemeter-client-6cd4499d55-d4mv2\" (UID: \"a5f11093-0de0-48a4-a981-f63982607e72\") " pod="openshift-monitoring/telemeter-client-6cd4499d55-d4mv2" Jul 30 17:02:01.822746 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.822243 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a5f11093-0de0-48a4-a981-f63982607e72-federate-client-tls\") pod \"telemeter-client-6cd4499d55-d4mv2\" (UID: \"a5f11093-0de0-48a4-a981-f63982607e72\") " pod="openshift-monitoring/telemeter-client-6cd4499d55-d4mv2" Jul 30 17:02:01.822746 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.822269 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvxm8\" (UniqueName: \"kubernetes.io/projected/a5f11093-0de0-48a4-a981-f63982607e72-kube-api-access-nvxm8\") pod \"telemeter-client-6cd4499d55-d4mv2\" (UID: \"a5f11093-0de0-48a4-a981-f63982607e72\") " pod="openshift-monitoring/telemeter-client-6cd4499d55-d4mv2" Jul 30 17:02:01.822746 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.822297 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a5f11093-0de0-48a4-a981-f63982607e72-secret-telemeter-client\") pod \"telemeter-client-6cd4499d55-d4mv2\" (UID: \"a5f11093-0de0-48a4-a981-f63982607e72\") " pod="openshift-monitoring/telemeter-client-6cd4499d55-d4mv2" Jul 30 17:02:01.822746 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.822345 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5f11093-0de0-48a4-a981-f63982607e72-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cd4499d55-d4mv2\" (UID: \"a5f11093-0de0-48a4-a981-f63982607e72\") " pod="openshift-monitoring/telemeter-client-6cd4499d55-d4mv2" Jul 30 17:02:01.822746 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.822463 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5f11093-0de0-48a4-a981-f63982607e72-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cd4499d55-d4mv2\" (UID: \"a5f11093-0de0-48a4-a981-f63982607e72\") " pod="openshift-monitoring/telemeter-client-6cd4499d55-d4mv2" Jul 30 17:02:01.823225 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.823172 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5f11093-0de0-48a4-a981-f63982607e72-metrics-client-ca\") pod \"telemeter-client-6cd4499d55-d4mv2\" (UID: \"a5f11093-0de0-48a4-a981-f63982607e72\") " pod="openshift-monitoring/telemeter-client-6cd4499d55-d4mv2" Jul 30 17:02:01.823619 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.823533 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5f11093-0de0-48a4-a981-f63982607e72-serving-certs-ca-bundle\") pod \"telemeter-client-6cd4499d55-d4mv2\" (UID: \"a5f11093-0de0-48a4-a981-f63982607e72\") " pod="openshift-monitoring/telemeter-client-6cd4499d55-d4mv2" Jul 30 17:02:01.823759 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.823724 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5f11093-0de0-48a4-a981-f63982607e72-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cd4499d55-d4mv2\" (UID: \"a5f11093-0de0-48a4-a981-f63982607e72\") " pod="openshift-monitoring/telemeter-client-6cd4499d55-d4mv2" Jul 30 17:02:01.827266 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.825774 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5f11093-0de0-48a4-a981-f63982607e72-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cd4499d55-d4mv2\" (UID: \"a5f11093-0de0-48a4-a981-f63982607e72\") " pod="openshift-monitoring/telemeter-client-6cd4499d55-d4mv2" Jul 30 17:02:01.827266 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.825983 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a5f11093-0de0-48a4-a981-f63982607e72-federate-client-tls\") pod \"telemeter-client-6cd4499d55-d4mv2\" (UID: \"a5f11093-0de0-48a4-a981-f63982607e72\") " pod="openshift-monitoring/telemeter-client-6cd4499d55-d4mv2" Jul 30 17:02:01.827266 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.826196 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a5f11093-0de0-48a4-a981-f63982607e72-secret-telemeter-client\") pod \"telemeter-client-6cd4499d55-d4mv2\" (UID: \"a5f11093-0de0-48a4-a981-f63982607e72\") " pod="openshift-monitoring/telemeter-client-6cd4499d55-d4mv2" Jul 30 17:02:01.827266 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.826354 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a5f11093-0de0-48a4-a981-f63982607e72-telemeter-client-tls\") pod \"telemeter-client-6cd4499d55-d4mv2\" (UID: \"a5f11093-0de0-48a4-a981-f63982607e72\") " pod="openshift-monitoring/telemeter-client-6cd4499d55-d4mv2" Jul 30 17:02:01.834116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.834049 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvxm8\" (UniqueName: \"kubernetes.io/projected/a5f11093-0de0-48a4-a981-f63982607e72-kube-api-access-nvxm8\") pod \"telemeter-client-6cd4499d55-d4mv2\" (UID: \"a5f11093-0de0-48a4-a981-f63982607e72\") " pod="openshift-monitoring/telemeter-client-6cd4499d55-d4mv2" Jul 30 17:02:01.840038 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.839995 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f9f9659d8-xbjcv"] Jul 30 17:02:01.873593 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.873531 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f9f9659d8-xbjcv"] Jul 30 17:02:01.873787 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.873656 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9f9659d8-xbjcv" Jul 30 17:02:01.876978 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.876667 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 30 17:02:01.876978 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.876773 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 30 17:02:01.876978 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.876786 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 30 17:02:01.876978 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.876828 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 30 17:02:01.876978 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.876840 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8spx6\"" Jul 30 17:02:01.876978 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.876928 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 30 17:02:01.923013 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.922981 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-oauth-serving-cert\") pod \"console-6f9f9659d8-xbjcv\" (UID: \"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84\") " pod="openshift-console/console-6f9f9659d8-xbjcv" Jul 30 17:02:01.923195 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.923045 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-console-oauth-config\") pod \"console-6f9f9659d8-xbjcv\" (UID: \"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84\") " pod="openshift-console/console-6f9f9659d8-xbjcv" Jul 30 17:02:01.923195 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.923087 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-service-ca\") pod \"console-6f9f9659d8-xbjcv\" (UID: \"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84\") " pod="openshift-console/console-6f9f9659d8-xbjcv" Jul 30 17:02:01.923195 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.923109 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjz2k\" (UniqueName: \"kubernetes.io/projected/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-kube-api-access-fjz2k\") pod \"console-6f9f9659d8-xbjcv\" (UID: \"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84\") " pod="openshift-console/console-6f9f9659d8-xbjcv" Jul 30 17:02:01.923195 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.923139 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-console-serving-cert\") pod \"console-6f9f9659d8-xbjcv\" (UID: \"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84\") " pod="openshift-console/console-6f9f9659d8-xbjcv" Jul 30 17:02:01.923367 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.923219 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-console-config\") pod \"console-6f9f9659d8-xbjcv\" (UID: \"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84\") " pod="openshift-console/console-6f9f9659d8-xbjcv" Jul 30 17:02:01.947937 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:01.947905 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6cd4499d55-d4mv2" Jul 30 17:02:02.024116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.024079 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-console-oauth-config\") pod \"console-6f9f9659d8-xbjcv\" (UID: \"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84\") " pod="openshift-console/console-6f9f9659d8-xbjcv" Jul 30 17:02:02.024295 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.024159 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-service-ca\") pod \"console-6f9f9659d8-xbjcv\" (UID: \"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84\") " pod="openshift-console/console-6f9f9659d8-xbjcv" Jul 30 17:02:02.024295 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.024184 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjz2k\" (UniqueName: \"kubernetes.io/projected/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-kube-api-access-fjz2k\") pod \"console-6f9f9659d8-xbjcv\" (UID: \"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84\") " pod="openshift-console/console-6f9f9659d8-xbjcv" Jul 30 17:02:02.024295 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.024209 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-console-serving-cert\") pod \"console-6f9f9659d8-xbjcv\" (UID: \"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84\") " pod="openshift-console/console-6f9f9659d8-xbjcv" Jul 30 17:02:02.024295 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.024242 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-console-config\") pod \"console-6f9f9659d8-xbjcv\" (UID: \"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84\") " pod="openshift-console/console-6f9f9659d8-xbjcv" Jul 30 17:02:02.024493 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.024368 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-oauth-serving-cert\") pod \"console-6f9f9659d8-xbjcv\" (UID: \"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84\") " pod="openshift-console/console-6f9f9659d8-xbjcv" Jul 30 17:02:02.025330 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.025302 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-service-ca\") pod \"console-6f9f9659d8-xbjcv\" (UID: \"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84\") " pod="openshift-console/console-6f9f9659d8-xbjcv" Jul 30 17:02:02.025482 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.025302 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-console-config\") pod \"console-6f9f9659d8-xbjcv\" (UID: \"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84\") " pod="openshift-console/console-6f9f9659d8-xbjcv" Jul 30 17:02:02.025482 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.025311 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-oauth-serving-cert\") pod \"console-6f9f9659d8-xbjcv\" (UID: \"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84\") " pod="openshift-console/console-6f9f9659d8-xbjcv" Jul 30 17:02:02.027181 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.027156 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-console-serving-cert\") pod \"console-6f9f9659d8-xbjcv\" (UID: \"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84\") " pod="openshift-console/console-6f9f9659d8-xbjcv" Jul 30 17:02:02.027294 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.027262 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-console-oauth-config\") pod \"console-6f9f9659d8-xbjcv\" (UID: \"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84\") " pod="openshift-console/console-6f9f9659d8-xbjcv" Jul 30 17:02:02.034179 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.034102 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjz2k\" (UniqueName: \"kubernetes.io/projected/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-kube-api-access-fjz2k\") pod \"console-6f9f9659d8-xbjcv\" (UID: \"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84\") " pod="openshift-console/console-6f9f9659d8-xbjcv" Jul 30 17:02:02.185752 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.185709 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9f9659d8-xbjcv" Jul 30 17:02:02.643739 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.638541 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7cd864494-k4wmt"] Jul 30 17:02:02.660836 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.660798 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-vgpzd"] Jul 30 17:02:02.688853 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.686046 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6cd4499d55-d4mv2"] Jul 30 17:02:02.713135 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.713052 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f9f9659d8-xbjcv"] Jul 30 17:02:02.811683 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.811594 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8vjz8" event={"ID":"3fdebda4-24ac-4c03-a395-a0e29dc51625","Type":"ContainerStarted","Data":"3cd4f351d4746e4edd6d965b0c2400ebcc4d2a6b1dea43661bbc430a4b298fc6"} Jul 30 17:02:02.813936 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.813788 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vgpzd" event={"ID":"17e68429-66e4-4fa4-82c8-489bcf812165","Type":"ContainerStarted","Data":"e23a02d567f3ee88532b02be77fe70da8eb54fe07989ca94f373c9c7ba888f40"} Jul 30 17:02:02.819620 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.819502 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9f9659d8-xbjcv" event={"ID":"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84","Type":"ContainerStarted","Data":"936aad9c85c8ddc20c829bd0a39b81775e68597ed11c817b8c32b28fe437b70e"} Jul 30 17:02:02.825456 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.825277 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cd4499d55-d4mv2" event={"ID":"a5f11093-0de0-48a4-a981-f63982607e72","Type":"ContainerStarted","Data":"a32c060210f9e36ea6e249140435410c5f38f99c5aa16d8829900f5e69771daa"} Jul 30 17:02:02.834771 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.834709 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" event={"ID":"667c2a81-0d30-431d-8799-dfba176558ab","Type":"ContainerStarted","Data":"726536fe4e5a76495a3400d2f16c589d4e9488e2c2d684fc29aa2eefba9bf2d6"} Jul 30 17:02:02.834947 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.834801 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" event={"ID":"667c2a81-0d30-431d-8799-dfba176558ab","Type":"ContainerStarted","Data":"8168f00a8bb698e5ec32a565de1500393c789f03cde3ac5090514c5007bbc022"} Jul 30 17:02:02.842641 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.841871 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7cd864494-k4wmt" event={"ID":"8faff120-a679-4343-96dd-92e15fd012ac","Type":"ContainerStarted","Data":"f820dab9e67901562d056a24367127e0556b50775f696d226cb4303f7e97cff8"} Jul 30 17:02:02.901389 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.901247 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:02:02.909177 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.907876 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 30 17:02:02.940615 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.939774 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 30 17:02:02.940615 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.939983 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:02.945987 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.944605 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xlqwd\"" Jul 30 17:02:02.945987 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.944835 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 30 17:02:02.945987 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.945016 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 30 17:02:02.945987 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.945186 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 30 17:02:02.945987 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.945472 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 30 17:02:02.945987 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.945506 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 30 17:02:02.945987 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.945906 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 30 17:02:02.945987 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.945945 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 30 17:02:02.946478 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.946019 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 30 17:02:02.946478 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.946031 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 30 17:02:02.946478 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.945947 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 30 17:02:02.946478 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.946190 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 30 17:02:02.946686 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.946627 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 30 17:02:02.953581 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.950184 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-309jr243q815l\"" Jul 30 17:02:02.953581 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.953034 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 30 17:02:02.960543 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:02.960404 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 30 17:02:03.044523 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.044482 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.044732 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.044540 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.044732 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.044624 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.044732 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.044703 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.044905 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.044735 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.044905 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.044786 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-config-out\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.044905 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.044817 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.044905 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.044852 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-config\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.044905 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.044876 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.045129 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.044911 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.045129 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.044937 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kq9b\" (UniqueName: \"kubernetes.io/projected/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-kube-api-access-6kq9b\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.045129 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.044965 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.045129 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.044994 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.045129 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.045045 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.045129 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.045098 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.045431 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.045132 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-web-config\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.045431 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.045163 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.045431 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.045187 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.045431 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.045233 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.045431 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.045262 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.147203 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.146196 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.147203 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.146296 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.147203 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.146363 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-web-config\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.147203 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.146420 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.147203 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.146447 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.147203 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.146483 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.147203 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.146507 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.147203 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.146542 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.147203 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.146594 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.147203 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.146624 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.147203 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.146655 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.147203 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.146683 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.147203 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.146735 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-config-out\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.147203 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.146821 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.147203 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.146883 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-config\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.147203 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.146926 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.147203 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.146990 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.148359 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.147017 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kq9b\" (UniqueName: \"kubernetes.io/projected/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-kube-api-access-6kq9b\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.148359 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.147045 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.148359 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.147079 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.148359 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.147471 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.148359 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.147569 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.148359 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.148195 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.150787 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.150444 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.153533 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.152839 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.153533 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.153000 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.154786 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.154759 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.156696 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.156666 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.161288 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.161223 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.163966 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.163905 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-web-config\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.164796 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.164738 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-config-out\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.165447 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.165144 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.165447 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.165399 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.166247 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.165799 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.166247 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.166196 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.166402 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.166329 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-config\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.167159 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.167106 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.167159 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.167149 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.169704 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.169645 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.172536 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.172114 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kq9b\" (UniqueName: \"kubernetes.io/projected/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-kube-api-access-6kq9b\") pod \"prometheus-k8s-0\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.268420 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.268109 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:03.506185 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.506136 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 30 17:02:03.517412 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:02:03.517209 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3cebcb0_d8af_4ca9_9bf1_f128ceb5112d.slice/crio-1233296d59d9bc85ca4f921749a1b186836822df1bf2c962d55acd7ee9013a53 WatchSource:0}: Error finding container 1233296d59d9bc85ca4f921749a1b186836822df1bf2c962d55acd7ee9013a53: Status 404 returned error can't find the container with id 1233296d59d9bc85ca4f921749a1b186836822df1bf2c962d55acd7ee9013a53 Jul 30 17:02:03.863809 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.862775 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8vjz8" event={"ID":"3fdebda4-24ac-4c03-a395-a0e29dc51625","Type":"ContainerStarted","Data":"08980dce5225c862ba68137909ee13b5bc5783e23dfd9657291e8487385d3df0"} Jul 30 17:02:03.873321 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.873210 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" event={"ID":"667c2a81-0d30-431d-8799-dfba176558ab","Type":"ContainerStarted","Data":"022c99579af771c6dda3272b2956778b89f3c88d274cf6c945cf241b359fc3d4"} Jul 30 17:02:03.878499 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.877412 2570 generic.go:356] "Generic (PLEG): container finished" podID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerID="3b4eb9aa95aa2b9e1a0f2d9c28348d8ebf7d66224ef278e21c87247011a24266" exitCode=0 Jul 30 17:02:03.878499 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.877470 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d","Type":"ContainerDied","Data":"3b4eb9aa95aa2b9e1a0f2d9c28348d8ebf7d66224ef278e21c87247011a24266"} Jul 30 17:02:03.878499 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.877562 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d","Type":"ContainerStarted","Data":"1233296d59d9bc85ca4f921749a1b186836822df1bf2c962d55acd7ee9013a53"} Jul 30 17:02:03.918501 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.917974 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8vjz8" podStartSLOduration=67.93301066 podStartE2EDuration="1m9.917948956s" totalImagesPullingTime="1.984938296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:02:03.884900404 +0000 UTC m=+70.017747361" watchObservedRunningTime="2026-07-30 17:02:03.917948956 +0000 UTC m=+70.050795914" Jul 30 17:02:03.987108 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:03.987067 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:02:04.047968 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:04.047926 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:02:04.898619 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:04.898483 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" event={"ID":"667c2a81-0d30-431d-8799-dfba176558ab","Type":"ContainerStarted","Data":"90089d774c17da63109af55202f93184cc55a619f643d66f37f011d84c772930"} Jul 30 17:02:05.284266 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:05.284112 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:02:05.384321 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:05.384285 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:02:05.449697 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:05.449660 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:02:06.623747 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:06.623703 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:02:06.724582 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:06.724523 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:02:07.811802 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:07.811770 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:02:09.141951 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:09.141912 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:02:09.244074 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:09.244028 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:02:10.026771 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:10.026739 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:02:10.086539 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:10.086509 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:02:12.100031 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:12.099970 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:02:12.161142 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:12.161103 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:02:16.830237 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:16.830195 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:02:16.897844 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:16.897803 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:02:20.390362 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:20.390328 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f9f9659d8-xbjcv"] Jul 30 17:02:20.487849 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:20.487818 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:02:20.602811 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:20.602773 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:02:20.700476 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:20.700404 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:02:20.980373 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:20.980340 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hwbcz" event={"ID":"8400548d-00fa-439c-b7b9-3157adfd8f76","Type":"ContainerStarted","Data":"af63e700432298532688b5cb1bf68d4e3dcebb7c552a0aeffe9577068bb3088a"} Jul 30 17:02:20.980674 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:20.980627 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:02:20.985487 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:20.984516 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cd4499d55-d4mv2" event={"ID":"a5f11093-0de0-48a4-a981-f63982607e72","Type":"ContainerStarted","Data":"945561db4c6f65cf5768a5c5fd83a35924ea25bad67612d3ae222906babcb33f"} Jul 30 17:02:20.985487 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:20.984611 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cd4499d55-d4mv2" event={"ID":"a5f11093-0de0-48a4-a981-f63982607e72","Type":"ContainerStarted","Data":"d4155837651685053f128127a1e160481e425fdac83c93488f1bbe3d4f47107c"} Jul 30 17:02:20.985487 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:20.984640 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cd4499d55-d4mv2" event={"ID":"a5f11093-0de0-48a4-a981-f63982607e72","Type":"ContainerStarted","Data":"a7115307b11cfc4cb28f103da7c6c4f871ef72493ca5344af20e3428ceafb0ca"} Jul 30 17:02:20.990990 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:20.990809 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" event={"ID":"667c2a81-0d30-431d-8799-dfba176558ab","Type":"ContainerStarted","Data":"2ef1590469f10ccf8f0faee1ea1db8d7028c8123db756ebb2db76aa641ae4239"} Jul 30 17:02:20.990990 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:20.990895 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" event={"ID":"667c2a81-0d30-431d-8799-dfba176558ab","Type":"ContainerStarted","Data":"5af49614c6979867eab84846d288582fdad099427f0d450d5848741023500325"} Jul 30 17:02:20.993717 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:20.991955 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" Jul 30 17:02:20.997770 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:20.996210 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hwbcz" podStartSLOduration=66.3242919 podStartE2EDuration="1m25.996177642s" totalImagesPullingTime="19.671885742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:00:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:02:20.99477372 +0000 UTC m=+87.127620677" watchObservedRunningTime="2026-07-30 17:02:20.996177642 +0000 UTC m=+87.129024600" Jul 30 17:02:20.999403 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:20.999309 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d","Type":"ContainerStarted","Data":"208fa099f77302adc9deae355095e8ebd7e1324ceb003f2e377fbb0e0733b69b"} Jul 30 17:02:20.999403 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:20.999385 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d","Type":"ContainerStarted","Data":"4c3eabf45da80edc1fec34d789815c8e59b51beb0b6cf466425d5257bda8ab41"} Jul 30 17:02:21.002789 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:21.002092 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jhw42" event={"ID":"681ff1ad-fa48-420e-9501-d18e7a57a773","Type":"ContainerStarted","Data":"4d0f8a2317c92fb15a1faecbffcd56f0eb68cd47fa06b488a532d527df9a685f"} Jul 30 17:02:21.002789 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:21.002458 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" Jul 30 17:02:21.005162 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:21.005132 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7cd864494-k4wmt" event={"ID":"8faff120-a679-4343-96dd-92e15fd012ac","Type":"ContainerStarted","Data":"9798a4630a76fcd12fce7283f99653033bddbae444a4888f42cf9b673d99f8b3"} Jul 30 17:02:21.007712 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:21.007680 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-6t9lf" event={"ID":"eff18f41-6541-4186-aba6-26e3505c3613","Type":"ContainerStarted","Data":"8c1fc2061bb96232d6a0510de3902a3cf3fefffc08daad22a88a767232184b23"} Jul 30 17:02:21.008732 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:21.008656 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-6t9lf" Jul 30 17:02:21.009961 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:21.009932 2570 patch_prober.go:28] interesting pod/downloads-7c97dc4555-6t9lf container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.10:8080/\": dial tcp 10.134.0.10:8080: connect: connection refused" start-of-body= Jul 30 17:02:21.010787 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:21.010743 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7c97dc4555-6t9lf" podUID="eff18f41-6541-4186-aba6-26e3505c3613" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.10:8080/\": dial tcp 10.134.0.10:8080: connect: connection refused" Jul 30 17:02:21.015625 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:21.010871 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vgpzd" event={"ID":"17e68429-66e4-4fa4-82c8-489bcf812165","Type":"ContainerStarted","Data":"9cc6a6268f744872eda05595f314b1d3a0384e09b9b14c75272a036d17e026e8"} Jul 30 17:02:21.016440 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:21.015872 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9f9659d8-xbjcv" event={"ID":"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84","Type":"ContainerStarted","Data":"1398336fc82a7440f56ee6be88cedcf0f1483d85751beb734393589fc490fe66"} Jul 30 17:02:21.016440 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:21.015050 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7cbc9d5bb8-9wxz7" podStartSLOduration=18.532544131 podStartE2EDuration="23.015028173s" totalImagesPullingTime="4.482484042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:01:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:02:21.014416724 +0000 UTC m=+87.147263680" watchObservedRunningTime="2026-07-30 17:02:21.015028173 +0000 UTC m=+87.147875131" Jul 30 17:02:21.019482 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:21.019303 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a","Type":"ContainerStarted","Data":"c3a7b9d40525a6cbe28056e13b767d5c57aa3a57f7c1ce12fa77db807d4f2903"} Jul 30 17:02:21.019482 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:21.019382 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a","Type":"ContainerStarted","Data":"c8f7ecb51d6dbc0c08ecee62b59f8104d8cb836aff9e1234bd70ba419f4a05c4"} Jul 30 17:02:21.019482 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:21.019425 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a","Type":"ContainerStarted","Data":"d48eba772c4929e6031c997a27314aefc8ad89fe12d355cb20026c1167477fc7"} Jul 30 17:02:21.036794 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:21.034921 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6cd4499d55-d4mv2" podStartSLOduration=2.377618081 podStartE2EDuration="20.034899202s" totalImagesPullingTime="17.657281121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:02:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:02:21.033275121 +0000 UTC m=+87.166122078" watchObservedRunningTime="2026-07-30 17:02:21.034899202 +0000 UTC m=+87.167746158" Jul 30 17:02:21.036794 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:21.035417 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vgpzd" Jul 30 17:02:21.045273 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:21.045200 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vgpzd" Jul 30 17:02:21.056158 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:21.056021 2570 patch_prober.go:28] interesting pod/downloads-7c97dc4555-6t9lf container/download-server namespace/openshift-console: Liveness probe status=failure output="Get \"http://10.134.0.10:8080/\": dial tcp 10.134.0.10:8080: connect: connection refused" start-of-body= Jul 30 17:02:21.056158 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:21.056079 2570 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-console/downloads-7c97dc4555-6t9lf" podUID="eff18f41-6541-4186-aba6-26e3505c3613" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.10:8080/\": dial tcp 10.134.0.10:8080: connect: connection refused" Jul 30 17:02:21.088891 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:21.084108 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-6t9lf" podStartSLOduration=2.957668748 podStartE2EDuration="31.084083546s" totalImagesPullingTime="28.126414798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:01:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:02:21.082009709 +0000 UTC m=+87.214856667" watchObservedRunningTime="2026-07-30 17:02:21.084083546 +0000 UTC m=+87.216930503" Jul 30 17:02:21.105858 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:21.104053 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jhw42" podStartSLOduration=66.445910101 podStartE2EDuration="1m26.104028318s" totalImagesPullingTime="19.658118217s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:02:21.102636079 +0000 UTC m=+87.235483036" watchObservedRunningTime="2026-07-30 17:02:21.104028318 +0000 UTC m=+87.236875275" Jul 30 17:02:21.130944 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:21.128019 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7cd864494-k4wmt" podStartSLOduration=3.42833898 podStartE2EDuration="21.12799137s" totalImagesPullingTime="17.69965239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:02:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:02:21.126875566 +0000 UTC m=+87.259722522" watchObservedRunningTime="2026-07-30 17:02:21.12799137 +0000 UTC m=+87.260838331" Jul 30 17:02:21.180343 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:21.180058 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vgpzd" podStartSLOduration=2.5086295119999997 podStartE2EDuration="20.180027872s" totalImagesPullingTime="17.67139836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:02:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:02:21.146263485 +0000 UTC m=+87.279110444" watchObservedRunningTime="2026-07-30 17:02:21.180027872 +0000 UTC m=+87.312874829" Jul 30 17:02:21.328754 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:21.328701 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7cd864494-k4wmt" Jul 30 17:02:21.329075 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:21.329009 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7cd864494-k4wmt" Jul 30 17:02:22.030647 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:22.030598 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a","Type":"ContainerStarted","Data":"49f1b87a3cd1eac2c730fcda2715bee374ce4f6c973bd4afaa4e8e58be970e90"} Jul 30 17:02:22.031239 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:22.030737 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a","Type":"ContainerStarted","Data":"1cecdcae38567200f46c3584969c19bf7b92e33fcf50cbda3db59eb559961217"} Jul 30 17:02:22.031239 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:22.030787 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a","Type":"ContainerStarted","Data":"67a1a4bba9e51813472ba3f39b5b73fae562269d4830db9e98cad1e64ecbc6f9"} Jul 30 17:02:22.037179 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:22.037133 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d","Type":"ContainerStarted","Data":"80e00ee197926d6e1f382bd09e9e43b45802c53ca16f4d042b630cee1193a1cf"} Jul 30 17:02:22.037356 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:22.037224 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d","Type":"ContainerStarted","Data":"950e850d079711c403d5d28ebe07e9196a59ef1615c16c31bff794bf609d54c3"} Jul 30 17:02:22.037356 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:22.037267 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d","Type":"ContainerStarted","Data":"4143f3f46868ed3c6e73759a5f5a3f857d4351ff42a85e3dd6d3f6ed191db9bc"} Jul 30 17:02:22.037356 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:22.037305 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d","Type":"ContainerStarted","Data":"f0d7c486dc0fe8cbf64339ff93d5abba3dee99d73b832c412d9e8f89ec0b54c5"} Jul 30 17:02:22.042479 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:22.042445 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-6t9lf" Jul 30 17:02:22.057858 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:22.057790 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f9f9659d8-xbjcv" podStartSLOduration=3.432081297 podStartE2EDuration="21.057768416s" totalImagesPullingTime="17.625687119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:02:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:02:21.180772549 +0000 UTC m=+87.313619506" watchObservedRunningTime="2026-07-30 17:02:22.057768416 +0000 UTC m=+88.190615377" Jul 30 17:02:22.058950 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:22.058898 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.357049546 podStartE2EDuration="25.058878816s" totalImagesPullingTime="20.679572584s" totalInitContainerRuntime="22.256686ms" isStatefulPod=false podCreationTimestamp="2026-07-30 17:01:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:02:22.056869675 +0000 UTC m=+88.189716634" watchObservedRunningTime="2026-07-30 17:02:22.058878816 +0000 UTC m=+88.191725773" Jul 30 17:02:22.109651 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:22.109001 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.509136446 podStartE2EDuration="20.108978511s" totalImagesPullingTime="16.58446832s" totalInitContainerRuntime="15.373745ms" isStatefulPod=false podCreationTimestamp="2026-07-30 17:02:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:02:22.107182551 +0000 UTC m=+88.240029507" watchObservedRunningTime="2026-07-30 17:02:22.108978511 +0000 UTC m=+88.241825468" Jul 30 17:02:22.185887 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:22.185855 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f9f9659d8-xbjcv" Jul 30 17:02:22.477132 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:22.477091 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:02:23.268568 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:23.268518 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:02:27.102262 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:27.102218 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:02:27.164000 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:27.163957 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:02:33.566135 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:33.566089 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:02:38.240253 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:38.240214 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:02:38.341570 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:38.341515 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:02:41.334042 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:41.334010 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7cd864494-k4wmt" Jul 30 17:02:41.338194 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:41.338161 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7cd864494-k4wmt" Jul 30 17:02:46.082751 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:46.082704 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f9f9659d8-xbjcv" podUID="c2a31c7e-ceea-483a-9a76-0ccb47c8cf84" containerName="console" containerID="cri-o://1398336fc82a7440f56ee6be88cedcf0f1483d85751beb734393589fc490fe66" gracePeriod=15 Jul 30 17:02:46.409266 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:46.409232 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9f9659d8-xbjcv" Jul 30 17:02:46.506369 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:46.506315 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-console-serving-cert\") pod \"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84\" (UID: \"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84\") " Jul 30 17:02:46.506633 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:46.506408 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-oauth-serving-cert\") pod \"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84\" (UID: \"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84\") " Jul 30 17:02:46.506633 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:46.506466 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-service-ca\") pod \"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84\" (UID: \"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84\") " Jul 30 17:02:46.506633 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:46.506507 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjz2k\" (UniqueName: \"kubernetes.io/projected/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-kube-api-access-fjz2k\") pod \"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84\" (UID: \"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84\") " Jul 30 17:02:46.506633 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:46.506541 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-console-oauth-config\") pod \"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84\" (UID: \"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84\") " Jul 30 17:02:46.506633 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:46.506590 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-console-config\") pod \"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84\" (UID: \"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84\") " Jul 30 17:02:46.507351 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:46.507317 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-console-config" (OuterVolumeSpecName: "console-config") pod "c2a31c7e-ceea-483a-9a76-0ccb47c8cf84" (UID: "c2a31c7e-ceea-483a-9a76-0ccb47c8cf84"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 17:02:46.507523 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:46.507493 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-service-ca" (OuterVolumeSpecName: "service-ca") pod "c2a31c7e-ceea-483a-9a76-0ccb47c8cf84" (UID: "c2a31c7e-ceea-483a-9a76-0ccb47c8cf84"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 17:02:46.510881 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:46.510839 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c2a31c7e-ceea-483a-9a76-0ccb47c8cf84" (UID: "c2a31c7e-ceea-483a-9a76-0ccb47c8cf84"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 17:02:46.512471 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:46.512399 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c2a31c7e-ceea-483a-9a76-0ccb47c8cf84" (UID: "c2a31c7e-ceea-483a-9a76-0ccb47c8cf84"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 17:02:46.516668 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:46.516634 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-kube-api-access-fjz2k" (OuterVolumeSpecName: "kube-api-access-fjz2k") pod "c2a31c7e-ceea-483a-9a76-0ccb47c8cf84" (UID: "c2a31c7e-ceea-483a-9a76-0ccb47c8cf84"). InnerVolumeSpecName "kube-api-access-fjz2k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 17:02:46.517448 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:46.517425 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c2a31c7e-ceea-483a-9a76-0ccb47c8cf84" (UID: "c2a31c7e-ceea-483a-9a76-0ccb47c8cf84"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 17:02:46.608015 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:46.607934 2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-oauth-serving-cert\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:02:46.608015 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:46.607962 2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-service-ca\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:02:46.608015 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:46.607971 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjz2k\" (UniqueName: \"kubernetes.io/projected/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-kube-api-access-fjz2k\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:02:46.608015 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:46.607980 2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-console-oauth-config\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:02:46.608015 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:46.607988 2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-console-config\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:02:46.608015 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:46.607996 2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84-console-serving-cert\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:02:47.158586 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:47.158520 2570 generic.go:356] "Generic (PLEG): container finished" podID="c2a31c7e-ceea-483a-9a76-0ccb47c8cf84" containerID="1398336fc82a7440f56ee6be88cedcf0f1483d85751beb734393589fc490fe66" exitCode=0 Jul 30 17:02:47.159129 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:47.158637 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9f9659d8-xbjcv" Jul 30 17:02:47.159129 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:47.158678 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9f9659d8-xbjcv" event={"ID":"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84","Type":"ContainerDied","Data":"1398336fc82a7440f56ee6be88cedcf0f1483d85751beb734393589fc490fe66"} Jul 30 17:02:47.159129 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:47.158729 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9f9659d8-xbjcv" event={"ID":"c2a31c7e-ceea-483a-9a76-0ccb47c8cf84","Type":"ContainerDied","Data":"936aad9c85c8ddc20c829bd0a39b81775e68597ed11c817b8c32b28fe437b70e"} Jul 30 17:02:47.159129 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:47.158774 2570 scope.go:117] "RemoveContainer" containerID="1398336fc82a7440f56ee6be88cedcf0f1483d85751beb734393589fc490fe66" Jul 30 17:02:47.172091 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:47.171796 2570 scope.go:117] "RemoveContainer" containerID="1398336fc82a7440f56ee6be88cedcf0f1483d85751beb734393589fc490fe66" Jul 30 17:02:47.172403 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:02:47.172287 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1398336fc82a7440f56ee6be88cedcf0f1483d85751beb734393589fc490fe66\": container with ID starting with 1398336fc82a7440f56ee6be88cedcf0f1483d85751beb734393589fc490fe66 not found: ID does not exist" containerID="1398336fc82a7440f56ee6be88cedcf0f1483d85751beb734393589fc490fe66" Jul 30 17:02:47.172403 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:47.172334 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1398336fc82a7440f56ee6be88cedcf0f1483d85751beb734393589fc490fe66"} err="failed to get container status \"1398336fc82a7440f56ee6be88cedcf0f1483d85751beb734393589fc490fe66\": rpc error: code = NotFound desc = could not find container \"1398336fc82a7440f56ee6be88cedcf0f1483d85751beb734393589fc490fe66\": container with ID starting with 1398336fc82a7440f56ee6be88cedcf0f1483d85751beb734393589fc490fe66 not found: ID does not exist" Jul 30 17:02:47.187848 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:47.187811 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f9f9659d8-xbjcv"] Jul 30 17:02:47.191283 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:47.191246 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f9f9659d8-xbjcv"] Jul 30 17:02:48.463757 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:48.463725 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2a31c7e-ceea-483a-9a76-0ccb47c8cf84" path="/var/lib/kubelet/pods/c2a31c7e-ceea-483a-9a76-0ccb47c8cf84/volumes" Jul 30 17:02:52.039971 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:02:52.039934 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hwbcz" Jul 30 17:03:03.268627 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:03.268580 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:03.325141 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:03.325113 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:04.248918 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:04.248889 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:12.592506 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:12.592466 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:03:12.649723 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:12.649693 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:03:16.843434 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:16.843393 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 30 17:03:16.843889 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:16.843725 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerName="alertmanager" containerID="cri-o://d48eba772c4929e6031c997a27314aefc8ad89fe12d355cb20026c1167477fc7" gracePeriod=120 Jul 30 17:03:16.843889 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:16.843806 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerName="kube-rbac-proxy-web" containerID="cri-o://c3a7b9d40525a6cbe28056e13b767d5c57aa3a57f7c1ce12fa77db807d4f2903" gracePeriod=120 Jul 30 17:03:16.843889 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:16.843798 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerName="kube-rbac-proxy-metric" containerID="cri-o://1cecdcae38567200f46c3584969c19bf7b92e33fcf50cbda3db59eb559961217" gracePeriod=120 Jul 30 17:03:16.845140 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:16.845090 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerName="config-reloader" containerID="cri-o://c8f7ecb51d6dbc0c08ecee62b59f8104d8cb836aff9e1234bd70ba419f4a05c4" gracePeriod=120 Jul 30 17:03:16.845376 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:16.845294 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerName="prom-label-proxy" containerID="cri-o://49f1b87a3cd1eac2c730fcda2715bee374ce4f6c973bd4afaa4e8e58be970e90" gracePeriod=120 Jul 30 17:03:16.846115 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:16.846053 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerName="kube-rbac-proxy" containerID="cri-o://67a1a4bba9e51813472ba3f39b5b73fae562269d4830db9e98cad1e64ecbc6f9" gracePeriod=120 Jul 30 17:03:17.289943 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:17.289905 2570 generic.go:356] "Generic (PLEG): container finished" podID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerID="49f1b87a3cd1eac2c730fcda2715bee374ce4f6c973bd4afaa4e8e58be970e90" exitCode=0 Jul 30 17:03:17.289943 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:17.289935 2570 generic.go:356] "Generic (PLEG): container finished" podID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerID="1cecdcae38567200f46c3584969c19bf7b92e33fcf50cbda3db59eb559961217" exitCode=0 Jul 30 17:03:17.289943 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:17.289944 2570 generic.go:356] "Generic (PLEG): container finished" podID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerID="67a1a4bba9e51813472ba3f39b5b73fae562269d4830db9e98cad1e64ecbc6f9" exitCode=0 Jul 30 17:03:17.289943 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:17.289950 2570 generic.go:356] "Generic (PLEG): container finished" podID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerID="c8f7ecb51d6dbc0c08ecee62b59f8104d8cb836aff9e1234bd70ba419f4a05c4" exitCode=0 Jul 30 17:03:17.290230 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:17.289958 2570 generic.go:356] "Generic (PLEG): container finished" podID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerID="d48eba772c4929e6031c997a27314aefc8ad89fe12d355cb20026c1167477fc7" exitCode=0 Jul 30 17:03:17.290230 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:17.289973 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a","Type":"ContainerDied","Data":"49f1b87a3cd1eac2c730fcda2715bee374ce4f6c973bd4afaa4e8e58be970e90"} Jul 30 17:03:17.290230 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:17.290063 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a","Type":"ContainerDied","Data":"1cecdcae38567200f46c3584969c19bf7b92e33fcf50cbda3db59eb559961217"} Jul 30 17:03:17.290230 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:17.290089 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a","Type":"ContainerDied","Data":"67a1a4bba9e51813472ba3f39b5b73fae562269d4830db9e98cad1e64ecbc6f9"} Jul 30 17:03:17.290230 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:17.290121 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a","Type":"ContainerDied","Data":"c8f7ecb51d6dbc0c08ecee62b59f8104d8cb836aff9e1234bd70ba419f4a05c4"} Jul 30 17:03:17.290230 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:17.290164 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a","Type":"ContainerDied","Data":"d48eba772c4929e6031c997a27314aefc8ad89fe12d355cb20026c1167477fc7"} Jul 30 17:03:18.086358 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.086330 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.190677 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.190636 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-config-volume\") pod \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " Jul 30 17:03:18.190875 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.190690 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-secret-alertmanager-main-tls\") pod \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " Jul 30 17:03:18.190875 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.190723 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-tls-assets\") pod \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " Jul 30 17:03:18.190875 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.190748 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-config-out\") pod \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " Jul 30 17:03:18.190875 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.190777 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-metrics-client-ca\") pod \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " Jul 30 17:03:18.190875 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.190832 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-web-config\") pod \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " Jul 30 17:03:18.190875 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.190850 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpjcf\" (UniqueName: \"kubernetes.io/projected/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-kube-api-access-zpjcf\") pod \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " Jul 30 17:03:18.191202 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.190905 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-secret-alertmanager-kube-rbac-proxy-web\") pod \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " Jul 30 17:03:18.191202 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.190932 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-secret-alertmanager-kube-rbac-proxy\") pod \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " Jul 30 17:03:18.191202 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.190968 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-cluster-tls-config\") pod \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " Jul 30 17:03:18.191202 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.191004 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-alertmanager-main-db\") pod \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " Jul 30 17:03:18.191202 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.191040 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-alertmanager-trusted-ca-bundle\") pod \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " Jul 30 17:03:18.191202 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.191069 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\" (UID: \"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a\") " Jul 30 17:03:18.191482 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.191223 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" (UID: "d88ddf41-ef6c-4f51-b06a-71a3c3cde73a"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 17:03:18.191482 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.191401 2570 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-metrics-client-ca\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:18.191890 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.191787 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" (UID: "d88ddf41-ef6c-4f51-b06a-71a3c3cde73a"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 17:03:18.192019 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.191976 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" (UID: "d88ddf41-ef6c-4f51-b06a-71a3c3cde73a"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 17:03:18.194226 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.194186 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" (UID: "d88ddf41-ef6c-4f51-b06a-71a3c3cde73a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 17:03:18.194506 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.194461 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-config-out" (OuterVolumeSpecName: "config-out") pod "d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" (UID: "d88ddf41-ef6c-4f51-b06a-71a3c3cde73a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 17:03:18.194803 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.194758 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-config-volume" (OuterVolumeSpecName: "config-volume") pod "d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" (UID: "d88ddf41-ef6c-4f51-b06a-71a3c3cde73a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 17:03:18.194931 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.194901 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" (UID: "d88ddf41-ef6c-4f51-b06a-71a3c3cde73a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 17:03:18.195071 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.195045 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" (UID: "d88ddf41-ef6c-4f51-b06a-71a3c3cde73a"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 17:03:18.195221 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.195191 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" (UID: "d88ddf41-ef6c-4f51-b06a-71a3c3cde73a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 17:03:18.195296 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.195255 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" (UID: "d88ddf41-ef6c-4f51-b06a-71a3c3cde73a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 17:03:18.195661 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.195639 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-kube-api-access-zpjcf" (OuterVolumeSpecName: "kube-api-access-zpjcf") pod "d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" (UID: "d88ddf41-ef6c-4f51-b06a-71a3c3cde73a"). InnerVolumeSpecName "kube-api-access-zpjcf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 17:03:18.199058 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.198950 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" (UID: "d88ddf41-ef6c-4f51-b06a-71a3c3cde73a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 17:03:18.206212 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.206177 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-web-config" (OuterVolumeSpecName: "web-config") pod "d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" (UID: "d88ddf41-ef6c-4f51-b06a-71a3c3cde73a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 17:03:18.291927 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.291894 2570 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-web-config\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:18.291927 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.291921 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpjcf\" (UniqueName: \"kubernetes.io/projected/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-kube-api-access-zpjcf\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:18.291927 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.291936 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:18.292176 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.291950 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:18.292176 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.291962 2570 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-cluster-tls-config\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:18.292176 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.291973 2570 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-alertmanager-main-db\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:18.292176 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.291984 2570 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:18.292176 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.291996 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:18.292176 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.292009 2570 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-config-volume\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:18.292176 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.292021 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-secret-alertmanager-main-tls\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:18.292176 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.292031 2570 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-tls-assets\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:18.292176 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.292042 2570 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a-config-out\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:18.297135 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.297097 2570 generic.go:356] "Generic (PLEG): container finished" podID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerID="c3a7b9d40525a6cbe28056e13b767d5c57aa3a57f7c1ce12fa77db807d4f2903" exitCode=0 Jul 30 17:03:18.297306 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.297180 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a","Type":"ContainerDied","Data":"c3a7b9d40525a6cbe28056e13b767d5c57aa3a57f7c1ce12fa77db807d4f2903"} Jul 30 17:03:18.297306 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.297201 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.297306 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.297254 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d88ddf41-ef6c-4f51-b06a-71a3c3cde73a","Type":"ContainerDied","Data":"ed9bff217f2fd4df9a76b0adb570fe79da154f640ca917b1e1a14150b2fec3ed"} Jul 30 17:03:18.297306 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.297290 2570 scope.go:117] "RemoveContainer" containerID="49f1b87a3cd1eac2c730fcda2715bee374ce4f6c973bd4afaa4e8e58be970e90" Jul 30 17:03:18.306222 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.306198 2570 scope.go:117] "RemoveContainer" containerID="1cecdcae38567200f46c3584969c19bf7b92e33fcf50cbda3db59eb559961217" Jul 30 17:03:18.313854 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.313833 2570 scope.go:117] "RemoveContainer" containerID="67a1a4bba9e51813472ba3f39b5b73fae562269d4830db9e98cad1e64ecbc6f9" Jul 30 17:03:18.322125 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.322091 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 30 17:03:18.322506 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.322490 2570 scope.go:117] "RemoveContainer" containerID="c3a7b9d40525a6cbe28056e13b767d5c57aa3a57f7c1ce12fa77db807d4f2903" Jul 30 17:03:18.326526 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.326498 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 30 17:03:18.330769 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.330751 2570 scope.go:117] "RemoveContainer" containerID="c8f7ecb51d6dbc0c08ecee62b59f8104d8cb836aff9e1234bd70ba419f4a05c4" Jul 30 17:03:18.338343 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.338322 2570 scope.go:117] "RemoveContainer" containerID="d48eba772c4929e6031c997a27314aefc8ad89fe12d355cb20026c1167477fc7" Jul 30 17:03:18.346813 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.346791 2570 scope.go:117] "RemoveContainer" containerID="3d649b47bcf8c076ab6b4f0a6448f1ea7000db55a0c62164d47fea02ee42f8e6" Jul 30 17:03:18.354728 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.354682 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 30 17:03:18.355271 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.355241 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerName="alertmanager" Jul 30 17:03:18.355271 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.355265 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerName="alertmanager" Jul 30 17:03:18.355407 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.355280 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerName="config-reloader" Jul 30 17:03:18.355407 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.355291 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerName="config-reloader" Jul 30 17:03:18.355407 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.355304 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerName="kube-rbac-proxy-metric" Jul 30 17:03:18.355407 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.355314 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerName="kube-rbac-proxy-metric" Jul 30 17:03:18.355407 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.355325 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerName="kube-rbac-proxy-web" Jul 30 17:03:18.355407 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.355335 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerName="kube-rbac-proxy-web" Jul 30 17:03:18.355407 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.355352 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerName="kube-rbac-proxy" Jul 30 17:03:18.355407 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.355360 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerName="kube-rbac-proxy" Jul 30 17:03:18.355407 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.355369 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerName="prom-label-proxy" Jul 30 17:03:18.355407 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.355377 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerName="prom-label-proxy" Jul 30 17:03:18.355407 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.355388 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2a31c7e-ceea-483a-9a76-0ccb47c8cf84" containerName="console" Jul 30 17:03:18.355407 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.355397 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2a31c7e-ceea-483a-9a76-0ccb47c8cf84" containerName="console" Jul 30 17:03:18.355806 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.355417 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerName="init-config-reloader" Jul 30 17:03:18.355806 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.355425 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerName="init-config-reloader" Jul 30 17:03:18.355806 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.355503 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerName="kube-rbac-proxy-metric" Jul 30 17:03:18.355806 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.355517 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerName="kube-rbac-proxy-web" Jul 30 17:03:18.355806 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.355530 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerName="config-reloader" Jul 30 17:03:18.355806 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.355540 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerName="prom-label-proxy" Jul 30 17:03:18.355806 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.355572 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2a31c7e-ceea-483a-9a76-0ccb47c8cf84" containerName="console" Jul 30 17:03:18.355806 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.355586 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerName="kube-rbac-proxy" Jul 30 17:03:18.355806 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.355593 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" containerName="alertmanager" Jul 30 17:03:18.356209 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.355889 2570 scope.go:117] "RemoveContainer" containerID="49f1b87a3cd1eac2c730fcda2715bee374ce4f6c973bd4afaa4e8e58be970e90" Jul 30 17:03:18.356209 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:03:18.356195 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49f1b87a3cd1eac2c730fcda2715bee374ce4f6c973bd4afaa4e8e58be970e90\": container with ID starting with 49f1b87a3cd1eac2c730fcda2715bee374ce4f6c973bd4afaa4e8e58be970e90 not found: ID does not exist" containerID="49f1b87a3cd1eac2c730fcda2715bee374ce4f6c973bd4afaa4e8e58be970e90" Jul 30 17:03:18.356271 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.356224 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49f1b87a3cd1eac2c730fcda2715bee374ce4f6c973bd4afaa4e8e58be970e90"} err="failed to get container status \"49f1b87a3cd1eac2c730fcda2715bee374ce4f6c973bd4afaa4e8e58be970e90\": rpc error: code = NotFound desc = could not find container \"49f1b87a3cd1eac2c730fcda2715bee374ce4f6c973bd4afaa4e8e58be970e90\": container with ID starting with 49f1b87a3cd1eac2c730fcda2715bee374ce4f6c973bd4afaa4e8e58be970e90 not found: ID does not exist" Jul 30 17:03:18.356271 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.356246 2570 scope.go:117] "RemoveContainer" containerID="1cecdcae38567200f46c3584969c19bf7b92e33fcf50cbda3db59eb559961217" Jul 30 17:03:18.356537 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:03:18.356518 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cecdcae38567200f46c3584969c19bf7b92e33fcf50cbda3db59eb559961217\": container with ID starting with 1cecdcae38567200f46c3584969c19bf7b92e33fcf50cbda3db59eb559961217 not found: ID does not exist" containerID="1cecdcae38567200f46c3584969c19bf7b92e33fcf50cbda3db59eb559961217" Jul 30 17:03:18.356622 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.356542 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cecdcae38567200f46c3584969c19bf7b92e33fcf50cbda3db59eb559961217"} err="failed to get container status \"1cecdcae38567200f46c3584969c19bf7b92e33fcf50cbda3db59eb559961217\": rpc error: code = NotFound desc = could not find container \"1cecdcae38567200f46c3584969c19bf7b92e33fcf50cbda3db59eb559961217\": container with ID starting with 1cecdcae38567200f46c3584969c19bf7b92e33fcf50cbda3db59eb559961217 not found: ID does not exist" Jul 30 17:03:18.356622 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.356572 2570 scope.go:117] "RemoveContainer" containerID="67a1a4bba9e51813472ba3f39b5b73fae562269d4830db9e98cad1e64ecbc6f9" Jul 30 17:03:18.356808 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:03:18.356792 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67a1a4bba9e51813472ba3f39b5b73fae562269d4830db9e98cad1e64ecbc6f9\": container with ID starting with 67a1a4bba9e51813472ba3f39b5b73fae562269d4830db9e98cad1e64ecbc6f9 not found: ID does not exist" containerID="67a1a4bba9e51813472ba3f39b5b73fae562269d4830db9e98cad1e64ecbc6f9" Jul 30 17:03:18.356854 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.356812 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67a1a4bba9e51813472ba3f39b5b73fae562269d4830db9e98cad1e64ecbc6f9"} err="failed to get container status \"67a1a4bba9e51813472ba3f39b5b73fae562269d4830db9e98cad1e64ecbc6f9\": rpc error: code = NotFound desc = could not find container \"67a1a4bba9e51813472ba3f39b5b73fae562269d4830db9e98cad1e64ecbc6f9\": container with ID starting with 67a1a4bba9e51813472ba3f39b5b73fae562269d4830db9e98cad1e64ecbc6f9 not found: ID does not exist" Jul 30 17:03:18.356854 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.356825 2570 scope.go:117] "RemoveContainer" containerID="c3a7b9d40525a6cbe28056e13b767d5c57aa3a57f7c1ce12fa77db807d4f2903" Jul 30 17:03:18.357067 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:03:18.357051 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3a7b9d40525a6cbe28056e13b767d5c57aa3a57f7c1ce12fa77db807d4f2903\": container with ID starting with c3a7b9d40525a6cbe28056e13b767d5c57aa3a57f7c1ce12fa77db807d4f2903 not found: ID does not exist" containerID="c3a7b9d40525a6cbe28056e13b767d5c57aa3a57f7c1ce12fa77db807d4f2903" Jul 30 17:03:18.357120 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.357069 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3a7b9d40525a6cbe28056e13b767d5c57aa3a57f7c1ce12fa77db807d4f2903"} err="failed to get container status \"c3a7b9d40525a6cbe28056e13b767d5c57aa3a57f7c1ce12fa77db807d4f2903\": rpc error: code = NotFound desc = could not find container \"c3a7b9d40525a6cbe28056e13b767d5c57aa3a57f7c1ce12fa77db807d4f2903\": container with ID starting with c3a7b9d40525a6cbe28056e13b767d5c57aa3a57f7c1ce12fa77db807d4f2903 not found: ID does not exist" Jul 30 17:03:18.357120 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.357081 2570 scope.go:117] "RemoveContainer" containerID="c8f7ecb51d6dbc0c08ecee62b59f8104d8cb836aff9e1234bd70ba419f4a05c4" Jul 30 17:03:18.357336 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:03:18.357316 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8f7ecb51d6dbc0c08ecee62b59f8104d8cb836aff9e1234bd70ba419f4a05c4\": container with ID starting with c8f7ecb51d6dbc0c08ecee62b59f8104d8cb836aff9e1234bd70ba419f4a05c4 not found: ID does not exist" containerID="c8f7ecb51d6dbc0c08ecee62b59f8104d8cb836aff9e1234bd70ba419f4a05c4" Jul 30 17:03:18.357373 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.357341 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8f7ecb51d6dbc0c08ecee62b59f8104d8cb836aff9e1234bd70ba419f4a05c4"} err="failed to get container status \"c8f7ecb51d6dbc0c08ecee62b59f8104d8cb836aff9e1234bd70ba419f4a05c4\": rpc error: code = NotFound desc = could not find container \"c8f7ecb51d6dbc0c08ecee62b59f8104d8cb836aff9e1234bd70ba419f4a05c4\": container with ID starting with c8f7ecb51d6dbc0c08ecee62b59f8104d8cb836aff9e1234bd70ba419f4a05c4 not found: ID does not exist" Jul 30 17:03:18.357373 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.357356 2570 scope.go:117] "RemoveContainer" containerID="d48eba772c4929e6031c997a27314aefc8ad89fe12d355cb20026c1167477fc7" Jul 30 17:03:18.357661 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:03:18.357576 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d48eba772c4929e6031c997a27314aefc8ad89fe12d355cb20026c1167477fc7\": container with ID starting with d48eba772c4929e6031c997a27314aefc8ad89fe12d355cb20026c1167477fc7 not found: ID does not exist" containerID="d48eba772c4929e6031c997a27314aefc8ad89fe12d355cb20026c1167477fc7" Jul 30 17:03:18.357661 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.357604 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d48eba772c4929e6031c997a27314aefc8ad89fe12d355cb20026c1167477fc7"} err="failed to get container status \"d48eba772c4929e6031c997a27314aefc8ad89fe12d355cb20026c1167477fc7\": rpc error: code = NotFound desc = could not find container \"d48eba772c4929e6031c997a27314aefc8ad89fe12d355cb20026c1167477fc7\": container with ID starting with d48eba772c4929e6031c997a27314aefc8ad89fe12d355cb20026c1167477fc7 not found: ID does not exist" Jul 30 17:03:18.357661 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.357617 2570 scope.go:117] "RemoveContainer" containerID="3d649b47bcf8c076ab6b4f0a6448f1ea7000db55a0c62164d47fea02ee42f8e6" Jul 30 17:03:18.357835 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:03:18.357812 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d649b47bcf8c076ab6b4f0a6448f1ea7000db55a0c62164d47fea02ee42f8e6\": container with ID starting with 3d649b47bcf8c076ab6b4f0a6448f1ea7000db55a0c62164d47fea02ee42f8e6 not found: ID does not exist" containerID="3d649b47bcf8c076ab6b4f0a6448f1ea7000db55a0c62164d47fea02ee42f8e6" Jul 30 17:03:18.357887 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.357843 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d649b47bcf8c076ab6b4f0a6448f1ea7000db55a0c62164d47fea02ee42f8e6"} err="failed to get container status \"3d649b47bcf8c076ab6b4f0a6448f1ea7000db55a0c62164d47fea02ee42f8e6\": rpc error: code = NotFound desc = could not find container \"3d649b47bcf8c076ab6b4f0a6448f1ea7000db55a0c62164d47fea02ee42f8e6\": container with ID starting with 3d649b47bcf8c076ab6b4f0a6448f1ea7000db55a0c62164d47fea02ee42f8e6 not found: ID does not exist" Jul 30 17:03:18.360940 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.360919 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.363807 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.363729 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 30 17:03:18.363807 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.363747 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 30 17:03:18.363807 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.363773 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 30 17:03:18.363807 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.363799 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 30 17:03:18.364142 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.363751 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 30 17:03:18.364142 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.363958 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 30 17:03:18.364244 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.364151 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 30 17:03:18.364244 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.364154 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 30 17:03:18.364244 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.364196 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vkwkd\"" Jul 30 17:03:18.368971 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.368948 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 30 17:03:18.371823 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.371800 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 30 17:03:18.464041 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.463964 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d88ddf41-ef6c-4f51-b06a-71a3c3cde73a" path="/var/lib/kubelet/pods/d88ddf41-ef6c-4f51-b06a-71a3c3cde73a/volumes" Jul 30 17:03:18.493302 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.493271 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3417e546-c418-4b4d-b14f-80271a46cf6a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.493402 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.493315 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3417e546-c418-4b4d-b14f-80271a46cf6a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.493402 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.493338 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3417e546-c418-4b4d-b14f-80271a46cf6a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.493402 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.493356 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3417e546-c418-4b4d-b14f-80271a46cf6a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.493500 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.493432 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3417e546-c418-4b4d-b14f-80271a46cf6a-config-volume\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.493500 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.493448 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3417e546-c418-4b4d-b14f-80271a46cf6a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.493500 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.493467 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3417e546-c418-4b4d-b14f-80271a46cf6a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.493631 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.493499 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3417e546-c418-4b4d-b14f-80271a46cf6a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.493631 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.493519 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3417e546-c418-4b4d-b14f-80271a46cf6a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.493697 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.493630 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrcww\" (UniqueName: \"kubernetes.io/projected/3417e546-c418-4b4d-b14f-80271a46cf6a-kube-api-access-wrcww\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.493697 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.493674 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3417e546-c418-4b4d-b14f-80271a46cf6a-config-out\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.493756 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.493702 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3417e546-c418-4b4d-b14f-80271a46cf6a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.493756 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.493723 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3417e546-c418-4b4d-b14f-80271a46cf6a-web-config\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.595114 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.595067 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3417e546-c418-4b4d-b14f-80271a46cf6a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.595114 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.595107 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3417e546-c418-4b4d-b14f-80271a46cf6a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.595328 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.595159 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3417e546-c418-4b4d-b14f-80271a46cf6a-config-volume\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.595328 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.595183 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3417e546-c418-4b4d-b14f-80271a46cf6a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.595328 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.595205 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3417e546-c418-4b4d-b14f-80271a46cf6a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.595476 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.595395 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3417e546-c418-4b4d-b14f-80271a46cf6a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.595476 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.595436 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3417e546-c418-4b4d-b14f-80271a46cf6a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.595601 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.595488 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrcww\" (UniqueName: \"kubernetes.io/projected/3417e546-c418-4b4d-b14f-80271a46cf6a-kube-api-access-wrcww\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.595601 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.595542 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3417e546-c418-4b4d-b14f-80271a46cf6a-config-out\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.595722 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.595600 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3417e546-c418-4b4d-b14f-80271a46cf6a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.595722 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.595626 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3417e546-c418-4b4d-b14f-80271a46cf6a-web-config\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.595722 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.595671 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3417e546-c418-4b4d-b14f-80271a46cf6a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.595866 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.595732 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3417e546-c418-4b4d-b14f-80271a46cf6a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.596010 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.595984 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3417e546-c418-4b4d-b14f-80271a46cf6a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.596477 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.596394 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3417e546-c418-4b4d-b14f-80271a46cf6a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.596903 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.596873 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3417e546-c418-4b4d-b14f-80271a46cf6a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.598713 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.598475 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3417e546-c418-4b4d-b14f-80271a46cf6a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.598713 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.598496 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3417e546-c418-4b4d-b14f-80271a46cf6a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.598713 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.598655 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3417e546-c418-4b4d-b14f-80271a46cf6a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.598713 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.598680 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3417e546-c418-4b4d-b14f-80271a46cf6a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.598908 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.598752 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3417e546-c418-4b4d-b14f-80271a46cf6a-config-volume\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.598908 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.598872 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3417e546-c418-4b4d-b14f-80271a46cf6a-web-config\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.599149 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.599129 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3417e546-c418-4b4d-b14f-80271a46cf6a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.599322 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.599306 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3417e546-c418-4b4d-b14f-80271a46cf6a-config-out\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.600448 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.600429 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3417e546-c418-4b4d-b14f-80271a46cf6a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.604690 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.604664 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrcww\" (UniqueName: \"kubernetes.io/projected/3417e546-c418-4b4d-b14f-80271a46cf6a-kube-api-access-wrcww\") pod \"alertmanager-main-0\" (UID: \"3417e546-c418-4b4d-b14f-80271a46cf6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.671609 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.671544 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 30 17:03:18.819375 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:18.819350 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 30 17:03:18.821024 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:03:18.820996 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3417e546_c418_4b4d_b14f_80271a46cf6a.slice/crio-f2300afde28647b6e82a2a3f11417e76f4dcfd76fbb763e71c6fcde1b8faf9ba WatchSource:0}: Error finding container f2300afde28647b6e82a2a3f11417e76f4dcfd76fbb763e71c6fcde1b8faf9ba: Status 404 returned error can't find the container with id f2300afde28647b6e82a2a3f11417e76f4dcfd76fbb763e71c6fcde1b8faf9ba Jul 30 17:03:19.303955 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:19.303915 2570 generic.go:356] "Generic (PLEG): container finished" podID="3417e546-c418-4b4d-b14f-80271a46cf6a" containerID="bf67beab6d810299dd33829112b67172297a30d6341acb6caad665f0bc8844ea" exitCode=0 Jul 30 17:03:19.304344 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:19.303976 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3417e546-c418-4b4d-b14f-80271a46cf6a","Type":"ContainerDied","Data":"bf67beab6d810299dd33829112b67172297a30d6341acb6caad665f0bc8844ea"} Jul 30 17:03:19.304344 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:19.304082 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3417e546-c418-4b4d-b14f-80271a46cf6a","Type":"ContainerStarted","Data":"f2300afde28647b6e82a2a3f11417e76f4dcfd76fbb763e71c6fcde1b8faf9ba"} Jul 30 17:03:19.580967 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:19.580936 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:03:20.312447 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:20.312415 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3417e546-c418-4b4d-b14f-80271a46cf6a","Type":"ContainerStarted","Data":"5278ec13da2f6b32e498a0e8e56d85514a7761360343ab06bbe6cb0ce9428491"} Jul 30 17:03:20.312836 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:20.312480 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3417e546-c418-4b4d-b14f-80271a46cf6a","Type":"ContainerStarted","Data":"d6187b3edb77ffad4a876ea4523843c3ebb0b9bc2a1feb802147b38a9a30566c"} Jul 30 17:03:20.312836 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:20.312507 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3417e546-c418-4b4d-b14f-80271a46cf6a","Type":"ContainerStarted","Data":"195776dc11598ddae4acf3183739bfd479fb571cef6d3d7539bbb3373b626d76"} Jul 30 17:03:20.312836 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:20.312532 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3417e546-c418-4b4d-b14f-80271a46cf6a","Type":"ContainerStarted","Data":"b7e7b63c9f844bed166169991a12b2bb7d6330a3e53832d30bdd574f8a2b5fc0"} Jul 30 17:03:20.312836 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:20.312584 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3417e546-c418-4b4d-b14f-80271a46cf6a","Type":"ContainerStarted","Data":"f12c4175f966e888550e5b8d275e65627c0d8d816e045aa8e459db3dda7fecc8"} Jul 30 17:03:20.312836 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:20.312608 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3417e546-c418-4b4d-b14f-80271a46cf6a","Type":"ContainerStarted","Data":"d5a95424fd0d6e6f3d94e7f598d6eed6a1dee41272cdf0e22a10c4545f46f32e"} Jul 30 17:03:20.340147 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:20.340072 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.320233039 podStartE2EDuration="2.340046916s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.813877ms" isStatefulPod=false podCreationTimestamp="2026-07-30 17:03:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:03:20.338082344 +0000 UTC m=+146.470929318" watchObservedRunningTime="2026-07-30 17:03:20.340046916 +0000 UTC m=+146.472893873" Jul 30 17:03:21.082635 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:21.082597 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 30 17:03:21.082991 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:21.082959 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerName="prometheus" containerID="cri-o://4c3eabf45da80edc1fec34d789815c8e59b51beb0b6cf466425d5257bda8ab41" gracePeriod=600 Jul 30 17:03:21.083406 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:21.083373 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerName="kube-rbac-proxy-thanos" containerID="cri-o://80e00ee197926d6e1f382bd09e9e43b45802c53ca16f4d042b630cee1193a1cf" gracePeriod=600 Jul 30 17:03:21.083525 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:21.083504 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerName="kube-rbac-proxy" containerID="cri-o://950e850d079711c403d5d28ebe07e9196a59ef1615c16c31bff794bf609d54c3" gracePeriod=600 Jul 30 17:03:21.083630 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:21.083605 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerName="kube-rbac-proxy-web" containerID="cri-o://4143f3f46868ed3c6e73759a5f5a3f857d4351ff42a85e3dd6d3f6ed191db9bc" gracePeriod=600 Jul 30 17:03:21.083709 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:21.083680 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerName="thanos-sidecar" containerID="cri-o://f0d7c486dc0fe8cbf64339ff93d5abba3dee99d73b832c412d9e8f89ec0b54c5" gracePeriod=600 Jul 30 17:03:21.083763 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:21.083751 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerName="config-reloader" containerID="cri-o://208fa099f77302adc9deae355095e8ebd7e1324ceb003f2e377fbb0e0733b69b" gracePeriod=600 Jul 30 17:03:21.330027 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:21.329988 2570 generic.go:356] "Generic (PLEG): container finished" podID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerID="4143f3f46868ed3c6e73759a5f5a3f857d4351ff42a85e3dd6d3f6ed191db9bc" exitCode=0 Jul 30 17:03:21.330027 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:21.330022 2570 generic.go:356] "Generic (PLEG): container finished" podID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerID="f0d7c486dc0fe8cbf64339ff93d5abba3dee99d73b832c412d9e8f89ec0b54c5" exitCode=0 Jul 30 17:03:21.330027 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:21.330031 2570 generic.go:356] "Generic (PLEG): container finished" podID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerID="208fa099f77302adc9deae355095e8ebd7e1324ceb003f2e377fbb0e0733b69b" exitCode=0 Jul 30 17:03:21.330521 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:21.330080 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d","Type":"ContainerDied","Data":"4143f3f46868ed3c6e73759a5f5a3f857d4351ff42a85e3dd6d3f6ed191db9bc"} Jul 30 17:03:21.330521 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:21.330208 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d","Type":"ContainerDied","Data":"f0d7c486dc0fe8cbf64339ff93d5abba3dee99d73b832c412d9e8f89ec0b54c5"} Jul 30 17:03:21.330521 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:21.330261 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d","Type":"ContainerDied","Data":"208fa099f77302adc9deae355095e8ebd7e1324ceb003f2e377fbb0e0733b69b"} Jul 30 17:03:22.340720 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:22.340687 2570 generic.go:356] "Generic (PLEG): container finished" podID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerID="80e00ee197926d6e1f382bd09e9e43b45802c53ca16f4d042b630cee1193a1cf" exitCode=0 Jul 30 17:03:22.340720 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:22.340712 2570 generic.go:356] "Generic (PLEG): container finished" podID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerID="950e850d079711c403d5d28ebe07e9196a59ef1615c16c31bff794bf609d54c3" exitCode=0 Jul 30 17:03:22.341170 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:22.340759 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d","Type":"ContainerDied","Data":"80e00ee197926d6e1f382bd09e9e43b45802c53ca16f4d042b630cee1193a1cf"} Jul 30 17:03:22.341170 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:22.340846 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d","Type":"ContainerDied","Data":"950e850d079711c403d5d28ebe07e9196a59ef1615c16c31bff794bf609d54c3"} Jul 30 17:03:24.234973 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:03:24.234930 2570 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4c3eabf45da80edc1fec34d789815c8e59b51beb0b6cf466425d5257bda8ab41" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Jul 30 17:03:24.236069 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:03:24.236027 2570 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4c3eabf45da80edc1fec34d789815c8e59b51beb0b6cf466425d5257bda8ab41" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Jul 30 17:03:24.237012 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:03:24.236979 2570 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4c3eabf45da80edc1fec34d789815c8e59b51beb0b6cf466425d5257bda8ab41" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Jul 30 17:03:24.237136 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:03:24.237025 2570 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-monitoring/prometheus-k8s-0" podUID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerName="prometheus" probeResult="unknown" Jul 30 17:03:24.561084 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:24.561002 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:03:24.614257 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:24.614222 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:03:28.873720 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:28.873684 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:03:28.927699 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:28.927634 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:03:29.235081 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:03:29.235031 2570 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4c3eabf45da80edc1fec34d789815c8e59b51beb0b6cf466425d5257bda8ab41" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Jul 30 17:03:29.236111 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:03:29.236078 2570 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4c3eabf45da80edc1fec34d789815c8e59b51beb0b6cf466425d5257bda8ab41" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Jul 30 17:03:29.237029 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:03:29.236985 2570 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4c3eabf45da80edc1fec34d789815c8e59b51beb0b6cf466425d5257bda8ab41" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Jul 30 17:03:29.237137 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:03:29.237043 2570 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-monitoring/prometheus-k8s-0" podUID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerName="prometheus" probeResult="unknown" Jul 30 17:03:30.389151 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.389119 2570 generic.go:356] "Generic (PLEG): container finished" podID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerID="4c3eabf45da80edc1fec34d789815c8e59b51beb0b6cf466425d5257bda8ab41" exitCode=0 Jul 30 17:03:30.389518 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.389186 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d","Type":"ContainerDied","Data":"4c3eabf45da80edc1fec34d789815c8e59b51beb0b6cf466425d5257bda8ab41"} Jul 30 17:03:30.434916 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.434887 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:30.609900 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.609804 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-config\") pod \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " Jul 30 17:03:30.609900 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.609843 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-prometheus-k8s-rulefiles-2\") pod \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " Jul 30 17:03:30.609900 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.609872 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-web-config\") pod \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " Jul 30 17:03:30.609900 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.609900 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-config-out\") pod \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " Jul 30 17:03:30.610223 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.610100 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-prometheus-k8s-tls\") pod \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " Jul 30 17:03:30.610223 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.610144 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-prometheus-k8s-rulefiles-0\") pod \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " Jul 30 17:03:30.610223 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.610182 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-configmap-kubelet-serving-ca-bundle\") pod \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " Jul 30 17:03:30.610223 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.610214 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kq9b\" (UniqueName: \"kubernetes.io/projected/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-kube-api-access-6kq9b\") pod \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " Jul 30 17:03:30.610435 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.610241 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-kube-rbac-proxy\") pod \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " Jul 30 17:03:30.610435 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.610241 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" (UID: "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 17:03:30.610435 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.610271 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-grpc-tls\") pod \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " Jul 30 17:03:30.610435 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.610311 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-configmap-metrics-client-ca\") pod \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " Jul 30 17:03:30.610435 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.610346 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-prometheus-k8s-db\") pod \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " Jul 30 17:03:30.610435 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.610372 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-tls-assets\") pod \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " Jul 30 17:03:30.610771 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.610484 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-configmap-serving-certs-ca-bundle\") pod \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " Jul 30 17:03:30.610771 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.610532 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-prometheus-k8s-rulefiles-1\") pod \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " Jul 30 17:03:30.610771 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.610601 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-thanos-prometheus-http-client-file\") pod \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " Jul 30 17:03:30.610771 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.610652 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " Jul 30 17:03:30.610771 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.610687 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " Jul 30 17:03:30.610771 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.610714 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-prometheus-trusted-ca-bundle\") pod \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " Jul 30 17:03:30.610771 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.610744 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-metrics-client-certs\") pod \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\" (UID: \"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d\") " Jul 30 17:03:30.611124 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.611074 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:30.611924 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.611653 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" (UID: "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 17:03:30.612259 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.612215 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" (UID: "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 17:03:30.612985 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.612705 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" (UID: "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 17:03:30.612985 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.612826 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-config" (OuterVolumeSpecName: "config") pod "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" (UID: "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 17:03:30.612985 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.612940 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" (UID: "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 17:03:30.613466 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.613051 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-kube-api-access-6kq9b" (OuterVolumeSpecName: "kube-api-access-6kq9b") pod "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" (UID: "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d"). InnerVolumeSpecName "kube-api-access-6kq9b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 17:03:30.613466 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.613382 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" (UID: "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 17:03:30.613466 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.613408 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" (UID: "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 17:03:30.613691 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.613647 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-config-out" (OuterVolumeSpecName: "config-out") pod "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" (UID: "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 17:03:30.614229 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.613987 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" (UID: "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 17:03:30.614822 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.614679 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" (UID: "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 17:03:30.615024 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.614999 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" (UID: "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 17:03:30.615216 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.615192 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" (UID: "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 17:03:30.615825 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.615784 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" (UID: "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 17:03:30.615986 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.615960 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" (UID: "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 17:03:30.616070 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.616045 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" (UID: "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 17:03:30.616161 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.616141 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" (UID: "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 17:03:30.616486 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.616467 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" (UID: "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 17:03:30.626619 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.626583 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-web-config" (OuterVolumeSpecName: "web-config") pod "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" (UID: "d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 17:03:30.711814 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.711770 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:30.711814 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.711804 2570 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:30.711814 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.711815 2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:30.711814 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.711824 2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:30.712082 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.711835 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:30.712082 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.711846 2570 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-metrics-client-certs\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:30.712082 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.711856 2570 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-config\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:30.712082 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.711864 2570 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-web-config\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:30.712082 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.711873 2570 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-config-out\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:30.712082 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.711883 2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:30.712082 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.711892 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:30.712082 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.711900 2570 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:30.712082 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.711909 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kq9b\" (UniqueName: \"kubernetes.io/projected/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-kube-api-access-6kq9b\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:30.712082 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.711917 2570 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-kube-rbac-proxy\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:30.712082 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.711925 2570 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-secret-grpc-tls\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:30.712082 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.711932 2570 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-configmap-metrics-client-ca\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:30.712082 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.711941 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-prometheus-k8s-db\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:30.712082 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.711948 2570 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-tls-assets\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:30.712082 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:30.711956 2570 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:03:31.396999 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.396959 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d","Type":"ContainerDied","Data":"1233296d59d9bc85ca4f921749a1b186836822df1bf2c962d55acd7ee9013a53"} Jul 30 17:03:31.397389 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.397028 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.397389 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.397043 2570 scope.go:117] "RemoveContainer" containerID="80e00ee197926d6e1f382bd09e9e43b45802c53ca16f4d042b630cee1193a1cf" Jul 30 17:03:31.412022 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.412001 2570 scope.go:117] "RemoveContainer" containerID="950e850d079711c403d5d28ebe07e9196a59ef1615c16c31bff794bf609d54c3" Jul 30 17:03:31.420296 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.420274 2570 scope.go:117] "RemoveContainer" containerID="4143f3f46868ed3c6e73759a5f5a3f857d4351ff42a85e3dd6d3f6ed191db9bc" Jul 30 17:03:31.427995 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.427967 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 30 17:03:31.428823 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.428808 2570 scope.go:117] "RemoveContainer" containerID="f0d7c486dc0fe8cbf64339ff93d5abba3dee99d73b832c412d9e8f89ec0b54c5" Jul 30 17:03:31.433154 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.433129 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 30 17:03:31.437395 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.437371 2570 scope.go:117] "RemoveContainer" containerID="208fa099f77302adc9deae355095e8ebd7e1324ceb003f2e377fbb0e0733b69b" Jul 30 17:03:31.444945 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.444917 2570 scope.go:117] "RemoveContainer" containerID="4c3eabf45da80edc1fec34d789815c8e59b51beb0b6cf466425d5257bda8ab41" Jul 30 17:03:31.454270 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.454246 2570 scope.go:117] "RemoveContainer" containerID="3b4eb9aa95aa2b9e1a0f2d9c28348d8ebf7d66224ef278e21c87247011a24266" Jul 30 17:03:31.459724 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.459699 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 30 17:03:31.460050 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.460038 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerName="config-reloader" Jul 30 17:03:31.460098 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.460053 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerName="config-reloader" Jul 30 17:03:31.460098 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.460065 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerName="init-config-reloader" Jul 30 17:03:31.460098 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.460071 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerName="init-config-reloader" Jul 30 17:03:31.460098 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.460080 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerName="kube-rbac-proxy-web" Jul 30 17:03:31.460098 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.460085 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerName="kube-rbac-proxy-web" Jul 30 17:03:31.460098 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.460092 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerName="kube-rbac-proxy-thanos" Jul 30 17:03:31.460098 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.460097 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerName="kube-rbac-proxy-thanos" Jul 30 17:03:31.460298 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.460110 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerName="prometheus" Jul 30 17:03:31.460298 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.460116 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerName="prometheus" Jul 30 17:03:31.460298 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.460123 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerName="thanos-sidecar" Jul 30 17:03:31.460298 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.460128 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerName="thanos-sidecar" Jul 30 17:03:31.460298 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.460136 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerName="kube-rbac-proxy" Jul 30 17:03:31.460298 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.460141 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerName="kube-rbac-proxy" Jul 30 17:03:31.460298 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.460192 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerName="prometheus" Jul 30 17:03:31.460298 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.460199 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerName="config-reloader" Jul 30 17:03:31.460298 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.460206 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerName="kube-rbac-proxy" Jul 30 17:03:31.460298 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.460213 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerName="kube-rbac-proxy-thanos" Jul 30 17:03:31.460298 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.460220 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerName="thanos-sidecar" Jul 30 17:03:31.460298 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.460225 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" containerName="kube-rbac-proxy-web" Jul 30 17:03:31.464181 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.464161 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.466811 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.466789 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 30 17:03:31.466938 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.466832 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 30 17:03:31.467020 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.467005 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 30 17:03:31.467122 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.467040 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 30 17:03:31.467122 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.467085 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 30 17:03:31.467276 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.467261 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 30 17:03:31.467861 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.467846 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 30 17:03:31.467977 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.467882 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-309jr243q815l\"" Jul 30 17:03:31.468164 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.468151 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 30 17:03:31.468378 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.468361 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 30 17:03:31.468468 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.468393 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xlqwd\"" Jul 30 17:03:31.468687 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.468668 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 30 17:03:31.468787 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.468702 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 30 17:03:31.468787 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.468677 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 30 17:03:31.470324 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.470285 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 30 17:03:31.473573 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.473534 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 30 17:03:31.479576 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.479500 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 30 17:03:31.518426 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.518385 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a3178ef-1487-40c8-92e6-d02db9782851-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.518426 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.518422 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8a3178ef-1487-40c8-92e6-d02db9782851-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.518724 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.518465 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8a3178ef-1487-40c8-92e6-d02db9782851-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.518724 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.518495 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rc5q\" (UniqueName: \"kubernetes.io/projected/8a3178ef-1487-40c8-92e6-d02db9782851-kube-api-access-6rc5q\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.518724 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.518513 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a3178ef-1487-40c8-92e6-d02db9782851-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.518724 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.518543 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8a3178ef-1487-40c8-92e6-d02db9782851-web-config\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.518724 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.518593 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8a3178ef-1487-40c8-92e6-d02db9782851-config-out\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.518724 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.518610 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a3178ef-1487-40c8-92e6-d02db9782851-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.518724 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.518629 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a3178ef-1487-40c8-92e6-d02db9782851-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.519717 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.519253 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8a3178ef-1487-40c8-92e6-d02db9782851-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.519717 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.519316 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8a3178ef-1487-40c8-92e6-d02db9782851-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.519717 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.519348 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8a3178ef-1487-40c8-92e6-d02db9782851-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.519717 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.519375 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a3178ef-1487-40c8-92e6-d02db9782851-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.519717 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.519398 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a3178ef-1487-40c8-92e6-d02db9782851-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.519717 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.519425 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a3178ef-1487-40c8-92e6-d02db9782851-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.519717 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.519458 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8a3178ef-1487-40c8-92e6-d02db9782851-config\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.519717 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.519484 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8a3178ef-1487-40c8-92e6-d02db9782851-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.519717 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.519516 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8a3178ef-1487-40c8-92e6-d02db9782851-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.519717 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.519543 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8a3178ef-1487-40c8-92e6-d02db9782851-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.519717 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.519598 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8a3178ef-1487-40c8-92e6-d02db9782851-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.620359 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.620320 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8a3178ef-1487-40c8-92e6-d02db9782851-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.620359 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.620366 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8a3178ef-1487-40c8-92e6-d02db9782851-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.620591 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.620389 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a3178ef-1487-40c8-92e6-d02db9782851-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.620591 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.620507 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8a3178ef-1487-40c8-92e6-d02db9782851-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.620683 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.620604 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8a3178ef-1487-40c8-92e6-d02db9782851-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.620683 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.620644 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rc5q\" (UniqueName: \"kubernetes.io/projected/8a3178ef-1487-40c8-92e6-d02db9782851-kube-api-access-6rc5q\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.620683 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.620675 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a3178ef-1487-40c8-92e6-d02db9782851-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.620831 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.620701 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8a3178ef-1487-40c8-92e6-d02db9782851-web-config\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.620831 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.620742 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8a3178ef-1487-40c8-92e6-d02db9782851-config-out\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.620831 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.620769 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a3178ef-1487-40c8-92e6-d02db9782851-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.620831 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.620795 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a3178ef-1487-40c8-92e6-d02db9782851-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.621026 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.620833 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8a3178ef-1487-40c8-92e6-d02db9782851-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.621026 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.620861 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8a3178ef-1487-40c8-92e6-d02db9782851-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.621026 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.620885 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8a3178ef-1487-40c8-92e6-d02db9782851-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.621026 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.620903 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a3178ef-1487-40c8-92e6-d02db9782851-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.621026 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.620933 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a3178ef-1487-40c8-92e6-d02db9782851-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.621026 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.620966 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a3178ef-1487-40c8-92e6-d02db9782851-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.621026 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.621000 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8a3178ef-1487-40c8-92e6-d02db9782851-config\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.621026 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.621025 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8a3178ef-1487-40c8-92e6-d02db9782851-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.621423 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.621051 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8a3178ef-1487-40c8-92e6-d02db9782851-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.621423 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.621177 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8a3178ef-1487-40c8-92e6-d02db9782851-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.621423 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.621385 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a3178ef-1487-40c8-92e6-d02db9782851-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.621611 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.621476 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8a3178ef-1487-40c8-92e6-d02db9782851-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.622422 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.622113 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a3178ef-1487-40c8-92e6-d02db9782851-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.623707 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.623682 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8a3178ef-1487-40c8-92e6-d02db9782851-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.623810 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.623742 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8a3178ef-1487-40c8-92e6-d02db9782851-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.624979 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.623981 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8a3178ef-1487-40c8-92e6-d02db9782851-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.624979 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.624325 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8a3178ef-1487-40c8-92e6-d02db9782851-config-out\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.624979 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.624419 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a3178ef-1487-40c8-92e6-d02db9782851-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.624979 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.624443 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a3178ef-1487-40c8-92e6-d02db9782851-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.624979 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.624648 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a3178ef-1487-40c8-92e6-d02db9782851-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.624979 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.624707 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8a3178ef-1487-40c8-92e6-d02db9782851-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.624979 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.624707 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8a3178ef-1487-40c8-92e6-d02db9782851-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.625450 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.625067 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a3178ef-1487-40c8-92e6-d02db9782851-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.625501 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.625453 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8a3178ef-1487-40c8-92e6-d02db9782851-web-config\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.626635 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.626613 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8a3178ef-1487-40c8-92e6-d02db9782851-config\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.626858 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.626834 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a3178ef-1487-40c8-92e6-d02db9782851-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.627123 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.627091 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8a3178ef-1487-40c8-92e6-d02db9782851-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.627206 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.627130 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8a3178ef-1487-40c8-92e6-d02db9782851-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.629141 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.629124 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rc5q\" (UniqueName: \"kubernetes.io/projected/8a3178ef-1487-40c8-92e6-d02db9782851-kube-api-access-6rc5q\") pod \"prometheus-k8s-0\" (UID: \"8a3178ef-1487-40c8-92e6-d02db9782851\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.776170 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.776066 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:31.923515 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:31.923478 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 30 17:03:31.926213 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:03:31.926182 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3178ef_1487_40c8_92e6_d02db9782851.slice/crio-4dc024f9dfeef45ef85a49bb4de687c840e728d3308bff6b230ad362e6fb8e12 WatchSource:0}: Error finding container 4dc024f9dfeef45ef85a49bb4de687c840e728d3308bff6b230ad362e6fb8e12: Status 404 returned error can't find the container with id 4dc024f9dfeef45ef85a49bb4de687c840e728d3308bff6b230ad362e6fb8e12 Jul 30 17:03:32.402016 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:32.401979 2570 generic.go:356] "Generic (PLEG): container finished" podID="8a3178ef-1487-40c8-92e6-d02db9782851" containerID="e062319c557ab33eefc3ce3db1a336228a26df0a83438d0af2bb8140094e4d76" exitCode=0 Jul 30 17:03:32.402458 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:32.402073 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a3178ef-1487-40c8-92e6-d02db9782851","Type":"ContainerDied","Data":"e062319c557ab33eefc3ce3db1a336228a26df0a83438d0af2bb8140094e4d76"} Jul 30 17:03:32.402458 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:32.402153 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a3178ef-1487-40c8-92e6-d02db9782851","Type":"ContainerStarted","Data":"4dc024f9dfeef45ef85a49bb4de687c840e728d3308bff6b230ad362e6fb8e12"} Jul 30 17:03:32.463952 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:32.463921 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d" path="/var/lib/kubelet/pods/d3cebcb0-d8af-4ca9-9bf1-f128ceb5112d/volumes" Jul 30 17:03:33.411352 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:33.411317 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a3178ef-1487-40c8-92e6-d02db9782851","Type":"ContainerStarted","Data":"ba9b91a83ec375e30b1a231c678615820bce52d547c5454d66bb882f5946dbc1"} Jul 30 17:03:33.411836 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:33.411409 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a3178ef-1487-40c8-92e6-d02db9782851","Type":"ContainerStarted","Data":"3a275dd39b83e863ec726fa6d2ebb26daee2e161a8bc782359e986d358193101"} Jul 30 17:03:33.411836 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:33.411438 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a3178ef-1487-40c8-92e6-d02db9782851","Type":"ContainerStarted","Data":"a4b1201ae49586602cc86167a1aded467259676aea5ba89844689e3bc8b7d3ca"} Jul 30 17:03:33.411836 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:33.411465 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a3178ef-1487-40c8-92e6-d02db9782851","Type":"ContainerStarted","Data":"be189f98e514bc9f44cfac39854c7d1beae4614fe0911be285039e86832c3a15"} Jul 30 17:03:33.411836 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:33.411489 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a3178ef-1487-40c8-92e6-d02db9782851","Type":"ContainerStarted","Data":"81cea91ef23e0216d35f009a476b6c4296cbd0d0eaf0ab13d8dc09c966db8cea"} Jul 30 17:03:33.411836 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:33.411513 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a3178ef-1487-40c8-92e6-d02db9782851","Type":"ContainerStarted","Data":"f11ed7cfc514b54e605f08dbbb71b7adb47c344748d8d250b033e810bcfb04db"} Jul 30 17:03:33.439787 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:33.439713 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.4192640499999998 podStartE2EDuration="2.439690218s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.426168ms" isStatefulPod=false podCreationTimestamp="2026-07-30 17:03:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:03:33.438228849 +0000 UTC m=+159.571075802" watchObservedRunningTime="2026-07-30 17:03:33.439690218 +0000 UTC m=+159.572537176" Jul 30 17:03:36.776751 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:36.776694 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:03:50.816527 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:50.816487 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:03:50.866858 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:03:50.866830 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:04:01.883568 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:04:01.883510 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:04:01.940676 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:04:01.940643 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:04:01.998209 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:04:01.998178 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:04:02.478976 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:04:02.478945 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:04:03.957672 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:04:03.957636 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:04:04.016566 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:04:04.016513 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:04:31.777253 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:04:31.777216 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:04:31.793145 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:04:31.793118 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:04:32.675350 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:04:32.675322 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 30 17:04:45.771962 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:04:45.771930 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:04:45.825806 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:04:45.825777 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:04:45.892418 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:04:45.892385 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:05:12.939760 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:05:12.939713 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:05:13.031794 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:05:13.031756 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:05:17.989964 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:05:17.989879 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:05:18.286603 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:05:18.286498 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:05:18.528878 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:05:18.528828 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:05:18.684426 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:05:18.684386 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:05:18.784450 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:05:18.784404 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:05:19.156625 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:05:19.156514 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:05:19.259710 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:05:19.259671 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:05:19.342822 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:05:19.342772 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:05:19.497817 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:05:19.497777 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:05:19.597282 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:05:19.597252 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:05:19.699105 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:05:19.699060 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:05:19.821283 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:05:19.821126 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:05:19.921798 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:05:19.921767 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:05:54.273388 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:05:54.273355 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/ovn-acl-logging/0.log" Jul 30 17:05:54.279040 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:05:54.279014 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/ovn-acl-logging/0.log" Jul 30 17:05:54.280403 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:05:54.280374 2570 kubelet.go:1648] "Image garbage collection succeeded" Jul 30 17:06:02.666571 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:02.666512 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:06:06.028319 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:06.028283 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:06:06.129334 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:06.129304 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:06:07.973771 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:07.973733 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:06:08.074960 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:08.074926 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:06:11.651680 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:11.651646 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:06:11.708329 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:11.708293 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:06:36.156764 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:36.156729 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:06:36.240661 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:36.240626 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:06:36.269764 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:36.269723 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-mpr6g"] Jul 30 17:06:36.273050 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:36.273025 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-mpr6g" Jul 30 17:06:36.275583 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:36.275561 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 30 17:06:36.275716 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:36.275664 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-7xdcq\"" Jul 30 17:06:36.276443 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:36.276426 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 30 17:06:36.276527 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:36.276439 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 30 17:06:36.280969 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:36.280949 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgcxm\" (UniqueName: \"kubernetes.io/projected/ad998c98-8fc7-46bd-be2c-5aa198f28a4e-kube-api-access-sgcxm\") pod \"seaweedfs-64568bcd49-mpr6g\" (UID: \"ad998c98-8fc7-46bd-be2c-5aa198f28a4e\") " pod="kserve/seaweedfs-64568bcd49-mpr6g" Jul 30 17:06:36.281068 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:36.280987 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ad998c98-8fc7-46bd-be2c-5aa198f28a4e-data\") pod \"seaweedfs-64568bcd49-mpr6g\" (UID: \"ad998c98-8fc7-46bd-be2c-5aa198f28a4e\") " pod="kserve/seaweedfs-64568bcd49-mpr6g" Jul 30 17:06:36.283871 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:36.283848 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-mpr6g"] Jul 30 17:06:36.346967 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:36.346936 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:06:36.382203 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:36.382147 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgcxm\" (UniqueName: \"kubernetes.io/projected/ad998c98-8fc7-46bd-be2c-5aa198f28a4e-kube-api-access-sgcxm\") pod \"seaweedfs-64568bcd49-mpr6g\" (UID: \"ad998c98-8fc7-46bd-be2c-5aa198f28a4e\") " pod="kserve/seaweedfs-64568bcd49-mpr6g" Jul 30 17:06:36.382403 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:36.382231 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ad998c98-8fc7-46bd-be2c-5aa198f28a4e-data\") pod \"seaweedfs-64568bcd49-mpr6g\" (UID: \"ad998c98-8fc7-46bd-be2c-5aa198f28a4e\") " pod="kserve/seaweedfs-64568bcd49-mpr6g" Jul 30 17:06:36.382653 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:36.382635 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ad998c98-8fc7-46bd-be2c-5aa198f28a4e-data\") pod \"seaweedfs-64568bcd49-mpr6g\" (UID: \"ad998c98-8fc7-46bd-be2c-5aa198f28a4e\") " pod="kserve/seaweedfs-64568bcd49-mpr6g" Jul 30 17:06:36.391206 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:36.391179 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgcxm\" (UniqueName: \"kubernetes.io/projected/ad998c98-8fc7-46bd-be2c-5aa198f28a4e-kube-api-access-sgcxm\") pod \"seaweedfs-64568bcd49-mpr6g\" (UID: \"ad998c98-8fc7-46bd-be2c-5aa198f28a4e\") " pod="kserve/seaweedfs-64568bcd49-mpr6g" Jul 30 17:06:36.537024 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:36.536984 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:06:36.583534 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:36.583502 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-mpr6g" Jul 30 17:06:36.717241 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:36.717200 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-mpr6g"] Jul 30 17:06:36.722128 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:06:36.722103 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad998c98_8fc7_46bd_be2c_5aa198f28a4e.slice/crio-cbae511a0e67cf09151db996019d2096a605cae029cb630f27e1b560849ad322 WatchSource:0}: Error finding container cbae511a0e67cf09151db996019d2096a605cae029cb630f27e1b560849ad322: Status 404 returned error can't find the container with id cbae511a0e67cf09151db996019d2096a605cae029cb630f27e1b560849ad322 Jul 30 17:06:36.723770 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:36.723751 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 30 17:06:36.992372 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:36.992337 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:06:37.170036 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:37.170001 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-mpr6g" event={"ID":"ad998c98-8fc7-46bd-be2c-5aa198f28a4e","Type":"ContainerStarted","Data":"cbae511a0e67cf09151db996019d2096a605cae029cb630f27e1b560849ad322"} Jul 30 17:06:37.569437 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:37.569405 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:06:37.670825 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:37.670788 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:06:37.771421 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:37.771389 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:06:40.184892 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:40.184804 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-mpr6g" event={"ID":"ad998c98-8fc7-46bd-be2c-5aa198f28a4e","Type":"ContainerStarted","Data":"13274dab07e2c9b59c21656fc0f59c99464743dbd1406c545f241c6bf28e02fa"} Jul 30 17:06:40.185266 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:40.184923 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-mpr6g" Jul 30 17:06:40.201731 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:40.201675 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-mpr6g" podStartSLOduration=0.988735835 podStartE2EDuration="4.201658286s" totalImagesPullingTime="3.212922451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:06:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:06:40.200301529 +0000 UTC m=+346.333148487" watchObservedRunningTime="2026-07-30 17:06:40.201658286 +0000 UTC m=+346.334505243" Jul 30 17:06:46.191329 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:06:46.191248 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-mpr6g" Jul 30 17:07:02.080668 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:02.080631 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:07:08.093082 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:08.093047 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:07:29.169092 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.169056 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6859f9ccc5-7pg82"] Jul 30 17:07:29.172137 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.172111 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6859f9ccc5-7pg82" Jul 30 17:07:29.174707 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.174683 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 30 17:07:29.174857 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.174683 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 30 17:07:29.175765 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.175731 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 30 17:07:29.175873 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.175766 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 30 17:07:29.175873 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.175827 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 30 17:07:29.175997 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.175882 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8spx6\"" Jul 30 17:07:29.180330 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.180310 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 30 17:07:29.185344 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.185308 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6859f9ccc5-7pg82"] Jul 30 17:07:29.232178 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.232147 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:07:29.247616 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.247578 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c39eb557-f004-4de2-b7dd-3bcf7957c18d-oauth-serving-cert\") pod \"console-6859f9ccc5-7pg82\" (UID: \"c39eb557-f004-4de2-b7dd-3bcf7957c18d\") " pod="openshift-console/console-6859f9ccc5-7pg82" Jul 30 17:07:29.247775 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.247629 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccrc2\" (UniqueName: \"kubernetes.io/projected/c39eb557-f004-4de2-b7dd-3bcf7957c18d-kube-api-access-ccrc2\") pod \"console-6859f9ccc5-7pg82\" (UID: \"c39eb557-f004-4de2-b7dd-3bcf7957c18d\") " pod="openshift-console/console-6859f9ccc5-7pg82" Jul 30 17:07:29.247775 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.247655 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c39eb557-f004-4de2-b7dd-3bcf7957c18d-console-oauth-config\") pod \"console-6859f9ccc5-7pg82\" (UID: \"c39eb557-f004-4de2-b7dd-3bcf7957c18d\") " pod="openshift-console/console-6859f9ccc5-7pg82" Jul 30 17:07:29.247775 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.247741 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c39eb557-f004-4de2-b7dd-3bcf7957c18d-console-serving-cert\") pod \"console-6859f9ccc5-7pg82\" (UID: \"c39eb557-f004-4de2-b7dd-3bcf7957c18d\") " pod="openshift-console/console-6859f9ccc5-7pg82" Jul 30 17:07:29.247775 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.247769 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c39eb557-f004-4de2-b7dd-3bcf7957c18d-service-ca\") pod \"console-6859f9ccc5-7pg82\" (UID: \"c39eb557-f004-4de2-b7dd-3bcf7957c18d\") " pod="openshift-console/console-6859f9ccc5-7pg82" Jul 30 17:07:29.247904 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.247792 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c39eb557-f004-4de2-b7dd-3bcf7957c18d-console-config\") pod \"console-6859f9ccc5-7pg82\" (UID: \"c39eb557-f004-4de2-b7dd-3bcf7957c18d\") " pod="openshift-console/console-6859f9ccc5-7pg82" Jul 30 17:07:29.247904 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.247863 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c39eb557-f004-4de2-b7dd-3bcf7957c18d-trusted-ca-bundle\") pod \"console-6859f9ccc5-7pg82\" (UID: \"c39eb557-f004-4de2-b7dd-3bcf7957c18d\") " pod="openshift-console/console-6859f9ccc5-7pg82" Jul 30 17:07:29.288129 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.288092 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:07:29.348509 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.348465 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c39eb557-f004-4de2-b7dd-3bcf7957c18d-oauth-serving-cert\") pod \"console-6859f9ccc5-7pg82\" (UID: \"c39eb557-f004-4de2-b7dd-3bcf7957c18d\") " pod="openshift-console/console-6859f9ccc5-7pg82" Jul 30 17:07:29.348733 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.348521 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccrc2\" (UniqueName: \"kubernetes.io/projected/c39eb557-f004-4de2-b7dd-3bcf7957c18d-kube-api-access-ccrc2\") pod \"console-6859f9ccc5-7pg82\" (UID: \"c39eb557-f004-4de2-b7dd-3bcf7957c18d\") " pod="openshift-console/console-6859f9ccc5-7pg82" Jul 30 17:07:29.348733 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.348574 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c39eb557-f004-4de2-b7dd-3bcf7957c18d-console-oauth-config\") pod \"console-6859f9ccc5-7pg82\" (UID: \"c39eb557-f004-4de2-b7dd-3bcf7957c18d\") " pod="openshift-console/console-6859f9ccc5-7pg82" Jul 30 17:07:29.348733 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.348632 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c39eb557-f004-4de2-b7dd-3bcf7957c18d-console-serving-cert\") pod \"console-6859f9ccc5-7pg82\" (UID: \"c39eb557-f004-4de2-b7dd-3bcf7957c18d\") " pod="openshift-console/console-6859f9ccc5-7pg82" Jul 30 17:07:29.348733 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.348651 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c39eb557-f004-4de2-b7dd-3bcf7957c18d-service-ca\") pod \"console-6859f9ccc5-7pg82\" (UID: \"c39eb557-f004-4de2-b7dd-3bcf7957c18d\") " pod="openshift-console/console-6859f9ccc5-7pg82" Jul 30 17:07:29.348733 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.348678 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c39eb557-f004-4de2-b7dd-3bcf7957c18d-console-config\") pod \"console-6859f9ccc5-7pg82\" (UID: \"c39eb557-f004-4de2-b7dd-3bcf7957c18d\") " pod="openshift-console/console-6859f9ccc5-7pg82" Jul 30 17:07:29.348733 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.348704 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c39eb557-f004-4de2-b7dd-3bcf7957c18d-trusted-ca-bundle\") pod \"console-6859f9ccc5-7pg82\" (UID: \"c39eb557-f004-4de2-b7dd-3bcf7957c18d\") " pod="openshift-console/console-6859f9ccc5-7pg82" Jul 30 17:07:29.349322 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.349289 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c39eb557-f004-4de2-b7dd-3bcf7957c18d-oauth-serving-cert\") pod \"console-6859f9ccc5-7pg82\" (UID: \"c39eb557-f004-4de2-b7dd-3bcf7957c18d\") " pod="openshift-console/console-6859f9ccc5-7pg82" Jul 30 17:07:29.349445 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.349293 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c39eb557-f004-4de2-b7dd-3bcf7957c18d-console-config\") pod \"console-6859f9ccc5-7pg82\" (UID: \"c39eb557-f004-4de2-b7dd-3bcf7957c18d\") " pod="openshift-console/console-6859f9ccc5-7pg82" Jul 30 17:07:29.349445 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.349409 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c39eb557-f004-4de2-b7dd-3bcf7957c18d-service-ca\") pod \"console-6859f9ccc5-7pg82\" (UID: \"c39eb557-f004-4de2-b7dd-3bcf7957c18d\") " pod="openshift-console/console-6859f9ccc5-7pg82" Jul 30 17:07:29.349936 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.349915 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c39eb557-f004-4de2-b7dd-3bcf7957c18d-trusted-ca-bundle\") pod \"console-6859f9ccc5-7pg82\" (UID: \"c39eb557-f004-4de2-b7dd-3bcf7957c18d\") " pod="openshift-console/console-6859f9ccc5-7pg82" Jul 30 17:07:29.351071 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.351046 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c39eb557-f004-4de2-b7dd-3bcf7957c18d-console-oauth-config\") pod \"console-6859f9ccc5-7pg82\" (UID: \"c39eb557-f004-4de2-b7dd-3bcf7957c18d\") " pod="openshift-console/console-6859f9ccc5-7pg82" Jul 30 17:07:29.351233 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.351214 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c39eb557-f004-4de2-b7dd-3bcf7957c18d-console-serving-cert\") pod \"console-6859f9ccc5-7pg82\" (UID: \"c39eb557-f004-4de2-b7dd-3bcf7957c18d\") " pod="openshift-console/console-6859f9ccc5-7pg82" Jul 30 17:07:29.356719 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.356691 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccrc2\" (UniqueName: \"kubernetes.io/projected/c39eb557-f004-4de2-b7dd-3bcf7957c18d-kube-api-access-ccrc2\") pod \"console-6859f9ccc5-7pg82\" (UID: \"c39eb557-f004-4de2-b7dd-3bcf7957c18d\") " pod="openshift-console/console-6859f9ccc5-7pg82" Jul 30 17:07:29.365472 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.365443 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:07:29.415932 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.415898 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:07:29.482778 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.482690 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6859f9ccc5-7pg82" Jul 30 17:07:29.626846 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.626761 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6859f9ccc5-7pg82"] Jul 30 17:07:29.629285 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:07:29.629255 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc39eb557_f004_4de2_b7dd_3bcf7957c18d.slice/crio-f44b041b633fa07927498a3ad5fb475873f948dba10fe3f7fa1608b41d6bbca2 WatchSource:0}: Error finding container f44b041b633fa07927498a3ad5fb475873f948dba10fe3f7fa1608b41d6bbca2: Status 404 returned error can't find the container with id f44b041b633fa07927498a3ad5fb475873f948dba10fe3f7fa1608b41d6bbca2 Jul 30 17:07:29.970583 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:29.970518 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:07:30.025866 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:30.025831 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:07:30.393119 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:30.393036 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6859f9ccc5-7pg82" event={"ID":"c39eb557-f004-4de2-b7dd-3bcf7957c18d","Type":"ContainerStarted","Data":"d80fba03744c4155cc7883007627543a6643cf01185350d99b3624554be51e80"} Jul 30 17:07:30.393119 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:30.393087 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6859f9ccc5-7pg82" event={"ID":"c39eb557-f004-4de2-b7dd-3bcf7957c18d","Type":"ContainerStarted","Data":"f44b041b633fa07927498a3ad5fb475873f948dba10fe3f7fa1608b41d6bbca2"} Jul 30 17:07:30.411752 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:30.411696 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6859f9ccc5-7pg82" podStartSLOduration=1.411678893 podStartE2EDuration="1.411678893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:07:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:07:30.41094588 +0000 UTC m=+396.543792837" watchObservedRunningTime="2026-07-30 17:07:30.411678893 +0000 UTC m=+396.544525849" Jul 30 17:07:37.270148 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:37.270109 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:07:39.482944 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:39.482900 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6859f9ccc5-7pg82" Jul 30 17:07:39.483366 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:39.482974 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6859f9ccc5-7pg82" Jul 30 17:07:39.487870 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:39.487845 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6859f9ccc5-7pg82" Jul 30 17:07:40.438749 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:40.438719 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6859f9ccc5-7pg82" Jul 30 17:07:40.588394 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:40.588362 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:07:40.641243 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:40.641199 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:07:40.702511 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:40.702418 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:07:53.576097 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:53.576055 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:07:53.657431 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:53.657383 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:07:53.830052 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:53.829960 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:07:54.161714 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:54.161637 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:07:54.265769 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:54.265735 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:07:54.365087 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:07:54.365052 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:08:10.858204 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:08:10.858162 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-6dsp6"] Jul 30 17:08:10.861844 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:08:10.861824 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-6dsp6" Jul 30 17:08:10.868572 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:08:10.868526 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-6dsp6"] Jul 30 17:08:10.935620 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:08:10.935582 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj67q\" (UniqueName: \"kubernetes.io/projected/6aea8222-4628-4f80-81ef-fa39aefa0820-kube-api-access-cj67q\") pod \"s3-init-6dsp6\" (UID: \"6aea8222-4628-4f80-81ef-fa39aefa0820\") " pod="kserve/s3-init-6dsp6" Jul 30 17:08:10.935620 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:08:10.935624 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6aea8222-4628-4f80-81ef-fa39aefa0820-model-cache\") pod \"s3-init-6dsp6\" (UID: \"6aea8222-4628-4f80-81ef-fa39aefa0820\") " pod="kserve/s3-init-6dsp6" Jul 30 17:08:11.036246 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:08:11.036209 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj67q\" (UniqueName: \"kubernetes.io/projected/6aea8222-4628-4f80-81ef-fa39aefa0820-kube-api-access-cj67q\") pod \"s3-init-6dsp6\" (UID: \"6aea8222-4628-4f80-81ef-fa39aefa0820\") " pod="kserve/s3-init-6dsp6" Jul 30 17:08:11.036246 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:08:11.036255 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6aea8222-4628-4f80-81ef-fa39aefa0820-model-cache\") pod \"s3-init-6dsp6\" (UID: \"6aea8222-4628-4f80-81ef-fa39aefa0820\") " pod="kserve/s3-init-6dsp6" Jul 30 17:08:11.036724 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:08:11.036704 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6aea8222-4628-4f80-81ef-fa39aefa0820-model-cache\") pod \"s3-init-6dsp6\" (UID: \"6aea8222-4628-4f80-81ef-fa39aefa0820\") " pod="kserve/s3-init-6dsp6" Jul 30 17:08:11.045169 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:08:11.045132 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj67q\" (UniqueName: \"kubernetes.io/projected/6aea8222-4628-4f80-81ef-fa39aefa0820-kube-api-access-cj67q\") pod \"s3-init-6dsp6\" (UID: \"6aea8222-4628-4f80-81ef-fa39aefa0820\") " pod="kserve/s3-init-6dsp6" Jul 30 17:08:11.181661 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:08:11.181628 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-6dsp6" Jul 30 17:08:11.317998 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:08:11.317962 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-6dsp6"] Jul 30 17:08:11.321201 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:08:11.321172 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6aea8222_4628_4f80_81ef_fa39aefa0820.slice/crio-341e5b0a5de00d29bb778e589965ca9e7e148cdcf6ce2dc3cba0dddf627f2a7d WatchSource:0}: Error finding container 341e5b0a5de00d29bb778e589965ca9e7e148cdcf6ce2dc3cba0dddf627f2a7d: Status 404 returned error can't find the container with id 341e5b0a5de00d29bb778e589965ca9e7e148cdcf6ce2dc3cba0dddf627f2a7d Jul 30 17:08:11.564956 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:08:11.564866 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-6dsp6" event={"ID":"6aea8222-4628-4f80-81ef-fa39aefa0820","Type":"ContainerStarted","Data":"341e5b0a5de00d29bb778e589965ca9e7e148cdcf6ce2dc3cba0dddf627f2a7d"} Jul 30 17:08:15.585806 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:08:15.585721 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-6dsp6" event={"ID":"6aea8222-4628-4f80-81ef-fa39aefa0820","Type":"ContainerStarted","Data":"8b8d6d0685c8f85db13ff38f1002d2d7f735154c1391108c828de326e1b71959"} Jul 30 17:08:17.597143 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:08:17.597110 2570 generic.go:356] "Generic (PLEG): container finished" podID="6aea8222-4628-4f80-81ef-fa39aefa0820" containerID="8b8d6d0685c8f85db13ff38f1002d2d7f735154c1391108c828de326e1b71959" exitCode=0 Jul 30 17:08:17.597574 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:08:17.597183 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-6dsp6" event={"ID":"6aea8222-4628-4f80-81ef-fa39aefa0820","Type":"ContainerDied","Data":"8b8d6d0685c8f85db13ff38f1002d2d7f735154c1391108c828de326e1b71959"} Jul 30 17:08:22.624442 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:08:22.624406 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-6dsp6" event={"ID":"6aea8222-4628-4f80-81ef-fa39aefa0820","Type":"ContainerStarted","Data":"9d009f7791b8531a843f7f37ab174285ab94487e041081eaddc6b6afaeec82e9"} Jul 30 17:08:22.641018 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:08:22.640952 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-6dsp6" podStartSLOduration=2.07204749 podStartE2EDuration="12.640934596s" totalImagesPullingTime="8.677609489s" totalInitContainerRuntime="1.891277617s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:08:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:08:22.639883501 +0000 UTC m=+448.772730458" watchObservedRunningTime="2026-07-30 17:08:22.640934596 +0000 UTC m=+448.773781551" Jul 30 17:09:28.921688 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:28.921654 2570 generic.go:356] "Generic (PLEG): container finished" podID="6aea8222-4628-4f80-81ef-fa39aefa0820" containerID="9d009f7791b8531a843f7f37ab174285ab94487e041081eaddc6b6afaeec82e9" exitCode=0 Jul 30 17:09:28.922130 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:28.921724 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-6dsp6" event={"ID":"6aea8222-4628-4f80-81ef-fa39aefa0820","Type":"ContainerDied","Data":"9d009f7791b8531a843f7f37ab174285ab94487e041081eaddc6b6afaeec82e9"} Jul 30 17:09:30.064141 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:30.064109 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-6dsp6" Jul 30 17:09:30.162607 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:30.162572 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cj67q\" (UniqueName: \"kubernetes.io/projected/6aea8222-4628-4f80-81ef-fa39aefa0820-kube-api-access-cj67q\") pod \"6aea8222-4628-4f80-81ef-fa39aefa0820\" (UID: \"6aea8222-4628-4f80-81ef-fa39aefa0820\") " Jul 30 17:09:30.162763 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:30.162650 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6aea8222-4628-4f80-81ef-fa39aefa0820-model-cache\") pod \"6aea8222-4628-4f80-81ef-fa39aefa0820\" (UID: \"6aea8222-4628-4f80-81ef-fa39aefa0820\") " Jul 30 17:09:30.164828 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:30.164799 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6aea8222-4628-4f80-81ef-fa39aefa0820-kube-api-access-cj67q" (OuterVolumeSpecName: "kube-api-access-cj67q") pod "6aea8222-4628-4f80-81ef-fa39aefa0820" (UID: "6aea8222-4628-4f80-81ef-fa39aefa0820"). InnerVolumeSpecName "kube-api-access-cj67q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 17:09:30.181597 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:30.181508 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aea8222-4628-4f80-81ef-fa39aefa0820-model-cache" (OuterVolumeSpecName: "model-cache") pod "6aea8222-4628-4f80-81ef-fa39aefa0820" (UID: "6aea8222-4628-4f80-81ef-fa39aefa0820"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 17:09:30.263378 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:30.263344 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cj67q\" (UniqueName: \"kubernetes.io/projected/6aea8222-4628-4f80-81ef-fa39aefa0820-kube-api-access-cj67q\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:09:30.263378 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:30.263375 2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6aea8222-4628-4f80-81ef-fa39aefa0820-model-cache\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:09:30.932035 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:30.932002 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-6dsp6" event={"ID":"6aea8222-4628-4f80-81ef-fa39aefa0820","Type":"ContainerDied","Data":"341e5b0a5de00d29bb778e589965ca9e7e148cdcf6ce2dc3cba0dddf627f2a7d"} Jul 30 17:09:30.932221 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:30.932042 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="341e5b0a5de00d29bb778e589965ca9e7e148cdcf6ce2dc3cba0dddf627f2a7d" Jul 30 17:09:30.932221 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:30.932017 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-6dsp6" Jul 30 17:09:31.306120 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:31.306039 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:09:31.359243 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:31.359213 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:09:42.556956 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.556921 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:09:42.673417 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.673380 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h"] Jul 30 17:09:42.673960 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.673935 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aea8222-4628-4f80-81ef-fa39aefa0820" containerName="s3-init" Jul 30 17:09:42.673960 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.673957 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aea8222-4628-4f80-81ef-fa39aefa0820" containerName="s3-init" Jul 30 17:09:42.674169 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.673968 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aea8222-4628-4f80-81ef-fa39aefa0820" containerName="download-hf-model" Jul 30 17:09:42.674169 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.673974 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aea8222-4628-4f80-81ef-fa39aefa0820" containerName="download-hf-model" Jul 30 17:09:42.674169 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.674025 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6aea8222-4628-4f80-81ef-fa39aefa0820" containerName="s3-init" Jul 30 17:09:42.677847 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.677827 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" Jul 30 17:09:42.680862 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.680835 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\"" Jul 30 17:09:42.680862 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.680853 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 30 17:09:42.681029 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.680870 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\"" Jul 30 17:09:42.681029 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.680910 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-qvl2g\"" Jul 30 17:09:42.681029 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.680908 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Jul 30 17:09:42.681029 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.680849 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 30 17:09:42.681029 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.680842 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Jul 30 17:09:42.689800 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.689772 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h"] Jul 30 17:09:42.757524 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.757493 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:09:42.774989 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.774954 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a1b5f49e-4675-4553-b153-1a95c49dfd0b-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h\" (UID: \"a1b5f49e-4675-4553-b153-1a95c49dfd0b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" Jul 30 17:09:42.775161 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.775003 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a1b5f49e-4675-4553-b153-1a95c49dfd0b-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h\" (UID: \"a1b5f49e-4675-4553-b153-1a95c49dfd0b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" Jul 30 17:09:42.775161 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.775030 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a1b5f49e-4675-4553-b153-1a95c49dfd0b-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h\" (UID: \"a1b5f49e-4675-4553-b153-1a95c49dfd0b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" Jul 30 17:09:42.775237 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.775196 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a1b5f49e-4675-4553-b153-1a95c49dfd0b-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h\" (UID: \"a1b5f49e-4675-4553-b153-1a95c49dfd0b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" Jul 30 17:09:42.775237 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.775227 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jld9l\" (UniqueName: \"kubernetes.io/projected/a1b5f49e-4675-4553-b153-1a95c49dfd0b-kube-api-access-jld9l\") pod \"isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h\" (UID: \"a1b5f49e-4675-4553-b153-1a95c49dfd0b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" Jul 30 17:09:42.858599 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.858496 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:09:42.875862 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.875820 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jld9l\" (UniqueName: \"kubernetes.io/projected/a1b5f49e-4675-4553-b153-1a95c49dfd0b-kube-api-access-jld9l\") pod \"isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h\" (UID: \"a1b5f49e-4675-4553-b153-1a95c49dfd0b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" Jul 30 17:09:42.876050 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.875870 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a1b5f49e-4675-4553-b153-1a95c49dfd0b-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h\" (UID: \"a1b5f49e-4675-4553-b153-1a95c49dfd0b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" Jul 30 17:09:42.876050 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.875917 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a1b5f49e-4675-4553-b153-1a95c49dfd0b-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h\" (UID: \"a1b5f49e-4675-4553-b153-1a95c49dfd0b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" Jul 30 17:09:42.876050 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.875940 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a1b5f49e-4675-4553-b153-1a95c49dfd0b-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h\" (UID: \"a1b5f49e-4675-4553-b153-1a95c49dfd0b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" Jul 30 17:09:42.876050 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.876037 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a1b5f49e-4675-4553-b153-1a95c49dfd0b-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h\" (UID: \"a1b5f49e-4675-4553-b153-1a95c49dfd0b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" Jul 30 17:09:42.876443 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.876422 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a1b5f49e-4675-4553-b153-1a95c49dfd0b-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h\" (UID: \"a1b5f49e-4675-4553-b153-1a95c49dfd0b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" Jul 30 17:09:42.876644 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.876624 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a1b5f49e-4675-4553-b153-1a95c49dfd0b-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h\" (UID: \"a1b5f49e-4675-4553-b153-1a95c49dfd0b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" Jul 30 17:09:42.876701 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.876656 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a1b5f49e-4675-4553-b153-1a95c49dfd0b-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h\" (UID: \"a1b5f49e-4675-4553-b153-1a95c49dfd0b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" Jul 30 17:09:42.878436 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.878416 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a1b5f49e-4675-4553-b153-1a95c49dfd0b-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h\" (UID: \"a1b5f49e-4675-4553-b153-1a95c49dfd0b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" Jul 30 17:09:42.884224 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.884188 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jld9l\" (UniqueName: \"kubernetes.io/projected/a1b5f49e-4675-4553-b153-1a95c49dfd0b-kube-api-access-jld9l\") pod \"isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h\" (UID: \"a1b5f49e-4675-4553-b153-1a95c49dfd0b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" Jul 30 17:09:42.897343 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.897313 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd"] Jul 30 17:09:42.901379 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.901361 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" Jul 30 17:09:42.903672 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.903653 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-predictor-serving-cert\"" Jul 30 17:09:42.903737 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.903673 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\"" Jul 30 17:09:42.911734 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.911531 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd"] Jul 30 17:09:42.935427 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.935368 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:09:42.976948 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.976912 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e4365cd6-449a-444a-9694-5a733e194980-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-knwdd\" (UID: \"e4365cd6-449a-444a-9694-5a733e194980\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" Jul 30 17:09:42.977162 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.976970 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e4365cd6-449a-444a-9694-5a733e194980-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-knwdd\" (UID: \"e4365cd6-449a-444a-9694-5a733e194980\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" Jul 30 17:09:42.977162 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.977030 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e4365cd6-449a-444a-9694-5a733e194980-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-knwdd\" (UID: \"e4365cd6-449a-444a-9694-5a733e194980\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" Jul 30 17:09:42.977162 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.977134 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e4365cd6-449a-444a-9694-5a733e194980-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-knwdd\" (UID: \"e4365cd6-449a-444a-9694-5a733e194980\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" Jul 30 17:09:42.977304 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.977189 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4sj8\" (UniqueName: \"kubernetes.io/projected/e4365cd6-449a-444a-9694-5a733e194980-kube-api-access-n4sj8\") pod \"isvc-xgboost-graph-predictor-555fc69d56-knwdd\" (UID: \"e4365cd6-449a-444a-9694-5a733e194980\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" Jul 30 17:09:42.989150 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:42.989113 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" Jul 30 17:09:43.006681 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.006653 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:09:43.076708 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.076667 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:09:43.077749 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.077727 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4sj8\" (UniqueName: \"kubernetes.io/projected/e4365cd6-449a-444a-9694-5a733e194980-kube-api-access-n4sj8\") pod \"isvc-xgboost-graph-predictor-555fc69d56-knwdd\" (UID: \"e4365cd6-449a-444a-9694-5a733e194980\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" Jul 30 17:09:43.077875 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.077825 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e4365cd6-449a-444a-9694-5a733e194980-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-knwdd\" (UID: \"e4365cd6-449a-444a-9694-5a733e194980\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" Jul 30 17:09:43.077937 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.077872 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e4365cd6-449a-444a-9694-5a733e194980-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-knwdd\" (UID: \"e4365cd6-449a-444a-9694-5a733e194980\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" Jul 30 17:09:43.078288 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.078123 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e4365cd6-449a-444a-9694-5a733e194980-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-knwdd\" (UID: \"e4365cd6-449a-444a-9694-5a733e194980\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" Jul 30 17:09:43.078288 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.078200 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e4365cd6-449a-444a-9694-5a733e194980-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-knwdd\" (UID: \"e4365cd6-449a-444a-9694-5a733e194980\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" Jul 30 17:09:43.078807 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.078669 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e4365cd6-449a-444a-9694-5a733e194980-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-knwdd\" (UID: \"e4365cd6-449a-444a-9694-5a733e194980\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" Jul 30 17:09:43.078807 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.078753 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e4365cd6-449a-444a-9694-5a733e194980-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-knwdd\" (UID: \"e4365cd6-449a-444a-9694-5a733e194980\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" Jul 30 17:09:43.079203 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.079184 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e4365cd6-449a-444a-9694-5a733e194980-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-knwdd\" (UID: \"e4365cd6-449a-444a-9694-5a733e194980\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" Jul 30 17:09:43.080682 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.080661 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e4365cd6-449a-444a-9694-5a733e194980-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-knwdd\" (UID: \"e4365cd6-449a-444a-9694-5a733e194980\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" Jul 30 17:09:43.086129 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.086102 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4sj8\" (UniqueName: \"kubernetes.io/projected/e4365cd6-449a-444a-9694-5a733e194980-kube-api-access-n4sj8\") pod \"isvc-xgboost-graph-predictor-555fc69d56-knwdd\" (UID: \"e4365cd6-449a-444a-9694-5a733e194980\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" Jul 30 17:09:43.102699 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.102670 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr"] Jul 30 17:09:43.107664 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.107639 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" Jul 30 17:09:43.110075 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.110016 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-predictor-serving-cert\"" Jul 30 17:09:43.110075 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.110061 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\"" Jul 30 17:09:43.115663 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.115497 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr"] Jul 30 17:09:43.131600 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.131577 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h"] Jul 30 17:09:43.134281 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:09:43.134256 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b5f49e_4675_4553_b153_1a95c49dfd0b.slice/crio-d1a1ccb79b24d5905cd7d8c7b308464e54719a1bfd34f23b175078d5ab617271 WatchSource:0}: Error finding container d1a1ccb79b24d5905cd7d8c7b308464e54719a1bfd34f23b175078d5ab617271: Status 404 returned error can't find the container with id d1a1ccb79b24d5905cd7d8c7b308464e54719a1bfd34f23b175078d5ab617271 Jul 30 17:09:43.149463 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.149433 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:09:43.180907 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.180874 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b4cadd76-b1e3-445b-bfff-2d3bdd9602f2-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr\" (UID: \"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" Jul 30 17:09:43.181065 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.180918 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b4cadd76-b1e3-445b-bfff-2d3bdd9602f2-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr\" (UID: \"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" Jul 30 17:09:43.181065 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.180958 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6524l\" (UniqueName: \"kubernetes.io/projected/b4cadd76-b1e3-445b-bfff-2d3bdd9602f2-kube-api-access-6524l\") pod \"isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr\" (UID: \"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" Jul 30 17:09:43.181065 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.181055 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b4cadd76-b1e3-445b-bfff-2d3bdd9602f2-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr\" (UID: \"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" Jul 30 17:09:43.181239 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.181076 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b4cadd76-b1e3-445b-bfff-2d3bdd9602f2-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr\" (UID: \"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" Jul 30 17:09:43.214834 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.214799 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" Jul 30 17:09:43.244716 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.244681 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:09:43.282064 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.282031 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6524l\" (UniqueName: \"kubernetes.io/projected/b4cadd76-b1e3-445b-bfff-2d3bdd9602f2-kube-api-access-6524l\") pod \"isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr\" (UID: \"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" Jul 30 17:09:43.282278 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.282117 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b4cadd76-b1e3-445b-bfff-2d3bdd9602f2-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr\" (UID: \"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" Jul 30 17:09:43.282278 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.282148 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b4cadd76-b1e3-445b-bfff-2d3bdd9602f2-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr\" (UID: \"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" Jul 30 17:09:43.282278 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.282185 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b4cadd76-b1e3-445b-bfff-2d3bdd9602f2-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr\" (UID: \"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" Jul 30 17:09:43.282278 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.282207 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b4cadd76-b1e3-445b-bfff-2d3bdd9602f2-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr\" (UID: \"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" Jul 30 17:09:43.282621 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.282596 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b4cadd76-b1e3-445b-bfff-2d3bdd9602f2-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr\" (UID: \"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" Jul 30 17:09:43.283074 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.283048 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b4cadd76-b1e3-445b-bfff-2d3bdd9602f2-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr\" (UID: \"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" Jul 30 17:09:43.283161 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.283076 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b4cadd76-b1e3-445b-bfff-2d3bdd9602f2-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr\" (UID: \"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" Jul 30 17:09:43.284916 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.284891 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b4cadd76-b1e3-445b-bfff-2d3bdd9602f2-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr\" (UID: \"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" Jul 30 17:09:43.289990 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.289963 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6524l\" (UniqueName: \"kubernetes.io/projected/b4cadd76-b1e3-445b-bfff-2d3bdd9602f2-kube-api-access-6524l\") pod \"isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr\" (UID: \"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" Jul 30 17:09:43.353173 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.353125 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd"] Jul 30 17:09:43.355810 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:09:43.355784 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4365cd6_449a_444a_9694_5a733e194980.slice/crio-d7ffa1a5f00e1c9296c3835509ffd7dcd4c9b882c7db02500a7db26a937d0741 WatchSource:0}: Error finding container d7ffa1a5f00e1c9296c3835509ffd7dcd4c9b882c7db02500a7db26a937d0741: Status 404 returned error can't find the container with id d7ffa1a5f00e1c9296c3835509ffd7dcd4c9b882c7db02500a7db26a937d0741 Jul 30 17:09:43.420105 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.420080 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" Jul 30 17:09:43.563983 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.563957 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr"] Jul 30 17:09:43.566020 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:09:43.565988 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4cadd76_b1e3_445b_bfff_2d3bdd9602f2.slice/crio-127839b3bca1e89d6d0507cb37dc0b04c76ed2e372b72b33e02b812ea3478629 WatchSource:0}: Error finding container 127839b3bca1e89d6d0507cb37dc0b04c76ed2e372b72b33e02b812ea3478629: Status 404 returned error can't find the container with id 127839b3bca1e89d6d0507cb37dc0b04c76ed2e372b72b33e02b812ea3478629 Jul 30 17:09:43.991633 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.991592 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" event={"ID":"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2","Type":"ContainerStarted","Data":"f822885e13514f5b1a082aea64d42f9a89b040dd10ad4a935f86f5ca93babaf0"} Jul 30 17:09:43.991844 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.991668 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" event={"ID":"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2","Type":"ContainerStarted","Data":"127839b3bca1e89d6d0507cb37dc0b04c76ed2e372b72b33e02b812ea3478629"} Jul 30 17:09:43.993416 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.993379 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" event={"ID":"e4365cd6-449a-444a-9694-5a733e194980","Type":"ContainerStarted","Data":"cae2c44c3665eadc68435818b6b94f13e9883bff3fb11b3c34d05cf20110c833"} Jul 30 17:09:43.993538 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.993455 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" event={"ID":"e4365cd6-449a-444a-9694-5a733e194980","Type":"ContainerStarted","Data":"d7ffa1a5f00e1c9296c3835509ffd7dcd4c9b882c7db02500a7db26a937d0741"} Jul 30 17:09:43.995090 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.995066 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" event={"ID":"a1b5f49e-4675-4553-b153-1a95c49dfd0b","Type":"ContainerStarted","Data":"55f4b8b3bdae4fa0765d6fde55190cbc6f65c2cabbd74af3d4d0a2f090181657"} Jul 30 17:09:43.995206 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:43.995121 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" event={"ID":"a1b5f49e-4675-4553-b153-1a95c49dfd0b","Type":"ContainerStarted","Data":"d1a1ccb79b24d5905cd7d8c7b308464e54719a1bfd34f23b175078d5ab617271"} Jul 30 17:09:48.016989 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:48.016954 2570 generic.go:356] "Generic (PLEG): container finished" podID="b4cadd76-b1e3-445b-bfff-2d3bdd9602f2" containerID="f822885e13514f5b1a082aea64d42f9a89b040dd10ad4a935f86f5ca93babaf0" exitCode=0 Jul 30 17:09:48.017421 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:48.017031 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" event={"ID":"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2","Type":"ContainerDied","Data":"f822885e13514f5b1a082aea64d42f9a89b040dd10ad4a935f86f5ca93babaf0"} Jul 30 17:09:48.018775 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:48.018707 2570 generic.go:356] "Generic (PLEG): container finished" podID="e4365cd6-449a-444a-9694-5a733e194980" containerID="cae2c44c3665eadc68435818b6b94f13e9883bff3fb11b3c34d05cf20110c833" exitCode=0 Jul 30 17:09:48.018870 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:48.018791 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" event={"ID":"e4365cd6-449a-444a-9694-5a733e194980","Type":"ContainerDied","Data":"cae2c44c3665eadc68435818b6b94f13e9883bff3fb11b3c34d05cf20110c833"} Jul 30 17:09:48.020451 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:48.020433 2570 generic.go:356] "Generic (PLEG): container finished" podID="a1b5f49e-4675-4553-b153-1a95c49dfd0b" containerID="55f4b8b3bdae4fa0765d6fde55190cbc6f65c2cabbd74af3d4d0a2f090181657" exitCode=0 Jul 30 17:09:48.020561 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:48.020471 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" event={"ID":"a1b5f49e-4675-4553-b153-1a95c49dfd0b","Type":"ContainerDied","Data":"55f4b8b3bdae4fa0765d6fde55190cbc6f65c2cabbd74af3d4d0a2f090181657"} Jul 30 17:09:57.152581 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:57.152516 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:09:58.996564 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:09:58.996457 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:10:10.327816 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:10.327762 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:10:17.228304 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:17.228191 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" event={"ID":"a1b5f49e-4675-4553-b153-1a95c49dfd0b","Type":"ContainerStarted","Data":"d65fd95307470c54067aeb67fb5dc7da9565c7386b422b2a8376e1fd07e4a9d2"} Jul 30 17:10:17.231621 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:17.231578 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" event={"ID":"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2","Type":"ContainerStarted","Data":"305cf3968c952d1b3d527d4bbf7bc50423c9f6613c1041427e10f0633e68832f"} Jul 30 17:10:18.246093 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:18.246052 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" event={"ID":"e4365cd6-449a-444a-9694-5a733e194980","Type":"ContainerStarted","Data":"aa220bf36ee86c88f8d817241daf79c3e26aa2c35b16dda2e287986cd8b848fd"} Jul 30 17:10:20.258731 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:20.258695 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" event={"ID":"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2","Type":"ContainerStarted","Data":"15f1b80565551c16c12eff78584be63400fce527a4fd56d647c40fd6d7536cea"} Jul 30 17:10:20.259209 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:20.258848 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" Jul 30 17:10:20.259209 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:20.258952 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" Jul 30 17:10:20.260753 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:20.260721 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" podUID="b4cadd76-b1e3-445b-bfff-2d3bdd9602f2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused" Jul 30 17:10:20.261184 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:20.261153 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" event={"ID":"e4365cd6-449a-444a-9694-5a733e194980","Type":"ContainerStarted","Data":"4ea7d74d8601a9ae7a0e1f958d0eaf5f06402de43f80bd4647227d4fb5f53eb3"} Jul 30 17:10:20.261299 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:20.261223 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" Jul 30 17:10:20.261299 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:20.261254 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" Jul 30 17:10:20.262843 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:20.262771 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" podUID="e4365cd6-449a-444a-9694-5a733e194980" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused" Jul 30 17:10:20.263576 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:20.263536 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" event={"ID":"a1b5f49e-4675-4553-b153-1a95c49dfd0b","Type":"ContainerStarted","Data":"bd60908b52b1c051c867dfdf14934639baf6dd03cab941983cbbbab401b05144"} Jul 30 17:10:20.263692 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:20.263681 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" Jul 30 17:10:20.278313 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:20.278228 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" podStartSLOduration=1.883811216 podStartE2EDuration="37.278208049s" totalImagesPullingTime="31.431633981s" totalInitContainerRuntime="3.962762852s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:09:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:10:20.276851147 +0000 UTC m=+566.409698103" watchObservedRunningTime="2026-07-30 17:10:20.278208049 +0000 UTC m=+566.411055005" Jul 30 17:10:20.295790 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:20.295735 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" podStartSLOduration=3.064963051 podStartE2EDuration="38.29571711s" totalImagesPullingTime="31.378666209s" totalInitContainerRuntime="3.85208785s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:09:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:10:20.294442284 +0000 UTC m=+566.427289239" watchObservedRunningTime="2026-07-30 17:10:20.29571711 +0000 UTC m=+566.428564065" Jul 30 17:10:20.312200 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:20.312143 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" podStartSLOduration=2.902586072 podStartE2EDuration="38.312123676s" totalImagesPullingTime="31.421287391s" totalInitContainerRuntime="3.988250213s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:09:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:10:20.310992312 +0000 UTC m=+566.443839262" watchObservedRunningTime="2026-07-30 17:10:20.312123676 +0000 UTC m=+566.444970634" Jul 30 17:10:21.269440 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:21.269388 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" podUID="e4365cd6-449a-444a-9694-5a733e194980" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused" Jul 30 17:10:21.269925 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:21.269513 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" Jul 30 17:10:21.269925 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:21.269756 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" podUID="b4cadd76-b1e3-445b-bfff-2d3bdd9602f2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused" Jul 30 17:10:21.270830 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:21.270795 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" podUID="a1b5f49e-4675-4553-b153-1a95c49dfd0b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused" Jul 30 17:10:22.274047 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:22.274004 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" podUID="a1b5f49e-4675-4553-b153-1a95c49dfd0b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused" Jul 30 17:10:26.274537 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:26.274502 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" Jul 30 17:10:26.275007 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:26.274827 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" Jul 30 17:10:26.275190 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:26.275161 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" podUID="e4365cd6-449a-444a-9694-5a733e194980" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused" Jul 30 17:10:26.275427 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:26.275403 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" podUID="b4cadd76-b1e3-445b-bfff-2d3bdd9602f2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused" Jul 30 17:10:27.279446 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:27.279416 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" Jul 30 17:10:27.280036 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:27.280004 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" podUID="a1b5f49e-4675-4553-b153-1a95c49dfd0b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused" Jul 30 17:10:36.276076 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:36.276033 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" podUID="e4365cd6-449a-444a-9694-5a733e194980" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused" Jul 30 17:10:36.276076 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:36.276033 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" podUID="b4cadd76-b1e3-445b-bfff-2d3bdd9602f2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused" Jul 30 17:10:37.280434 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:37.280390 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" podUID="a1b5f49e-4675-4553-b153-1a95c49dfd0b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused" Jul 30 17:10:46.275903 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:46.275861 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" podUID="b4cadd76-b1e3-445b-bfff-2d3bdd9602f2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused" Jul 30 17:10:46.276360 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:46.275862 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" podUID="e4365cd6-449a-444a-9694-5a733e194980" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused" Jul 30 17:10:47.280380 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:47.280333 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" podUID="a1b5f49e-4675-4553-b153-1a95c49dfd0b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused" Jul 30 17:10:54.317486 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:54.317455 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/ovn-acl-logging/0.log" Jul 30 17:10:54.318501 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:54.318478 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/ovn-acl-logging/0.log" Jul 30 17:10:56.276000 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:56.275956 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" podUID="b4cadd76-b1e3-445b-bfff-2d3bdd9602f2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused" Jul 30 17:10:56.276391 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:56.275956 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" podUID="e4365cd6-449a-444a-9694-5a733e194980" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused" Jul 30 17:10:57.280576 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:10:57.280510 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" podUID="a1b5f49e-4675-4553-b153-1a95c49dfd0b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused" Jul 30 17:11:02.575456 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:11:02.575415 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:11:03.515370 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:11:03.515338 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:11:06.275993 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:11:06.275952 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" podUID="b4cadd76-b1e3-445b-bfff-2d3bdd9602f2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused" Jul 30 17:11:06.276385 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:11:06.275955 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" podUID="e4365cd6-449a-444a-9694-5a733e194980" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused" Jul 30 17:11:07.280435 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:11:07.280394 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" podUID="a1b5f49e-4675-4553-b153-1a95c49dfd0b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused" Jul 30 17:11:16.275824 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:11:16.275738 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" podUID="b4cadd76-b1e3-445b-bfff-2d3bdd9602f2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused" Jul 30 17:11:16.276291 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:11:16.275739 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" podUID="e4365cd6-449a-444a-9694-5a733e194980" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused" Jul 30 17:11:16.736018 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:11:16.735966 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:11:17.280383 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:11:17.280335 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" podUID="a1b5f49e-4675-4553-b153-1a95c49dfd0b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused" Jul 30 17:11:18.313653 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:11:18.313615 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:11:26.275684 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:11:26.275644 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" podUID="b4cadd76-b1e3-445b-bfff-2d3bdd9602f2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused" Jul 30 17:11:26.276253 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:11:26.276234 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" Jul 30 17:11:27.280209 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:11:27.280167 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" podUID="a1b5f49e-4675-4553-b153-1a95c49dfd0b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused" Jul 30 17:11:32.458643 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:11:32.458598 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" podUID="b4cadd76-b1e3-445b-bfff-2d3bdd9602f2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused" Jul 30 17:11:37.281347 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:11:37.281316 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" Jul 30 17:11:42.464053 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:11:42.464021 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" Jul 30 17:12:02.633087 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:02.633058 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:12:02.799901 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:02.799870 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:12:09.780619 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:09.780587 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:12:09.877538 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:09.877504 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:12:12.741930 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:12.741899 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:12:12.835179 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:12.829629 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr"] Jul 30 17:12:12.835179 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:12.830052 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" podUID="b4cadd76-b1e3-445b-bfff-2d3bdd9602f2" containerName="kserve-container" containerID="cri-o://305cf3968c952d1b3d527d4bbf7bc50423c9f6613c1041427e10f0633e68832f" gracePeriod=30 Jul 30 17:12:12.835179 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:12.830421 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" podUID="b4cadd76-b1e3-445b-bfff-2d3bdd9602f2" containerName="kube-rbac-proxy" containerID="cri-o://15f1b80565551c16c12eff78584be63400fce527a4fd56d647c40fd6d7536cea" gracePeriod=30 Jul 30 17:12:12.847930 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:12.847873 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:12:12.907747 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:12.907706 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h"] Jul 30 17:12:12.907991 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:12.907965 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" podUID="a1b5f49e-4675-4553-b153-1a95c49dfd0b" containerName="kube-rbac-proxy" containerID="cri-o://bd60908b52b1c051c867dfdf14934639baf6dd03cab941983cbbbab401b05144" gracePeriod=30 Jul 30 17:12:12.908072 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:12.907945 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" podUID="a1b5f49e-4675-4553-b153-1a95c49dfd0b" containerName="kserve-container" containerID="cri-o://d65fd95307470c54067aeb67fb5dc7da9565c7386b422b2a8376e1fd07e4a9d2" gracePeriod=30 Jul 30 17:12:12.958359 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:12.958310 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd"] Jul 30 17:12:12.958750 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:12.958709 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" podUID="e4365cd6-449a-444a-9694-5a733e194980" containerName="kserve-container" containerID="cri-o://aa220bf36ee86c88f8d817241daf79c3e26aa2c35b16dda2e287986cd8b848fd" gracePeriod=30 Jul 30 17:12:12.958846 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:12.958746 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" podUID="e4365cd6-449a-444a-9694-5a733e194980" containerName="kube-rbac-proxy" containerID="cri-o://4ea7d74d8601a9ae7a0e1f958d0eaf5f06402de43f80bd4647227d4fb5f53eb3" gracePeriod=30 Jul 30 17:12:12.960189 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:12.960163 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:12:13.036738 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:13.036703 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:12:13.097897 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:13.097869 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:12:13.198057 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:13.198023 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:12:13.422320 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:13.422288 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:12:13.822834 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:13.822743 2570 generic.go:356] "Generic (PLEG): container finished" podID="a1b5f49e-4675-4553-b153-1a95c49dfd0b" containerID="bd60908b52b1c051c867dfdf14934639baf6dd03cab941983cbbbab401b05144" exitCode=2 Jul 30 17:12:13.822834 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:13.822819 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" event={"ID":"a1b5f49e-4675-4553-b153-1a95c49dfd0b","Type":"ContainerDied","Data":"bd60908b52b1c051c867dfdf14934639baf6dd03cab941983cbbbab401b05144"} Jul 30 17:12:13.824816 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:13.824794 2570 generic.go:356] "Generic (PLEG): container finished" podID="b4cadd76-b1e3-445b-bfff-2d3bdd9602f2" containerID="15f1b80565551c16c12eff78584be63400fce527a4fd56d647c40fd6d7536cea" exitCode=2 Jul 30 17:12:13.824950 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:13.824863 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" event={"ID":"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2","Type":"ContainerDied","Data":"15f1b80565551c16c12eff78584be63400fce527a4fd56d647c40fd6d7536cea"} Jul 30 17:12:13.826830 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:13.826810 2570 generic.go:356] "Generic (PLEG): container finished" podID="e4365cd6-449a-444a-9694-5a733e194980" containerID="4ea7d74d8601a9ae7a0e1f958d0eaf5f06402de43f80bd4647227d4fb5f53eb3" exitCode=2 Jul 30 17:12:13.826935 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:13.826863 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" event={"ID":"e4365cd6-449a-444a-9694-5a733e194980","Type":"ContainerDied","Data":"4ea7d74d8601a9ae7a0e1f958d0eaf5f06402de43f80bd4647227d4fb5f53eb3"} Jul 30 17:12:16.270028 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:16.269987 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" podUID="b4cadd76-b1e3-445b-bfff-2d3bdd9602f2" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.28:8643/healthz\": dial tcp 10.134.0.28:8643: connect: connection refused" Jul 30 17:12:16.270434 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:16.269995 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" podUID="e4365cd6-449a-444a-9694-5a733e194980" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.27:8643/healthz\": dial tcp 10.134.0.27:8643: connect: connection refused" Jul 30 17:12:16.275260 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:16.275218 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" podUID="e4365cd6-449a-444a-9694-5a733e194980" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused" Jul 30 17:12:16.947835 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:16.947803 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:12:17.105002 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.104964 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:12:17.211728 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.211661 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" Jul 30 17:12:17.275298 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.275257 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" podUID="a1b5f49e-4675-4553-b153-1a95c49dfd0b" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.26:8643/healthz\": dial tcp 10.134.0.26:8643: connect: connection refused" Jul 30 17:12:17.280681 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.280648 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" podUID="a1b5f49e-4675-4553-b153-1a95c49dfd0b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused" Jul 30 17:12:17.331619 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.331541 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e4365cd6-449a-444a-9694-5a733e194980-kserve-provision-location\") pod \"e4365cd6-449a-444a-9694-5a733e194980\" (UID: \"e4365cd6-449a-444a-9694-5a733e194980\") " Jul 30 17:12:17.331762 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.331642 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4sj8\" (UniqueName: \"kubernetes.io/projected/e4365cd6-449a-444a-9694-5a733e194980-kube-api-access-n4sj8\") pod \"e4365cd6-449a-444a-9694-5a733e194980\" (UID: \"e4365cd6-449a-444a-9694-5a733e194980\") " Jul 30 17:12:17.331762 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.331687 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e4365cd6-449a-444a-9694-5a733e194980-proxy-tls\") pod \"e4365cd6-449a-444a-9694-5a733e194980\" (UID: \"e4365cd6-449a-444a-9694-5a733e194980\") " Jul 30 17:12:17.331762 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.331757 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e4365cd6-449a-444a-9694-5a733e194980-cabundle-cert\") pod \"e4365cd6-449a-444a-9694-5a733e194980\" (UID: \"e4365cd6-449a-444a-9694-5a733e194980\") " Jul 30 17:12:17.331973 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.331807 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e4365cd6-449a-444a-9694-5a733e194980-kube-rbac-proxy-sar-config\") pod \"e4365cd6-449a-444a-9694-5a733e194980\" (UID: \"e4365cd6-449a-444a-9694-5a733e194980\") " Jul 30 17:12:17.331973 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.331893 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4365cd6-449a-444a-9694-5a733e194980-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "e4365cd6-449a-444a-9694-5a733e194980" (UID: "e4365cd6-449a-444a-9694-5a733e194980"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 17:12:17.332088 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.332073 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4365cd6-449a-444a-9694-5a733e194980-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "e4365cd6-449a-444a-9694-5a733e194980" (UID: "e4365cd6-449a-444a-9694-5a733e194980"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 17:12:17.332191 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.332169 2570 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e4365cd6-449a-444a-9694-5a733e194980-cabundle-cert\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:12:17.332191 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.332186 2570 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e4365cd6-449a-444a-9694-5a733e194980-kserve-provision-location\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:12:17.332370 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.332236 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4365cd6-449a-444a-9694-5a733e194980-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "e4365cd6-449a-444a-9694-5a733e194980" (UID: "e4365cd6-449a-444a-9694-5a733e194980"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 17:12:17.333977 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.333948 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4365cd6-449a-444a-9694-5a733e194980-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "e4365cd6-449a-444a-9694-5a733e194980" (UID: "e4365cd6-449a-444a-9694-5a733e194980"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 17:12:17.334085 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.334016 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4365cd6-449a-444a-9694-5a733e194980-kube-api-access-n4sj8" (OuterVolumeSpecName: "kube-api-access-n4sj8") pod "e4365cd6-449a-444a-9694-5a733e194980" (UID: "e4365cd6-449a-444a-9694-5a733e194980"). InnerVolumeSpecName "kube-api-access-n4sj8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 17:12:17.432946 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.432905 2570 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e4365cd6-449a-444a-9694-5a733e194980-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:12:17.432946 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.432937 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4sj8\" (UniqueName: \"kubernetes.io/projected/e4365cd6-449a-444a-9694-5a733e194980-kube-api-access-n4sj8\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:12:17.433149 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.432969 2570 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e4365cd6-449a-444a-9694-5a733e194980-proxy-tls\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:12:17.848941 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.848909 2570 generic.go:356] "Generic (PLEG): container finished" podID="e4365cd6-449a-444a-9694-5a733e194980" containerID="aa220bf36ee86c88f8d817241daf79c3e26aa2c35b16dda2e287986cd8b848fd" exitCode=0 Jul 30 17:12:17.849131 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.848963 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" event={"ID":"e4365cd6-449a-444a-9694-5a733e194980","Type":"ContainerDied","Data":"aa220bf36ee86c88f8d817241daf79c3e26aa2c35b16dda2e287986cd8b848fd"} Jul 30 17:12:17.849131 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.849043 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" event={"ID":"e4365cd6-449a-444a-9694-5a733e194980","Type":"ContainerDied","Data":"d7ffa1a5f00e1c9296c3835509ffd7dcd4c9b882c7db02500a7db26a937d0741"} Jul 30 17:12:17.849131 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.848974 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd" Jul 30 17:12:17.849131 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.849069 2570 scope.go:117] "RemoveContainer" containerID="4ea7d74d8601a9ae7a0e1f958d0eaf5f06402de43f80bd4647227d4fb5f53eb3" Jul 30 17:12:17.863968 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.863942 2570 scope.go:117] "RemoveContainer" containerID="aa220bf36ee86c88f8d817241daf79c3e26aa2c35b16dda2e287986cd8b848fd" Jul 30 17:12:17.872773 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.872704 2570 scope.go:117] "RemoveContainer" containerID="cae2c44c3665eadc68435818b6b94f13e9883bff3fb11b3c34d05cf20110c833" Jul 30 17:12:17.874762 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.874738 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd"] Jul 30 17:12:17.878281 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.878257 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-knwdd"] Jul 30 17:12:17.882386 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.882369 2570 scope.go:117] "RemoveContainer" containerID="4ea7d74d8601a9ae7a0e1f958d0eaf5f06402de43f80bd4647227d4fb5f53eb3" Jul 30 17:12:17.882779 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:12:17.882759 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ea7d74d8601a9ae7a0e1f958d0eaf5f06402de43f80bd4647227d4fb5f53eb3\": container with ID starting with 4ea7d74d8601a9ae7a0e1f958d0eaf5f06402de43f80bd4647227d4fb5f53eb3 not found: ID does not exist" containerID="4ea7d74d8601a9ae7a0e1f958d0eaf5f06402de43f80bd4647227d4fb5f53eb3" Jul 30 17:12:17.882846 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.882794 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ea7d74d8601a9ae7a0e1f958d0eaf5f06402de43f80bd4647227d4fb5f53eb3"} err="failed to get container status \"4ea7d74d8601a9ae7a0e1f958d0eaf5f06402de43f80bd4647227d4fb5f53eb3\": rpc error: code = NotFound desc = could not find container \"4ea7d74d8601a9ae7a0e1f958d0eaf5f06402de43f80bd4647227d4fb5f53eb3\": container with ID starting with 4ea7d74d8601a9ae7a0e1f958d0eaf5f06402de43f80bd4647227d4fb5f53eb3 not found: ID does not exist" Jul 30 17:12:17.882846 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.882822 2570 scope.go:117] "RemoveContainer" containerID="aa220bf36ee86c88f8d817241daf79c3e26aa2c35b16dda2e287986cd8b848fd" Jul 30 17:12:17.883122 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:12:17.883104 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa220bf36ee86c88f8d817241daf79c3e26aa2c35b16dda2e287986cd8b848fd\": container with ID starting with aa220bf36ee86c88f8d817241daf79c3e26aa2c35b16dda2e287986cd8b848fd not found: ID does not exist" containerID="aa220bf36ee86c88f8d817241daf79c3e26aa2c35b16dda2e287986cd8b848fd" Jul 30 17:12:17.883162 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.883128 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa220bf36ee86c88f8d817241daf79c3e26aa2c35b16dda2e287986cd8b848fd"} err="failed to get container status \"aa220bf36ee86c88f8d817241daf79c3e26aa2c35b16dda2e287986cd8b848fd\": rpc error: code = NotFound desc = could not find container \"aa220bf36ee86c88f8d817241daf79c3e26aa2c35b16dda2e287986cd8b848fd\": container with ID starting with aa220bf36ee86c88f8d817241daf79c3e26aa2c35b16dda2e287986cd8b848fd not found: ID does not exist" Jul 30 17:12:17.883162 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.883144 2570 scope.go:117] "RemoveContainer" containerID="cae2c44c3665eadc68435818b6b94f13e9883bff3fb11b3c34d05cf20110c833" Jul 30 17:12:17.883384 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:12:17.883367 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cae2c44c3665eadc68435818b6b94f13e9883bff3fb11b3c34d05cf20110c833\": container with ID starting with cae2c44c3665eadc68435818b6b94f13e9883bff3fb11b3c34d05cf20110c833 not found: ID does not exist" containerID="cae2c44c3665eadc68435818b6b94f13e9883bff3fb11b3c34d05cf20110c833" Jul 30 17:12:17.883423 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:17.883389 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cae2c44c3665eadc68435818b6b94f13e9883bff3fb11b3c34d05cf20110c833"} err="failed to get container status \"cae2c44c3665eadc68435818b6b94f13e9883bff3fb11b3c34d05cf20110c833\": rpc error: code = NotFound desc = could not find container \"cae2c44c3665eadc68435818b6b94f13e9883bff3fb11b3c34d05cf20110c833\": container with ID starting with cae2c44c3665eadc68435818b6b94f13e9883bff3fb11b3c34d05cf20110c833 not found: ID does not exist" Jul 30 17:12:18.464948 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.464914 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4365cd6-449a-444a-9694-5a733e194980" path="/var/lib/kubelet/pods/e4365cd6-449a-444a-9694-5a733e194980/volumes" Jul 30 17:12:18.599903 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.599877 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" Jul 30 17:12:18.671388 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.671359 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" Jul 30 17:12:18.746096 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.746001 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a1b5f49e-4675-4553-b153-1a95c49dfd0b-kserve-provision-location\") pod \"a1b5f49e-4675-4553-b153-1a95c49dfd0b\" (UID: \"a1b5f49e-4675-4553-b153-1a95c49dfd0b\") " Jul 30 17:12:18.746096 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.746051 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6524l\" (UniqueName: \"kubernetes.io/projected/b4cadd76-b1e3-445b-bfff-2d3bdd9602f2-kube-api-access-6524l\") pod \"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2\" (UID: \"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2\") " Jul 30 17:12:18.746096 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.746088 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b4cadd76-b1e3-445b-bfff-2d3bdd9602f2-cabundle-cert\") pod \"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2\" (UID: \"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2\") " Jul 30 17:12:18.746326 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.746111 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b4cadd76-b1e3-445b-bfff-2d3bdd9602f2-proxy-tls\") pod \"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2\" (UID: \"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2\") " Jul 30 17:12:18.746326 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.746174 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a1b5f49e-4675-4553-b153-1a95c49dfd0b-kube-rbac-proxy-sar-config\") pod \"a1b5f49e-4675-4553-b153-1a95c49dfd0b\" (UID: \"a1b5f49e-4675-4553-b153-1a95c49dfd0b\") " Jul 30 17:12:18.746326 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.746222 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b4cadd76-b1e3-445b-bfff-2d3bdd9602f2-kserve-provision-location\") pod \"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2\" (UID: \"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2\") " Jul 30 17:12:18.746326 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.746257 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a1b5f49e-4675-4553-b153-1a95c49dfd0b-proxy-tls\") pod \"a1b5f49e-4675-4553-b153-1a95c49dfd0b\" (UID: \"a1b5f49e-4675-4553-b153-1a95c49dfd0b\") " Jul 30 17:12:18.746326 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.746281 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jld9l\" (UniqueName: \"kubernetes.io/projected/a1b5f49e-4675-4553-b153-1a95c49dfd0b-kube-api-access-jld9l\") pod \"a1b5f49e-4675-4553-b153-1a95c49dfd0b\" (UID: \"a1b5f49e-4675-4553-b153-1a95c49dfd0b\") " Jul 30 17:12:18.746326 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.746310 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a1b5f49e-4675-4553-b153-1a95c49dfd0b-cabundle-cert\") pod \"a1b5f49e-4675-4553-b153-1a95c49dfd0b\" (UID: \"a1b5f49e-4675-4553-b153-1a95c49dfd0b\") " Jul 30 17:12:18.746648 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.746411 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1b5f49e-4675-4553-b153-1a95c49dfd0b-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "a1b5f49e-4675-4553-b153-1a95c49dfd0b" (UID: "a1b5f49e-4675-4553-b153-1a95c49dfd0b"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 17:12:18.746707 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.746654 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1b5f49e-4675-4553-b153-1a95c49dfd0b-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "a1b5f49e-4675-4553-b153-1a95c49dfd0b" (UID: "a1b5f49e-4675-4553-b153-1a95c49dfd0b"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 17:12:18.746807 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.746784 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1b5f49e-4675-4553-b153-1a95c49dfd0b-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "a1b5f49e-4675-4553-b153-1a95c49dfd0b" (UID: "a1b5f49e-4675-4553-b153-1a95c49dfd0b"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 17:12:18.746863 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.746812 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4cadd76-b1e3-445b-bfff-2d3bdd9602f2-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "b4cadd76-b1e3-445b-bfff-2d3bdd9602f2" (UID: "b4cadd76-b1e3-445b-bfff-2d3bdd9602f2"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 17:12:18.746863 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.746822 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b4cadd76-b1e3-445b-bfff-2d3bdd9602f2-kube-rbac-proxy-sar-config\") pod \"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2\" (UID: \"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2\") " Jul 30 17:12:18.746971 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.746858 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4cadd76-b1e3-445b-bfff-2d3bdd9602f2-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "b4cadd76-b1e3-445b-bfff-2d3bdd9602f2" (UID: "b4cadd76-b1e3-445b-bfff-2d3bdd9602f2"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 17:12:18.747119 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.747097 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4cadd76-b1e3-445b-bfff-2d3bdd9602f2-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "b4cadd76-b1e3-445b-bfff-2d3bdd9602f2" (UID: "b4cadd76-b1e3-445b-bfff-2d3bdd9602f2"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 17:12:18.747299 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.747283 2570 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a1b5f49e-4675-4553-b153-1a95c49dfd0b-kserve-provision-location\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:12:18.747360 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.747300 2570 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b4cadd76-b1e3-445b-bfff-2d3bdd9602f2-cabundle-cert\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:12:18.747360 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.747310 2570 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a1b5f49e-4675-4553-b153-1a95c49dfd0b-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:12:18.747360 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.747319 2570 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b4cadd76-b1e3-445b-bfff-2d3bdd9602f2-kserve-provision-location\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:12:18.747360 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.747327 2570 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a1b5f49e-4675-4553-b153-1a95c49dfd0b-cabundle-cert\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:12:18.747360 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.747338 2570 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b4cadd76-b1e3-445b-bfff-2d3bdd9602f2-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:12:18.748569 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.748514 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1b5f49e-4675-4553-b153-1a95c49dfd0b-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a1b5f49e-4675-4553-b153-1a95c49dfd0b" (UID: "a1b5f49e-4675-4553-b153-1a95c49dfd0b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 17:12:18.748710 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.748689 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1b5f49e-4675-4553-b153-1a95c49dfd0b-kube-api-access-jld9l" (OuterVolumeSpecName: "kube-api-access-jld9l") pod "a1b5f49e-4675-4553-b153-1a95c49dfd0b" (UID: "a1b5f49e-4675-4553-b153-1a95c49dfd0b"). InnerVolumeSpecName "kube-api-access-jld9l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 17:12:18.748796 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.748779 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4cadd76-b1e3-445b-bfff-2d3bdd9602f2-kube-api-access-6524l" (OuterVolumeSpecName: "kube-api-access-6524l") pod "b4cadd76-b1e3-445b-bfff-2d3bdd9602f2" (UID: "b4cadd76-b1e3-445b-bfff-2d3bdd9602f2"). InnerVolumeSpecName "kube-api-access-6524l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 17:12:18.748846 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.748803 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4cadd76-b1e3-445b-bfff-2d3bdd9602f2-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "b4cadd76-b1e3-445b-bfff-2d3bdd9602f2" (UID: "b4cadd76-b1e3-445b-bfff-2d3bdd9602f2"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 17:12:18.848822 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.848780 2570 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a1b5f49e-4675-4553-b153-1a95c49dfd0b-proxy-tls\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:12:18.848822 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.848814 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jld9l\" (UniqueName: \"kubernetes.io/projected/a1b5f49e-4675-4553-b153-1a95c49dfd0b-kube-api-access-jld9l\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:12:18.848822 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.848826 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6524l\" (UniqueName: \"kubernetes.io/projected/b4cadd76-b1e3-445b-bfff-2d3bdd9602f2-kube-api-access-6524l\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:12:18.849115 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.848837 2570 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b4cadd76-b1e3-445b-bfff-2d3bdd9602f2-proxy-tls\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:12:18.855473 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.855439 2570 generic.go:356] "Generic (PLEG): container finished" podID="b4cadd76-b1e3-445b-bfff-2d3bdd9602f2" containerID="305cf3968c952d1b3d527d4bbf7bc50423c9f6613c1041427e10f0633e68832f" exitCode=0 Jul 30 17:12:18.855647 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.855507 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" Jul 30 17:12:18.855647 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.855525 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" event={"ID":"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2","Type":"ContainerDied","Data":"305cf3968c952d1b3d527d4bbf7bc50423c9f6613c1041427e10f0633e68832f"} Jul 30 17:12:18.855647 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.855621 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr" event={"ID":"b4cadd76-b1e3-445b-bfff-2d3bdd9602f2","Type":"ContainerDied","Data":"127839b3bca1e89d6d0507cb37dc0b04c76ed2e372b72b33e02b812ea3478629"} Jul 30 17:12:18.855837 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.855659 2570 scope.go:117] "RemoveContainer" containerID="15f1b80565551c16c12eff78584be63400fce527a4fd56d647c40fd6d7536cea" Jul 30 17:12:18.858503 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.858473 2570 generic.go:356] "Generic (PLEG): container finished" podID="a1b5f49e-4675-4553-b153-1a95c49dfd0b" containerID="d65fd95307470c54067aeb67fb5dc7da9565c7386b422b2a8376e1fd07e4a9d2" exitCode=0 Jul 30 17:12:18.858625 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.858524 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" event={"ID":"a1b5f49e-4675-4553-b153-1a95c49dfd0b","Type":"ContainerDied","Data":"d65fd95307470c54067aeb67fb5dc7da9565c7386b422b2a8376e1fd07e4a9d2"} Jul 30 17:12:18.858625 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.858544 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" Jul 30 17:12:18.858625 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.858595 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h" event={"ID":"a1b5f49e-4675-4553-b153-1a95c49dfd0b","Type":"ContainerDied","Data":"d1a1ccb79b24d5905cd7d8c7b308464e54719a1bfd34f23b175078d5ab617271"} Jul 30 17:12:18.864577 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.864561 2570 scope.go:117] "RemoveContainer" containerID="305cf3968c952d1b3d527d4bbf7bc50423c9f6613c1041427e10f0633e68832f" Jul 30 17:12:18.874675 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.874656 2570 scope.go:117] "RemoveContainer" containerID="f822885e13514f5b1a082aea64d42f9a89b040dd10ad4a935f86f5ca93babaf0" Jul 30 17:12:18.879998 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.879964 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr"] Jul 30 17:12:18.882896 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.882867 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-9dc8c55d5-tmrwr"] Jul 30 17:12:18.884893 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.884873 2570 scope.go:117] "RemoveContainer" containerID="15f1b80565551c16c12eff78584be63400fce527a4fd56d647c40fd6d7536cea" Jul 30 17:12:18.885191 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:12:18.885173 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15f1b80565551c16c12eff78584be63400fce527a4fd56d647c40fd6d7536cea\": container with ID starting with 15f1b80565551c16c12eff78584be63400fce527a4fd56d647c40fd6d7536cea not found: ID does not exist" containerID="15f1b80565551c16c12eff78584be63400fce527a4fd56d647c40fd6d7536cea" Jul 30 17:12:18.885241 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.885200 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15f1b80565551c16c12eff78584be63400fce527a4fd56d647c40fd6d7536cea"} err="failed to get container status \"15f1b80565551c16c12eff78584be63400fce527a4fd56d647c40fd6d7536cea\": rpc error: code = NotFound desc = could not find container \"15f1b80565551c16c12eff78584be63400fce527a4fd56d647c40fd6d7536cea\": container with ID starting with 15f1b80565551c16c12eff78584be63400fce527a4fd56d647c40fd6d7536cea not found: ID does not exist" Jul 30 17:12:18.885241 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.885215 2570 scope.go:117] "RemoveContainer" containerID="305cf3968c952d1b3d527d4bbf7bc50423c9f6613c1041427e10f0633e68832f" Jul 30 17:12:18.885452 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:12:18.885436 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"305cf3968c952d1b3d527d4bbf7bc50423c9f6613c1041427e10f0633e68832f\": container with ID starting with 305cf3968c952d1b3d527d4bbf7bc50423c9f6613c1041427e10f0633e68832f not found: ID does not exist" containerID="305cf3968c952d1b3d527d4bbf7bc50423c9f6613c1041427e10f0633e68832f" Jul 30 17:12:18.885493 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.885455 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"305cf3968c952d1b3d527d4bbf7bc50423c9f6613c1041427e10f0633e68832f"} err="failed to get container status \"305cf3968c952d1b3d527d4bbf7bc50423c9f6613c1041427e10f0633e68832f\": rpc error: code = NotFound desc = could not find container \"305cf3968c952d1b3d527d4bbf7bc50423c9f6613c1041427e10f0633e68832f\": container with ID starting with 305cf3968c952d1b3d527d4bbf7bc50423c9f6613c1041427e10f0633e68832f not found: ID does not exist" Jul 30 17:12:18.885493 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.885467 2570 scope.go:117] "RemoveContainer" containerID="f822885e13514f5b1a082aea64d42f9a89b040dd10ad4a935f86f5ca93babaf0" Jul 30 17:12:18.885705 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:12:18.885687 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f822885e13514f5b1a082aea64d42f9a89b040dd10ad4a935f86f5ca93babaf0\": container with ID starting with f822885e13514f5b1a082aea64d42f9a89b040dd10ad4a935f86f5ca93babaf0 not found: ID does not exist" containerID="f822885e13514f5b1a082aea64d42f9a89b040dd10ad4a935f86f5ca93babaf0" Jul 30 17:12:18.885746 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.885708 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f822885e13514f5b1a082aea64d42f9a89b040dd10ad4a935f86f5ca93babaf0"} err="failed to get container status \"f822885e13514f5b1a082aea64d42f9a89b040dd10ad4a935f86f5ca93babaf0\": rpc error: code = NotFound desc = could not find container \"f822885e13514f5b1a082aea64d42f9a89b040dd10ad4a935f86f5ca93babaf0\": container with ID starting with f822885e13514f5b1a082aea64d42f9a89b040dd10ad4a935f86f5ca93babaf0 not found: ID does not exist" Jul 30 17:12:18.885746 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.885721 2570 scope.go:117] "RemoveContainer" containerID="bd60908b52b1c051c867dfdf14934639baf6dd03cab941983cbbbab401b05144" Jul 30 17:12:18.892609 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.892577 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h"] Jul 30 17:12:18.894489 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.894473 2570 scope.go:117] "RemoveContainer" containerID="d65fd95307470c54067aeb67fb5dc7da9565c7386b422b2a8376e1fd07e4a9d2" Jul 30 17:12:18.898136 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.898110 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84b858ffdc-k6z5h"] Jul 30 17:12:18.902887 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.902868 2570 scope.go:117] "RemoveContainer" containerID="55f4b8b3bdae4fa0765d6fde55190cbc6f65c2cabbd74af3d4d0a2f090181657" Jul 30 17:12:18.911252 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.911232 2570 scope.go:117] "RemoveContainer" containerID="bd60908b52b1c051c867dfdf14934639baf6dd03cab941983cbbbab401b05144" Jul 30 17:12:18.911615 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:12:18.911597 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd60908b52b1c051c867dfdf14934639baf6dd03cab941983cbbbab401b05144\": container with ID starting with bd60908b52b1c051c867dfdf14934639baf6dd03cab941983cbbbab401b05144 not found: ID does not exist" containerID="bd60908b52b1c051c867dfdf14934639baf6dd03cab941983cbbbab401b05144" Jul 30 17:12:18.911716 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.911627 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd60908b52b1c051c867dfdf14934639baf6dd03cab941983cbbbab401b05144"} err="failed to get container status \"bd60908b52b1c051c867dfdf14934639baf6dd03cab941983cbbbab401b05144\": rpc error: code = NotFound desc = could not find container \"bd60908b52b1c051c867dfdf14934639baf6dd03cab941983cbbbab401b05144\": container with ID starting with bd60908b52b1c051c867dfdf14934639baf6dd03cab941983cbbbab401b05144 not found: ID does not exist" Jul 30 17:12:18.911716 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.911651 2570 scope.go:117] "RemoveContainer" containerID="d65fd95307470c54067aeb67fb5dc7da9565c7386b422b2a8376e1fd07e4a9d2" Jul 30 17:12:18.911910 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:12:18.911889 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d65fd95307470c54067aeb67fb5dc7da9565c7386b422b2a8376e1fd07e4a9d2\": container with ID starting with d65fd95307470c54067aeb67fb5dc7da9565c7386b422b2a8376e1fd07e4a9d2 not found: ID does not exist" containerID="d65fd95307470c54067aeb67fb5dc7da9565c7386b422b2a8376e1fd07e4a9d2" Jul 30 17:12:18.911946 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.911916 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d65fd95307470c54067aeb67fb5dc7da9565c7386b422b2a8376e1fd07e4a9d2"} err="failed to get container status \"d65fd95307470c54067aeb67fb5dc7da9565c7386b422b2a8376e1fd07e4a9d2\": rpc error: code = NotFound desc = could not find container \"d65fd95307470c54067aeb67fb5dc7da9565c7386b422b2a8376e1fd07e4a9d2\": container with ID starting with d65fd95307470c54067aeb67fb5dc7da9565c7386b422b2a8376e1fd07e4a9d2 not found: ID does not exist" Jul 30 17:12:18.911946 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.911932 2570 scope.go:117] "RemoveContainer" containerID="55f4b8b3bdae4fa0765d6fde55190cbc6f65c2cabbd74af3d4d0a2f090181657" Jul 30 17:12:18.912194 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:12:18.912170 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55f4b8b3bdae4fa0765d6fde55190cbc6f65c2cabbd74af3d4d0a2f090181657\": container with ID starting with 55f4b8b3bdae4fa0765d6fde55190cbc6f65c2cabbd74af3d4d0a2f090181657 not found: ID does not exist" containerID="55f4b8b3bdae4fa0765d6fde55190cbc6f65c2cabbd74af3d4d0a2f090181657" Jul 30 17:12:18.912238 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:18.912202 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55f4b8b3bdae4fa0765d6fde55190cbc6f65c2cabbd74af3d4d0a2f090181657"} err="failed to get container status \"55f4b8b3bdae4fa0765d6fde55190cbc6f65c2cabbd74af3d4d0a2f090181657\": rpc error: code = NotFound desc = could not find container \"55f4b8b3bdae4fa0765d6fde55190cbc6f65c2cabbd74af3d4d0a2f090181657\": container with ID starting with 55f4b8b3bdae4fa0765d6fde55190cbc6f65c2cabbd74af3d4d0a2f090181657 not found: ID does not exist" Jul 30 17:12:20.463863 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:20.463831 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1b5f49e-4675-4553-b153-1a95c49dfd0b" path="/var/lib/kubelet/pods/a1b5f49e-4675-4553-b153-1a95c49dfd0b/volumes" Jul 30 17:12:20.464334 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:12:20.464314 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4cadd76-b1e3-445b-bfff-2d3bdd9602f2" path="/var/lib/kubelet/pods/b4cadd76-b1e3-445b-bfff-2d3bdd9602f2/volumes" Jul 30 17:13:12.990272 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:13:12.990230 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:13:13.222712 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:13:13.222679 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:13:35.332422 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:13:35.332386 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:13:53.134897 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:13:53.134861 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:13:53.191174 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:13:53.191146 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:14:08.276891 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:14:08.276856 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:15:54.355671 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:15:54.355580 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/ovn-acl-logging/0.log" Jul 30 17:15:54.356177 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:15:54.356009 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/ovn-acl-logging/0.log" Jul 30 17:19:30.297342 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:19:30.297266 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:20:31.568220 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:20:31.568134 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:20:31.710952 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:20:31.710911 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:20:31.773149 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:20:31.773112 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:20:31.877737 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:20:31.877639 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:20:31.975102 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:20:31.975053 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:20:32.094084 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:20:32.094049 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:20:54.383325 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:20:54.383291 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/ovn-acl-logging/0.log" Jul 30 17:20:54.384750 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:20:54.384721 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/ovn-acl-logging/0.log" Jul 30 17:21:27.642234 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:21:27.642197 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:21:27.750847 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:21:27.750806 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:21:27.834481 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:21:27.834442 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:21:27.901430 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:21:27.901344 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:21:27.966656 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:21:27.966619 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:21:28.105329 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:21:28.105300 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:21:31.793613 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:21:31.793523 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:21:32.054872 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:21:32.054753 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:21:41.903866 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:21:41.903816 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:21:42.014431 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:21:42.014394 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:21:42.116926 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:21:42.116892 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:21:42.215565 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:21:42.215525 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:21:42.314258 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:21:42.314213 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:21:42.755165 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:21:42.755131 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:21:52.291987 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:21:52.291898 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:22:27.851374 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:22:27.851340 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:22:28.062844 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:22:28.062804 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:22:37.945140 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:22:37.945109 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:22:38.057835 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:22:38.057746 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:22:38.150641 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:22:38.150607 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:22:38.213396 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:22:38.213303 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:22:38.311977 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:22:38.311947 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:22:38.412539 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:22:38.412501 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:22:42.111264 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:22:42.111229 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:22:42.259434 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:22:42.259396 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:23:38.179156 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:23:38.179118 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:23:38.425938 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:23:38.425905 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:25:16.656175 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:25:16.656098 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:25:54.411056 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:25:54.411029 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/ovn-acl-logging/0.log" Jul 30 17:25:54.412701 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:25:54.412681 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/ovn-acl-logging/0.log" Jul 30 17:28:38.759621 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:28:38.759590 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:29:43.884011 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:29:43.883977 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:30:54.438155 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:30:54.438125 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/ovn-acl-logging/0.log" Jul 30 17:30:54.440815 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:30:54.440794 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/ovn-acl-logging/0.log" Jul 30 17:30:56.854788 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:30:56.854757 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:30:58.151662 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:30:58.151623 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:31:52.944501 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:31:52.944465 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:31:53.058739 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:31:53.058701 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:31:53.134639 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:31:53.134603 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:31:53.202222 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:31:53.202131 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:31:53.297156 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:31:53.297120 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:31:53.407519 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:31:53.407487 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:31:57.101431 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:31:57.101393 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:31:57.318742 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:31:57.318702 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:32:07.221986 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:32:07.221949 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:32:07.309340 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:32:07.309305 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:32:07.397023 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:32:07.396992 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:32:07.472323 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:32:07.472243 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:32:07.664813 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:32:07.664773 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:32:07.770866 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:32:07.770774 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:32:53.204385 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:32:53.204346 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:32:53.403043 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:32:53.403007 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:33:07.507729 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:33:07.507687 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:33:07.755148 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:33:07.755098 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:34:08.912470 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:34:08.912435 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:34:08.967422 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:34:08.967389 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:35:02.972572 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:35:02.972518 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:35:54.472476 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:35:54.472448 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/ovn-acl-logging/0.log" Jul 30 17:35:54.477598 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:35:54.477580 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/ovn-acl-logging/0.log" Jul 30 17:37:01.285321 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:37:01.285235 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:40:35.209638 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:40:35.209608 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:40:54.507117 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:40:54.507087 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/ovn-acl-logging/0.log" Jul 30 17:40:54.513961 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:40:54.513940 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/ovn-acl-logging/0.log" Jul 30 17:41:22.177882 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:41:22.177803 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:41:22.303240 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:41:22.303212 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:41:22.362010 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:41:22.361967 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:43:44.630366 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:43:44.630333 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:45:54.541533 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:45:54.541466 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/ovn-acl-logging/0.log" Jul 30 17:45:54.547614 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:45:54.547596 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/ovn-acl-logging/0.log" Jul 30 17:47:03.471499 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:47:03.471469 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:49:12.529428 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:12.529345 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:49:13.546728 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.546691 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-v8rf5/must-gather-r8kcm"] Jul 30 17:49:13.547116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.547057 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1b5f49e-4675-4553-b153-1a95c49dfd0b" containerName="kserve-container" Jul 30 17:49:13.547116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.547068 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1b5f49e-4675-4553-b153-1a95c49dfd0b" containerName="kserve-container" Jul 30 17:49:13.547116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.547081 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1b5f49e-4675-4553-b153-1a95c49dfd0b" containerName="storage-initializer" Jul 30 17:49:13.547116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.547086 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1b5f49e-4675-4553-b153-1a95c49dfd0b" containerName="storage-initializer" Jul 30 17:49:13.547116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.547096 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4365cd6-449a-444a-9694-5a733e194980" containerName="storage-initializer" Jul 30 17:49:13.547116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.547102 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4365cd6-449a-444a-9694-5a733e194980" containerName="storage-initializer" Jul 30 17:49:13.547116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.547110 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4cadd76-b1e3-445b-bfff-2d3bdd9602f2" containerName="kserve-container" Jul 30 17:49:13.547116 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.547117 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4cadd76-b1e3-445b-bfff-2d3bdd9602f2" containerName="kserve-container" Jul 30 17:49:13.547394 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.547123 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4365cd6-449a-444a-9694-5a733e194980" containerName="kube-rbac-proxy" Jul 30 17:49:13.547394 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.547129 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4365cd6-449a-444a-9694-5a733e194980" containerName="kube-rbac-proxy" Jul 30 17:49:13.547394 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.547137 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4cadd76-b1e3-445b-bfff-2d3bdd9602f2" containerName="kube-rbac-proxy" Jul 30 17:49:13.547394 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.547142 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4cadd76-b1e3-445b-bfff-2d3bdd9602f2" containerName="kube-rbac-proxy" Jul 30 17:49:13.547394 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.547150 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1b5f49e-4675-4553-b153-1a95c49dfd0b" containerName="kube-rbac-proxy" Jul 30 17:49:13.547394 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.547155 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1b5f49e-4675-4553-b153-1a95c49dfd0b" containerName="kube-rbac-proxy" Jul 30 17:49:13.547394 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.547164 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4cadd76-b1e3-445b-bfff-2d3bdd9602f2" containerName="storage-initializer" Jul 30 17:49:13.547394 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.547169 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4cadd76-b1e3-445b-bfff-2d3bdd9602f2" containerName="storage-initializer" Jul 30 17:49:13.547394 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.547181 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4365cd6-449a-444a-9694-5a733e194980" containerName="kserve-container" Jul 30 17:49:13.547394 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.547186 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4365cd6-449a-444a-9694-5a733e194980" containerName="kserve-container" Jul 30 17:49:13.547394 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.547243 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4365cd6-449a-444a-9694-5a733e194980" containerName="kserve-container" Jul 30 17:49:13.547394 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.547250 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4cadd76-b1e3-445b-bfff-2d3bdd9602f2" containerName="kserve-container" Jul 30 17:49:13.547394 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.547257 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4365cd6-449a-444a-9694-5a733e194980" containerName="kube-rbac-proxy" Jul 30 17:49:13.547394 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.547264 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1b5f49e-4675-4553-b153-1a95c49dfd0b" containerName="kserve-container" Jul 30 17:49:13.547394 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.547271 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1b5f49e-4675-4553-b153-1a95c49dfd0b" containerName="kube-rbac-proxy" Jul 30 17:49:13.547394 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.547276 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4cadd76-b1e3-445b-bfff-2d3bdd9602f2" containerName="kube-rbac-proxy" Jul 30 17:49:13.550228 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.550213 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v8rf5/must-gather-r8kcm" Jul 30 17:49:13.553022 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.552998 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v8rf5\"/\"openshift-service-ca.crt\"" Jul 30 17:49:13.553160 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.553039 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v8rf5\"/\"kube-root-ca.crt\"" Jul 30 17:49:13.553160 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.553059 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-v8rf5\"/\"default-dockercfg-hjrg8\"" Jul 30 17:49:13.560728 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.560707 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v8rf5/must-gather-r8kcm"] Jul 30 17:49:13.660034 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.659995 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78-must-gather-output\") pod \"must-gather-r8kcm\" (UID: \"1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78\") " pod="openshift-must-gather-v8rf5/must-gather-r8kcm" Jul 30 17:49:13.660222 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.660068 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvm9j\" (UniqueName: \"kubernetes.io/projected/1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78-kube-api-access-tvm9j\") pod \"must-gather-r8kcm\" (UID: \"1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78\") " pod="openshift-must-gather-v8rf5/must-gather-r8kcm" Jul 30 17:49:13.687155 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.687121 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:49:13.760643 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.760612 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78-must-gather-output\") pod \"must-gather-r8kcm\" (UID: \"1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78\") " pod="openshift-must-gather-v8rf5/must-gather-r8kcm" Jul 30 17:49:13.760819 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.760671 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvm9j\" (UniqueName: \"kubernetes.io/projected/1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78-kube-api-access-tvm9j\") pod \"must-gather-r8kcm\" (UID: \"1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78\") " pod="openshift-must-gather-v8rf5/must-gather-r8kcm" Jul 30 17:49:13.760975 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.760955 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78-must-gather-output\") pod \"must-gather-r8kcm\" (UID: \"1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78\") " pod="openshift-must-gather-v8rf5/must-gather-r8kcm" Jul 30 17:49:13.770403 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.770371 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvm9j\" (UniqueName: \"kubernetes.io/projected/1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78-kube-api-access-tvm9j\") pod \"must-gather-r8kcm\" (UID: \"1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78\") " pod="openshift-must-gather-v8rf5/must-gather-r8kcm" Jul 30 17:49:13.874032 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:13.873955 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v8rf5/must-gather-r8kcm" Jul 30 17:49:14.001602 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:14.001572 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v8rf5/must-gather-r8kcm"] Jul 30 17:49:14.004983 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:49:14.004952 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c61a53c_441e_4bf6_8f16_d5a9e5f2fa78.slice/crio-f5352d61863d14e7e499243208c1ff34fa77ce1c1af547f8cfca9f0205b16ef6 WatchSource:0}: Error finding container f5352d61863d14e7e499243208c1ff34fa77ce1c1af547f8cfca9f0205b16ef6: Status 404 returned error can't find the container with id f5352d61863d14e7e499243208c1ff34fa77ce1c1af547f8cfca9f0205b16ef6 Jul 30 17:49:14.006737 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:14.006720 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 30 17:49:14.110340 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:14.110302 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v8rf5/must-gather-r8kcm" event={"ID":"1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78","Type":"ContainerStarted","Data":"f5352d61863d14e7e499243208c1ff34fa77ce1c1af547f8cfca9f0205b16ef6"} Jul 30 17:49:21.156436 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:21.156400 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v8rf5/must-gather-r8kcm" event={"ID":"1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78","Type":"ContainerStarted","Data":"4a42179dbe52bd8dd9956d168f21369dd0034eb09100b0a44feb3e19079b01aa"} Jul 30 17:49:21.156436 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:21.156443 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v8rf5/must-gather-r8kcm" event={"ID":"1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78","Type":"ContainerStarted","Data":"971dc07900946f939f7664936f8c0e1813548c2ec843c2e2a2a764f374128eeb"} Jul 30 17:49:21.175753 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:21.175694 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-v8rf5/must-gather-r8kcm" podStartSLOduration=2.011457526 podStartE2EDuration="8.175671715s" totalImagesPullingTime="6.164214189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:49:21.173375307 +0000 UTC m=+2907.306222257" watchObservedRunningTime="2026-07-30 17:49:21.175671715 +0000 UTC m=+2907.308518673" Jul 30 17:49:44.261368 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:44.261330 2570 generic.go:356] "Generic (PLEG): container finished" podID="1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78" containerID="971dc07900946f939f7664936f8c0e1813548c2ec843c2e2a2a764f374128eeb" exitCode=0 Jul 30 17:49:44.261907 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:44.261389 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v8rf5/must-gather-r8kcm" event={"ID":"1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78","Type":"ContainerDied","Data":"971dc07900946f939f7664936f8c0e1813548c2ec843c2e2a2a764f374128eeb"} Jul 30 17:49:44.261907 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:44.261793 2570 scope.go:117] "RemoveContainer" containerID="971dc07900946f939f7664936f8c0e1813548c2ec843c2e2a2a764f374128eeb" Jul 30 17:49:44.293682 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:44.293654 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-v8rf5_must-gather-r8kcm_1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78/gather/0.log" Jul 30 17:49:44.782139 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:44.782110 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:49:44.941543 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:44.941506 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-45p7p/must-gather-zjb6b"] Jul 30 17:49:44.944174 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:44.944159 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-45p7p/must-gather-zjb6b" Jul 30 17:49:44.953487 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:44.953470 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-45p7p\"/\"default-dockercfg-lhkfc\"" Jul 30 17:49:44.953921 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:44.953906 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-45p7p\"/\"openshift-service-ca.crt\"" Jul 30 17:49:44.953995 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:44.953980 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-45p7p\"/\"kube-root-ca.crt\"" Jul 30 17:49:44.958740 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:44.958718 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-45p7p/must-gather-zjb6b"] Jul 30 17:49:44.978198 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:44.978173 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:49:45.040727 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:45.040649 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzdkt\" (UniqueName: \"kubernetes.io/projected/fbf9b4ed-eade-4fea-aa5f-e5489a235611-kube-api-access-xzdkt\") pod \"must-gather-zjb6b\" (UID: \"fbf9b4ed-eade-4fea-aa5f-e5489a235611\") " pod="openshift-must-gather-45p7p/must-gather-zjb6b" Jul 30 17:49:45.040727 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:45.040710 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fbf9b4ed-eade-4fea-aa5f-e5489a235611-must-gather-output\") pod \"must-gather-zjb6b\" (UID: \"fbf9b4ed-eade-4fea-aa5f-e5489a235611\") " pod="openshift-must-gather-45p7p/must-gather-zjb6b" Jul 30 17:49:45.078747 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:45.078718 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:49:45.141717 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:45.141689 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzdkt\" (UniqueName: \"kubernetes.io/projected/fbf9b4ed-eade-4fea-aa5f-e5489a235611-kube-api-access-xzdkt\") pod \"must-gather-zjb6b\" (UID: \"fbf9b4ed-eade-4fea-aa5f-e5489a235611\") " pod="openshift-must-gather-45p7p/must-gather-zjb6b" Jul 30 17:49:45.141882 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:45.141757 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fbf9b4ed-eade-4fea-aa5f-e5489a235611-must-gather-output\") pod \"must-gather-zjb6b\" (UID: \"fbf9b4ed-eade-4fea-aa5f-e5489a235611\") " pod="openshift-must-gather-45p7p/must-gather-zjb6b" Jul 30 17:49:45.142082 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:45.142061 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fbf9b4ed-eade-4fea-aa5f-e5489a235611-must-gather-output\") pod \"must-gather-zjb6b\" (UID: \"fbf9b4ed-eade-4fea-aa5f-e5489a235611\") " pod="openshift-must-gather-45p7p/must-gather-zjb6b" Jul 30 17:49:45.150562 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:45.150533 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzdkt\" (UniqueName: \"kubernetes.io/projected/fbf9b4ed-eade-4fea-aa5f-e5489a235611-kube-api-access-xzdkt\") pod \"must-gather-zjb6b\" (UID: \"fbf9b4ed-eade-4fea-aa5f-e5489a235611\") " pod="openshift-must-gather-45p7p/must-gather-zjb6b" Jul 30 17:49:45.252773 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:45.252737 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-45p7p/must-gather-zjb6b" Jul 30 17:49:45.382890 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:45.382858 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-45p7p/must-gather-zjb6b"] Jul 30 17:49:45.386162 ip-10-0-136-120 kubenswrapper[2570]: W0730 17:49:45.386134 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfbf9b4ed_eade_4fea_aa5f_e5489a235611.slice/crio-e310dba46453ada9844f4bbc0801bb01cc7d635821f448636433c1bf3091fe29 WatchSource:0}: Error finding container e310dba46453ada9844f4bbc0801bb01cc7d635821f448636433c1bf3091fe29: Status 404 returned error can't find the container with id e310dba46453ada9844f4bbc0801bb01cc7d635821f448636433c1bf3091fe29 Jul 30 17:49:46.282712 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:46.282673 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-45p7p/must-gather-zjb6b" event={"ID":"fbf9b4ed-eade-4fea-aa5f-e5489a235611","Type":"ContainerStarted","Data":"e310dba46453ada9844f4bbc0801bb01cc7d635821f448636433c1bf3091fe29"} Jul 30 17:49:47.291240 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:47.291196 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-45p7p/must-gather-zjb6b" event={"ID":"fbf9b4ed-eade-4fea-aa5f-e5489a235611","Type":"ContainerStarted","Data":"bb202d6a4d5e4396097521bd00093d66efffb66a8cff11f3f26490c8c1738111"} Jul 30 17:49:47.291718 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:47.291255 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-45p7p/must-gather-zjb6b" event={"ID":"fbf9b4ed-eade-4fea-aa5f-e5489a235611","Type":"ContainerStarted","Data":"1e62e5153e59c592301bacd18df9f43ff26c4ef49fecadc7ea9e9d0d461721ae"} Jul 30 17:49:47.310519 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:47.310453 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-45p7p/must-gather-zjb6b" podStartSLOduration=2.354830551 podStartE2EDuration="3.310432404s" totalImagesPullingTime="955.601853ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:49:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:49:47.309335143 +0000 UTC m=+2933.442182101" watchObservedRunningTime="2026-07-30 17:49:47.310432404 +0000 UTC m=+2933.443279361" Jul 30 17:49:47.787937 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:47.787909 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jhw42_681ff1ad-fa48-420e-9501-d18e7a57a773/global-pull-secret-syncer/0.log" Jul 30 17:49:47.920705 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:47.920677 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" Jul 30 17:49:48.043036 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:48.042960 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-120.ec2.internal_3492ed6927be9f82b217829acc311662/haproxy/0.log" Jul 30 17:49:49.768090 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:49.768041 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-v8rf5/must-gather-r8kcm"] Jul 30 17:49:49.768651 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:49.768388 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-v8rf5/must-gather-r8kcm" podUID="1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78" containerName="copy" containerID="cri-o://4a42179dbe52bd8dd9956d168f21369dd0034eb09100b0a44feb3e19079b01aa" gracePeriod=2 Jul 30 17:49:49.774497 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:49:49.774218 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-r8kcm\" is forbidden: User \"system:node:ip-10-0-136-120.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-v8rf5\": no relationship found between node 'ip-10-0-136-120.ec2.internal' and this object" podUID="1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78" pod="openshift-must-gather-v8rf5/must-gather-r8kcm" Jul 30 17:49:49.775120 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:49.775096 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-v8rf5/must-gather-r8kcm"] Jul 30 17:49:50.158785 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:50.158727 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-v8rf5_must-gather-r8kcm_1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78/copy/0.log" Jul 30 17:49:50.160838 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:50.160815 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v8rf5/must-gather-r8kcm" Jul 30 17:49:50.163078 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:49:50.163028 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-r8kcm\" is forbidden: User \"system:node:ip-10-0-136-120.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-v8rf5\": no relationship found between node 'ip-10-0-136-120.ec2.internal' and this object" podUID="1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78" pod="openshift-must-gather-v8rf5/must-gather-r8kcm" Jul 30 17:49:50.298979 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:50.298933 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78-must-gather-output\") pod \"1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78\" (UID: \"1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78\") " Jul 30 17:49:50.299172 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:50.298985 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvm9j\" (UniqueName: \"kubernetes.io/projected/1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78-kube-api-access-tvm9j\") pod \"1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78\" (UID: \"1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78\") " Jul 30 17:49:50.301266 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:50.301230 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78" (UID: "1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 17:49:50.302627 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:50.302605 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78-kube-api-access-tvm9j" (OuterVolumeSpecName: "kube-api-access-tvm9j") pod "1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78" (UID: "1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78"). InnerVolumeSpecName "kube-api-access-tvm9j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 17:49:50.313857 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:50.313790 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-v8rf5_must-gather-r8kcm_1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78/copy/0.log" Jul 30 17:49:50.314543 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:50.314468 2570 generic.go:356] "Generic (PLEG): container finished" podID="1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78" containerID="4a42179dbe52bd8dd9956d168f21369dd0034eb09100b0a44feb3e19079b01aa" exitCode=143 Jul 30 17:49:50.314766 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:50.314714 2570 scope.go:117] "RemoveContainer" containerID="4a42179dbe52bd8dd9956d168f21369dd0034eb09100b0a44feb3e19079b01aa" Jul 30 17:49:50.315091 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:50.315031 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v8rf5/must-gather-r8kcm" Jul 30 17:49:50.321908 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:49:50.321877 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-r8kcm\" is forbidden: User \"system:node:ip-10-0-136-120.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-v8rf5\": no relationship found between node 'ip-10-0-136-120.ec2.internal' and this object" podUID="1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78" pod="openshift-must-gather-v8rf5/must-gather-r8kcm" Jul 30 17:49:50.337007 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:49:50.336976 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-r8kcm\" is forbidden: User \"system:node:ip-10-0-136-120.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-v8rf5\": no relationship found between node 'ip-10-0-136-120.ec2.internal' and this object" podUID="1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78" pod="openshift-must-gather-v8rf5/must-gather-r8kcm" Jul 30 17:49:50.357481 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:50.349727 2570 scope.go:117] "RemoveContainer" containerID="971dc07900946f939f7664936f8c0e1813548c2ec843c2e2a2a764f374128eeb" Jul 30 17:49:50.385448 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:50.385416 2570 scope.go:117] "RemoveContainer" containerID="4a42179dbe52bd8dd9956d168f21369dd0034eb09100b0a44feb3e19079b01aa" Jul 30 17:49:50.385891 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:49:50.385862 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a42179dbe52bd8dd9956d168f21369dd0034eb09100b0a44feb3e19079b01aa\": container with ID starting with 4a42179dbe52bd8dd9956d168f21369dd0034eb09100b0a44feb3e19079b01aa not found: ID does not exist" containerID="4a42179dbe52bd8dd9956d168f21369dd0034eb09100b0a44feb3e19079b01aa" Jul 30 17:49:50.386002 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:50.385917 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a42179dbe52bd8dd9956d168f21369dd0034eb09100b0a44feb3e19079b01aa"} err="failed to get container status \"4a42179dbe52bd8dd9956d168f21369dd0034eb09100b0a44feb3e19079b01aa\": rpc error: code = NotFound desc = could not find container \"4a42179dbe52bd8dd9956d168f21369dd0034eb09100b0a44feb3e19079b01aa\": container with ID starting with 4a42179dbe52bd8dd9956d168f21369dd0034eb09100b0a44feb3e19079b01aa not found: ID does not exist" Jul 30 17:49:50.386002 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:50.385945 2570 scope.go:117] "RemoveContainer" containerID="971dc07900946f939f7664936f8c0e1813548c2ec843c2e2a2a764f374128eeb" Jul 30 17:49:50.386261 ip-10-0-136-120 kubenswrapper[2570]: E0730 17:49:50.386236 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"971dc07900946f939f7664936f8c0e1813548c2ec843c2e2a2a764f374128eeb\": container with ID starting with 971dc07900946f939f7664936f8c0e1813548c2ec843c2e2a2a764f374128eeb not found: ID does not exist" containerID="971dc07900946f939f7664936f8c0e1813548c2ec843c2e2a2a764f374128eeb" Jul 30 17:49:50.386354 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:50.386276 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"971dc07900946f939f7664936f8c0e1813548c2ec843c2e2a2a764f374128eeb"} err="failed to get container status \"971dc07900946f939f7664936f8c0e1813548c2ec843c2e2a2a764f374128eeb\": rpc error: code = NotFound desc = could not find container \"971dc07900946f939f7664936f8c0e1813548c2ec843c2e2a2a764f374128eeb\": container with ID starting with 971dc07900946f939f7664936f8c0e1813548c2ec843c2e2a2a764f374128eeb not found: ID does not exist" Jul 30 17:49:50.400997 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:50.400960 2570 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78-must-gather-output\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:49:50.400997 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:50.400998 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvm9j\" (UniqueName: \"kubernetes.io/projected/1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78-kube-api-access-tvm9j\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 30 17:49:50.427123 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:50.427087 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:49:50.467261 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:50.467222 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78" path="/var/lib/kubelet/pods/1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78/volumes" Jul 30 17:49:50.501621 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:50.501588 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wvmx2_c29dde6b-4cd2-45b3-8c4c-ec991ed5adb3/konnectivity-agent/0.log" limit=1024 Jul 30 17:49:51.901990 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:51.901801 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3417e546-c418-4b4d-b14f-80271a46cf6a/alertmanager/0.log" Jul 30 17:49:51.954402 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:51.954352 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3417e546-c418-4b4d-b14f-80271a46cf6a/config-reloader/0.log" Jul 30 17:49:51.992304 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:51.992221 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3417e546-c418-4b4d-b14f-80271a46cf6a/kube-rbac-proxy-web/0.log" Jul 30 17:49:52.035356 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:52.035281 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3417e546-c418-4b4d-b14f-80271a46cf6a/kube-rbac-proxy/0.log" Jul 30 17:49:52.087532 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:52.087506 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3417e546-c418-4b4d-b14f-80271a46cf6a/kube-rbac-proxy-metric/0.log" Jul 30 17:49:52.126824 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:52.126796 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3417e546-c418-4b4d-b14f-80271a46cf6a/prom-label-proxy/0.log" Jul 30 17:49:52.158043 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:52.157957 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3417e546-c418-4b4d-b14f-80271a46cf6a/init-config-reloader/0.log" Jul 30 17:49:52.248330 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:52.248278 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-c9bw7_b64c71e9-273c-41c0-abba-77b6cc09aaaa/kube-state-metrics/0.log" Jul 30 17:49:52.275841 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:52.275813 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-c9bw7_b64c71e9-273c-41c0-abba-77b6cc09aaaa/kube-rbac-proxy-main/0.log" Jul 30 17:49:52.319783 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:52.319740 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-c9bw7_b64c71e9-273c-41c0-abba-77b6cc09aaaa/kube-rbac-proxy-self/0.log" Jul 30 17:49:52.358095 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:52.358059 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7cd864494-k4wmt_8faff120-a679-4343-96dd-92e15fd012ac/metrics-server/0.log" Jul 30 17:49:52.390518 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:52.390483 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-vgpzd_17e68429-66e4-4fa4-82c8-489bcf812165/monitoring-plugin/0.log" Jul 30 17:49:52.617625 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:52.617586 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wkkz5_010f3382-7f6e-4077-8123-783989ce2bb7/node-exporter/0.log" Jul 30 17:49:52.643042 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:52.643011 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wkkz5_010f3382-7f6e-4077-8123-783989ce2bb7/kube-rbac-proxy/0.log" Jul 30 17:49:52.670245 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:52.669999 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wkkz5_010f3382-7f6e-4077-8123-783989ce2bb7/init-textfile/0.log" Jul 30 17:49:52.701948 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:52.701914 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-bddfd_ded37f1c-e05e-4b86-ba0f-e534666e7809/kube-rbac-proxy-main/0.log" Jul 30 17:49:52.728717 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:52.728685 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-bddfd_ded37f1c-e05e-4b86-ba0f-e534666e7809/kube-rbac-proxy-self/0.log" Jul 30 17:49:52.753071 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:52.753040 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-bddfd_ded37f1c-e05e-4b86-ba0f-e534666e7809/openshift-state-metrics/0.log" Jul 30 17:49:52.796533 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:52.796499 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8a3178ef-1487-40c8-92e6-d02db9782851/prometheus/0.log" Jul 30 17:49:52.824745 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:52.824714 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8a3178ef-1487-40c8-92e6-d02db9782851/config-reloader/0.log" Jul 30 17:49:52.857849 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:52.857820 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8a3178ef-1487-40c8-92e6-d02db9782851/thanos-sidecar/0.log" Jul 30 17:49:52.892495 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:52.892425 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8a3178ef-1487-40c8-92e6-d02db9782851/kube-rbac-proxy-web/0.log" Jul 30 17:49:52.942744 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:52.942700 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8a3178ef-1487-40c8-92e6-d02db9782851/kube-rbac-proxy/0.log" Jul 30 17:49:53.018978 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:53.018932 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8a3178ef-1487-40c8-92e6-d02db9782851/kube-rbac-proxy-thanos/0.log" Jul 30 17:49:53.058816 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:53.058787 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8a3178ef-1487-40c8-92e6-d02db9782851/init-config-reloader/0.log" Jul 30 17:49:53.100979 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:53.100932 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-p8cg5_b03a0311-edc6-4935-86c6-70d02a37d27c/prometheus-operator/0.log" Jul 30 17:49:53.125700 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:53.125676 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-p8cg5_b03a0311-edc6-4935-86c6-70d02a37d27c/kube-rbac-proxy/0.log" Jul 30 17:49:53.155068 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:53.154986 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-pzpn6_7a164ac8-9291-4a03-9a80-2f325fde4954/prometheus-operator-admission-webhook/0.log" Jul 30 17:49:53.187101 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:53.187066 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cd4499d55-d4mv2_a5f11093-0de0-48a4-a981-f63982607e72/telemeter-client/0.log" Jul 30 17:49:53.214859 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:53.214824 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cd4499d55-d4mv2_a5f11093-0de0-48a4-a981-f63982607e72/reload/0.log" Jul 30 17:49:53.241596 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:53.241540 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cd4499d55-d4mv2_a5f11093-0de0-48a4-a981-f63982607e72/kube-rbac-proxy/0.log" Jul 30 17:49:53.286982 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:53.286954 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cbc9d5bb8-9wxz7_667c2a81-0d30-431d-8799-dfba176558ab/thanos-query/0.log" Jul 30 17:49:53.311043 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:53.311014 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cbc9d5bb8-9wxz7_667c2a81-0d30-431d-8799-dfba176558ab/kube-rbac-proxy-web/0.log" Jul 30 17:49:53.334585 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:53.334532 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cbc9d5bb8-9wxz7_667c2a81-0d30-431d-8799-dfba176558ab/kube-rbac-proxy/0.log" Jul 30 17:49:53.358400 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:53.358372 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cbc9d5bb8-9wxz7_667c2a81-0d30-431d-8799-dfba176558ab/prom-label-proxy/0.log" Jul 30 17:49:53.382625 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:53.382592 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cbc9d5bb8-9wxz7_667c2a81-0d30-431d-8799-dfba176558ab/kube-rbac-proxy-rules/0.log" Jul 30 17:49:53.411237 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:53.411160 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cbc9d5bb8-9wxz7_667c2a81-0d30-431d-8799-dfba176558ab/kube-rbac-proxy-metrics/0.log" Jul 30 17:49:55.741394 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:55.741370 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6859f9ccc5-7pg82_c39eb557-f004-4de2-b7dd-3bcf7957c18d/console/0.log" Jul 30 17:49:55.776598 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:55.776568 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-6t9lf_eff18f41-6541-4186-aba6-26e3505c3613/download-server/0.log" Jul 30 17:49:56.271262 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:56.271219 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-45p7p/perf-node-gather-daemonset-r4qkh"] Jul 30 17:49:56.272122 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:56.272095 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78" containerName="gather" Jul 30 17:49:56.272299 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:56.272284 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78" containerName="gather" Jul 30 17:49:56.272413 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:56.272401 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78" containerName="copy" Jul 30 17:49:56.272495 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:56.272486 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78" containerName="copy" Jul 30 17:49:56.272710 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:56.272694 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78" containerName="copy" Jul 30 17:49:56.272818 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:56.272807 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c61a53c-441e-4bf6-8f16-d5a9e5f2fa78" containerName="gather" Jul 30 17:49:56.278379 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:56.278356 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-r4qkh" Jul 30 17:49:56.287762 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:56.287734 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-45p7p/perf-node-gather-daemonset-r4qkh"] Jul 30 17:49:56.366333 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:56.366299 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7171a2db-33c5-4d22-b9ff-a91d4d71e1d7-sys\") pod \"perf-node-gather-daemonset-r4qkh\" (UID: \"7171a2db-33c5-4d22-b9ff-a91d4d71e1d7\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-r4qkh" Jul 30 17:49:56.366536 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:56.366406 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7171a2db-33c5-4d22-b9ff-a91d4d71e1d7-podres\") pod \"perf-node-gather-daemonset-r4qkh\" (UID: \"7171a2db-33c5-4d22-b9ff-a91d4d71e1d7\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-r4qkh" Jul 30 17:49:56.366536 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:56.366441 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7171a2db-33c5-4d22-b9ff-a91d4d71e1d7-proc\") pod \"perf-node-gather-daemonset-r4qkh\" (UID: \"7171a2db-33c5-4d22-b9ff-a91d4d71e1d7\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-r4qkh" Jul 30 17:49:56.366536 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:56.366473 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9ldf\" (UniqueName: \"kubernetes.io/projected/7171a2db-33c5-4d22-b9ff-a91d4d71e1d7-kube-api-access-z9ldf\") pod \"perf-node-gather-daemonset-r4qkh\" (UID: \"7171a2db-33c5-4d22-b9ff-a91d4d71e1d7\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-r4qkh" Jul 30 17:49:56.366714 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:56.366543 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7171a2db-33c5-4d22-b9ff-a91d4d71e1d7-lib-modules\") pod \"perf-node-gather-daemonset-r4qkh\" (UID: \"7171a2db-33c5-4d22-b9ff-a91d4d71e1d7\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-r4qkh" Jul 30 17:49:56.467134 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:56.467090 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7171a2db-33c5-4d22-b9ff-a91d4d71e1d7-lib-modules\") pod \"perf-node-gather-daemonset-r4qkh\" (UID: \"7171a2db-33c5-4d22-b9ff-a91d4d71e1d7\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-r4qkh" Jul 30 17:49:56.467322 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:56.467162 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7171a2db-33c5-4d22-b9ff-a91d4d71e1d7-sys\") pod \"perf-node-gather-daemonset-r4qkh\" (UID: \"7171a2db-33c5-4d22-b9ff-a91d4d71e1d7\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-r4qkh" Jul 30 17:49:56.467322 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:56.467262 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7171a2db-33c5-4d22-b9ff-a91d4d71e1d7-podres\") pod \"perf-node-gather-daemonset-r4qkh\" (UID: \"7171a2db-33c5-4d22-b9ff-a91d4d71e1d7\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-r4qkh" Jul 30 17:49:56.467322 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:56.467268 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7171a2db-33c5-4d22-b9ff-a91d4d71e1d7-lib-modules\") pod \"perf-node-gather-daemonset-r4qkh\" (UID: \"7171a2db-33c5-4d22-b9ff-a91d4d71e1d7\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-r4qkh" Jul 30 17:49:56.467322 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:56.467284 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7171a2db-33c5-4d22-b9ff-a91d4d71e1d7-sys\") pod \"perf-node-gather-daemonset-r4qkh\" (UID: \"7171a2db-33c5-4d22-b9ff-a91d4d71e1d7\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-r4qkh" Jul 30 17:49:56.467322 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:56.467290 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7171a2db-33c5-4d22-b9ff-a91d4d71e1d7-proc\") pod \"perf-node-gather-daemonset-r4qkh\" (UID: \"7171a2db-33c5-4d22-b9ff-a91d4d71e1d7\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-r4qkh" Jul 30 17:49:56.467619 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:56.467341 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7171a2db-33c5-4d22-b9ff-a91d4d71e1d7-proc\") pod \"perf-node-gather-daemonset-r4qkh\" (UID: \"7171a2db-33c5-4d22-b9ff-a91d4d71e1d7\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-r4qkh" Jul 30 17:49:56.467619 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:56.467356 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7171a2db-33c5-4d22-b9ff-a91d4d71e1d7-podres\") pod \"perf-node-gather-daemonset-r4qkh\" (UID: \"7171a2db-33c5-4d22-b9ff-a91d4d71e1d7\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-r4qkh" Jul 30 17:49:56.467619 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:56.467350 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9ldf\" (UniqueName: \"kubernetes.io/projected/7171a2db-33c5-4d22-b9ff-a91d4d71e1d7-kube-api-access-z9ldf\") pod \"perf-node-gather-daemonset-r4qkh\" (UID: \"7171a2db-33c5-4d22-b9ff-a91d4d71e1d7\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-r4qkh" Jul 30 17:49:56.476365 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:56.476335 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9ldf\" (UniqueName: \"kubernetes.io/projected/7171a2db-33c5-4d22-b9ff-a91d4d71e1d7-kube-api-access-z9ldf\") pod \"perf-node-gather-daemonset-r4qkh\" (UID: \"7171a2db-33c5-4d22-b9ff-a91d4d71e1d7\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-r4qkh" Jul 30 17:49:56.594125 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:56.594039 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-r4qkh" Jul 30 17:49:56.776567 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:56.776514 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-45p7p/perf-node-gather-daemonset-r4qkh"] Jul 30 17:49:57.253228 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:57.253202 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7t2wd_18095718-fd6d-4d25-ad02-25c48c851ab0/dns/0.log" Jul 30 17:49:57.279523 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:57.279497 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7t2wd_18095718-fd6d-4d25-ad02-25c48c851ab0/kube-rbac-proxy/0.log" Jul 30 17:49:57.361903 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:57.361868 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-r4qkh" event={"ID":"7171a2db-33c5-4d22-b9ff-a91d4d71e1d7","Type":"ContainerStarted","Data":"4789a0917e19387750392908fd38dd3e12466a87de5c4e3ceefa13f31997f318"} Jul 30 17:49:57.362081 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:57.361918 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-r4qkh" event={"ID":"7171a2db-33c5-4d22-b9ff-a91d4d71e1d7","Type":"ContainerStarted","Data":"064885502e812ad8a42092b18e8223599b4879b0760d6bb696be6c35cecc5c9b"} Jul 30 17:49:57.362081 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:57.362013 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-r4qkh" Jul 30 17:49:57.381678 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:57.381613 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-r4qkh" podStartSLOduration=1.381592677 podStartE2EDuration="1.381592677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:49:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:49:57.379882186 +0000 UTC m=+2943.512729143" watchObservedRunningTime="2026-07-30 17:49:57.381592677 +0000 UTC m=+2943.514439633" Jul 30 17:49:57.443811 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:57.443783 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tb5cb_41759fa3-9219-4210-9e10-5bf02dc9fb96/dns-node-resolver/0.log" Jul 30 17:49:57.964028 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:57.963995 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4wsb4_33961af5-8f26-48ff-98de-e0340507e385/node-ca/0.log" Jul 30 17:49:59.101589 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:59.101540 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mhm6l_f9d07348-83de-40fd-a5f7-1e47c44b306c/serve-healthcheck-canary/0.log" Jul 30 17:49:59.657090 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:59.657058 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tktgh_4f88bc24-37c8-4a16-9f26-67effbdbc720/kube-rbac-proxy/0.log" Jul 30 17:49:59.678742 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:59.678717 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tktgh_4f88bc24-37c8-4a16-9f26-67effbdbc720/exporter/0.log" Jul 30 17:49:59.703291 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:49:59.703267 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tktgh_4f88bc24-37c8-4a16-9f26-67effbdbc720/extractor/0.log" Jul 30 17:50:02.156224 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:50:02.156193 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-6dsp6_6aea8222-4628-4f80-81ef-fa39aefa0820/s3-init/0.log" Jul 30 17:50:02.173031 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:50:02.173005 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-6dsp6_6aea8222-4628-4f80-81ef-fa39aefa0820/download-hf-model/0.log" Jul 30 17:50:02.199809 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:50:02.199778 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-mpr6g_ad998c98-8fc7-46bd-be2c-5aa198f28a4e/seaweedfs/0.log" Jul 30 17:50:03.377787 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:50:03.377759 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-r4qkh" Jul 30 17:50:07.990143 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:50:07.990113 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8zvvk_b08e8de2-4dd8-4cde-b485-dc15f87d3915/kube-multus-additional-cni-plugins/0.log" Jul 30 17:50:08.014770 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:50:08.014740 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8zvvk_b08e8de2-4dd8-4cde-b485-dc15f87d3915/egress-router-binary-copy/0.log" Jul 30 17:50:08.037307 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:50:08.037281 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8zvvk_b08e8de2-4dd8-4cde-b485-dc15f87d3915/cni-plugins/0.log" Jul 30 17:50:08.059346 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:50:08.059324 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8zvvk_b08e8de2-4dd8-4cde-b485-dc15f87d3915/bond-cni-plugin/0.log" Jul 30 17:50:08.079924 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:50:08.079897 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8zvvk_b08e8de2-4dd8-4cde-b485-dc15f87d3915/routeoverride-cni/0.log" Jul 30 17:50:08.101253 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:50:08.101220 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8zvvk_b08e8de2-4dd8-4cde-b485-dc15f87d3915/whereabouts-cni-bincopy/0.log" Jul 30 17:50:08.121242 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:50:08.121220 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8zvvk_b08e8de2-4dd8-4cde-b485-dc15f87d3915/whereabouts-cni/0.log" Jul 30 17:50:08.187968 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:50:08.187943 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ssvk2_3ffbe09e-50f3-487b-8c82-5b6f992c5410/kube-multus/0.log" Jul 30 17:50:08.327263 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:50:08.327185 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8vjz8_3fdebda4-24ac-4c03-a395-a0e29dc51625/network-metrics-daemon/0.log" Jul 30 17:50:08.346955 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:50:08.346928 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8vjz8_3fdebda4-24ac-4c03-a395-a0e29dc51625/kube-rbac-proxy/0.log" Jul 30 17:50:09.092995 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:50:09.092964 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/ovn-controller/0.log" Jul 30 17:50:09.112199 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:50:09.112172 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/ovn-acl-logging/1.log" Jul 30 17:50:09.112354 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:50:09.112172 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/ovn-acl-logging/0.log" Jul 30 17:50:09.130944 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:50:09.130919 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/kube-rbac-proxy-node/0.log" Jul 30 17:50:09.158472 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:50:09.158446 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/kube-rbac-proxy-ovn-metrics/0.log" Jul 30 17:50:09.183954 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:50:09.183911 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/northd/0.log" Jul 30 17:50:09.211761 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:50:09.211738 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/nbdb/0.log" Jul 30 17:50:09.242046 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:50:09.242020 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/sbdb/0.log" Jul 30 17:50:09.317445 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:50:09.317414 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77btm_3ba7595c-0626-4561-8f94-ef72a6621ef1/ovnkube-controller/0.log" Jul 30 17:50:10.877369 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:50:10.877339 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-hwbcz_8400548d-00fa-439c-b7b9-3157adfd8f76/network-check-target-container/0.log" Jul 30 17:50:11.777071 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:50:11.777031 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-6t9xr_5dfaaf6d-53e5-4884-94e1-ff75d93560b5/iptables-alerter/0.log" Jul 30 17:50:12.618835 ip-10-0-136-120 kubenswrapper[2570]: I0730 17:50:12.618811 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-v2thn_6d100ab6-7f70-4ec4-a23f-58b7badc9b93/tuned/0.log"